e2e-kops-grid-cilium-eni-u2004-k26 #1609071740191772672
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 30 failed / 856 succeeded |
| Started | |
| Elapsed | 42m4s |
| Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\(allowExpansion\)\]\svolume\-expand\sshould\sresize\svolume\swhen\sPVC\sis\sedited\swhile\spod\sis\susing\sit$'
test/e2e/storage/testsuites/volume_expand.go:270 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func5() test/e2e/storage/testsuites/volume_expand.go:270 +0x3b3from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/31/22 06:45:14.611�[0m Dec 31 06:45:14.611: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename volume-expand �[38;5;243m12/31/22 06:45:14.612�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/31/22 06:45:14.707�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/31/22 06:45:14.77�[0m [BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/framework/metrics/init/init.go:31 [It] should resize volume when PVC is edited while pod is using it test/e2e/storage/testsuites/volume_expand.go:248 Dec 31 06:45:14.833: INFO: Creating resource for dynamic PV Dec 31 06:45:14.833: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} �[1mSTEP:�[0m creating a StorageClass volume-expand-9722-e2e-scqdz79 �[38;5;243m12/31/22 06:45:14.833�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m12/31/22 06:45:14.868�[0m �[1mSTEP:�[0m Creating a pod with dynamically provisioned volume �[38;5;243m12/31/22 06:45:14.935�[0m Dec 31 06:45:14.968: INFO: Waiting up to 5m0s for pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1" in namespace "volume-expand-9722" to be "running" Dec 31 06:45:15.000: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 31.60941ms Dec 31 06:45:17.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.064736883s Dec 31 06:45:19.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4.064000386s Dec 31 06:45:21.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 6.064758481s Dec 31 06:45:23.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 8.064577081s Dec 31 06:45:25.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 10.064723207s Dec 31 06:45:27.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 12.064488482s Dec 31 06:45:29.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 14.064485275s Dec 31 06:45:31.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 16.064203625s Dec 31 06:45:33.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 18.064227222s Dec 31 06:45:35.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 20.063595162s Dec 31 06:45:37.040: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 22.072081166s Dec 31 06:45:39.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 24.064486053s Dec 31 06:45:41.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 26.063975918s Dec 31 06:45:43.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 28.064617604s Dec 31 06:45:45.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 30.064187406s Dec 31 06:45:47.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 32.063760967s Dec 31 06:45:49.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 34.063694976s Dec 31 06:45:51.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 36.064303385s Dec 31 06:45:53.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 38.064790017s Dec 31 06:45:55.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 40.0650498s Dec 31 06:45:57.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 42.064723762s Dec 31 06:45:59.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 44.064469933s Dec 31 06:46:01.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 46.064739225s Dec 31 06:46:03.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 48.064623081s Dec 31 06:46:05.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 50.064708681s Dec 31 06:46:07.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 52.06439005s Dec 31 06:46:09.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 54.064867221s Dec 31 06:46:11.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 56.064159856s Dec 31 06:46:13.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 58.063965198s Dec 31 06:46:15.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.064116302s Dec 31 06:46:17.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.064546485s Dec 31 06:46:19.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.064568536s Dec 31 06:46:21.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.064378045s Dec 31 06:46:23.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.064499643s Dec 31 06:46:25.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.064940403s Dec 31 06:46:27.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.06474063s Dec 31 06:46:29.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.06410281s Dec 31 06:46:31.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.063886625s Dec 31 06:46:33.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.064171373s Dec 31 06:46:35.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.064097799s Dec 31 06:46:37.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.064579468s Dec 31 06:46:39.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.064625552s Dec 31 06:46:41.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.064332041s Dec 31 06:46:43.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.063938064s Dec 31 06:46:45.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.064210568s Dec 31 06:46:47.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.064478281s Dec 31 06:46:49.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.06445514s Dec 31 06:46:51.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.064420716s Dec 31 06:46:53.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.064416803s Dec 31 06:46:55.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.063623152s Dec 31 06:46:57.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.064442178s Dec 31 06:46:59.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.064503662s Dec 31 06:47:01.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.065026809s Dec 31 06:47:03.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.064076018s Dec 31 06:47:05.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.06466927s Dec 31 06:47:07.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.064994892s Dec 31 06:47:09.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.063957446s Dec 31 06:47:11.031: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.063357574s Dec 31 06:47:13.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.064388075s Dec 31 06:47:15.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.06450731s Dec 31 06:47:17.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.064205496s Dec 31 06:47:19.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.064050592s Dec 31 06:47:21.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.063947949s Dec 31 06:47:23.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.065182611s Dec 31 06:47:25.035: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.066504474s Dec 31 06:47:27.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.063428006s Dec 31 06:47:29.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.064044261s Dec 31 06:47:31.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.063955236s Dec 31 06:47:33.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.064398587s Dec 31 06:47:35.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.063820289s Dec 31 06:47:37.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.064475158s Dec 31 06:47:39.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.064307935s Dec 31 06:47:41.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.063681602s Dec 31 06:47:43.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.064255554s Dec 31 06:47:45.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.064359656s Dec 31 06:47:47.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.064462078s Dec 31 06:47:49.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.064721227s Dec 31 06:47:51.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.064152354s Dec 31 06:47:53.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.064328431s Dec 31 06:47:55.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.064112785s Dec 31 06:47:57.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.06423547s Dec 31 06:47:59.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.064280922s Dec 31 06:48:01.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.063876457s Dec 31 06:48:03.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.064523081s Dec 31 06:48:05.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.064783157s Dec 31 06:48:07.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.064470431s Dec 31 06:48:09.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.063886704s Dec 31 06:48:11.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.063622254s Dec 31 06:48:13.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.064373184s Dec 31 06:48:15.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.063799567s Dec 31 06:48:17.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.064546997s Dec 31 06:48:19.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.064482522s Dec 31 06:48:21.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.064921944s Dec 31 06:48:23.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.064748372s Dec 31 06:48:25.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.064487791s Dec 31 06:48:27.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.063753108s Dec 31 06:48:29.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.064278134s Dec 31 06:48:31.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.063902601s Dec 31 06:48:33.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.064216453s Dec 31 06:48:35.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.064120932s Dec 31 06:48:37.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.064557467s Dec 31 06:48:39.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.064520076s Dec 31 06:48:41.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.063869007s Dec 31 06:48:43.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.064091441s Dec 31 06:48:45.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.063775396s Dec 31 06:48:47.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.064045267s Dec 31 06:48:49.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.064667602s Dec 31 06:48:51.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.064305152s Dec 31 06:48:53.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.063737149s Dec 31 06:48:55.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.063937554s Dec 31 06:48:57.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.064266434s Dec 31 06:48:59.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.064362972s Dec 31 06:49:01.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.064058268s Dec 31 06:49:03.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.064431966s Dec 31 06:49:05.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.063985742s Dec 31 06:49:07.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.064270899s Dec 31 06:49:09.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.06441025s Dec 31 06:49:11.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.06436745s Dec 31 06:49:13.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.064148852s Dec 31 06:49:15.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.064455067s Dec 31 06:49:17.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.063364505s Dec 31 06:49:19.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.064575531s Dec 31 06:49:21.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.064662285s Dec 31 06:49:23.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.064390753s Dec 31 06:49:25.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.064151174s Dec 31 06:49:27.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.064183749s Dec 31 06:49:29.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.06360502s Dec 31 06:49:31.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.063786612s Dec 31 06:49:33.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.064287708s Dec 31 06:49:35.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.064061645s Dec 31 06:49:37.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.063699228s Dec 31 06:49:39.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.064648891s Dec 31 06:49:41.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.064329597s Dec 31 06:49:43.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.064760834s Dec 31 06:49:45.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.063644329s Dec 31 06:49:47.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.064187804s Dec 31 06:49:49.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.064401032s Dec 31 06:49:51.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.06461663s Dec 31 06:49:53.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.064745507s Dec 31 06:49:55.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.064061705s Dec 31 06:49:57.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.064817695s Dec 31 06:49:59.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.064307407s Dec 31 06:50:01.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.064276326s Dec 31 06:50:03.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.064609814s Dec 31 06:50:05.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.06404116s Dec 31 06:50:07.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.064520355s Dec 31 06:50:09.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.064699581s Dec 31 06:50:11.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.063850845s Dec 31 06:50:13.033: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.065324515s Dec 31 06:50:15.032: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.064058833s Dec 31 06:50:15.064: INFO: Pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.095862535s Dec 31 06:50:15.064: INFO: Unexpected error: While creating pods for resizing: <*errors.errorString | 0xc0042b0a10>: { s: "pod \"pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1\" is not Running: timed out while waiting for pod volume-expand-9722/pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1 to be running", } Dec 31 06:50:15.064: FAIL: While creating pods for resizing: pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1" is not Running: timed out while waiting for pod volume-expand-9722/pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1 to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func5() test/e2e/storage/testsuites/volume_expand.go:270 +0x3b3 Dec 31 06:50:15.064: INFO: Deleting pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1" in namespace "volume-expand-9722" Dec 31 06:50:15.101: INFO: Wait up to 5m0s for pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1" to be fully deleted �[1mSTEP:�[0m Deleting pod �[38;5;243m12/31/22 06:50:17.165�[0m Dec 31 06:50:17.165: INFO: Deleting pod "pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1" in namespace "volume-expand-9722" �[1mSTEP:�[0m Deleting pvc �[38;5;243m12/31/22 06:50:17.196�[0m Dec 31 06:50:17.262: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comdzp9l" Dec 31 06:50:17.298: INFO: Waiting up to 5m0s for PersistentVolume pvc-884928e4-c800-435c-bafc-edeea324ce49 to get deleted Dec 31 06:50:17.330: INFO: PersistentVolume pvc-884928e4-c800-435c-bafc-edeea324ce49 found and phase=Released (31.496995ms) Dec 31 06:50:22.363: INFO: PersistentVolume pvc-884928e4-c800-435c-bafc-edeea324ce49 found and phase=Released (5.064399913s) Dec 31 06:50:27.396: INFO: PersistentVolume pvc-884928e4-c800-435c-bafc-edeea324ce49 found and phase=Released (10.097479845s) Dec 31 06:50:32.429: INFO: PersistentVolume pvc-884928e4-c800-435c-bafc-edeea324ce49 found and phase=Released (15.130513747s) Dec 31 06:50:37.464: INFO: PersistentVolume pvc-884928e4-c800-435c-bafc-edeea324ce49 was removed �[1mSTEP:�[0m Deleting sc �[38;5;243m12/31/22 06:50:37.464�[0m [AfterEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/framework/node/init/init.go:32 Dec 31 06:50:37.497: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m12/31/22 06:50:37.53�[0m �[1mSTEP:�[0m Collecting events from namespace "volume-expand-9722". �[38;5;243m12/31/22 06:50:37.53�[0m �[1mSTEP:�[0m Found 18 events. �[38;5;243m12/31/22 06:50:37.562�[0m Dec 31 06:50:37.562: INFO: At 2022-12-31 06:45:14 +0000 UTC - event for ebs.csi.aws.comdzp9l: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Dec 31 06:50:37.562: INFO: At 2022-12-31 06:45:14 +0000 UTC - event for ebs.csi.aws.comdzp9l: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Dec 31 06:50:37.562: INFO: At 2022-12-31 06:45:14 +0000 UTC - event for ebs.csi.aws.comdzp9l: {ebs.csi.aws.com_ebs-csi-controller-89b649c94-wxqzv_57c0034f-3597-4ac7-8161-5faf40bb36c5 } Provisioning: External provisioner is provisioning volume for claim "volume-expand-9722/ebs.csi.aws.comdzp9l" Dec 31 06:50:37.562: INFO: At 2022-12-31 06:45:18 +0000 UTC - event for ebs.csi.aws.comdzp9l: {ebs.csi.aws.com_ebs-csi-controller-89b649c94-wxqzv_57c0034f-3597-4ac7-8161-5faf40bb36c5 } ProvisioningSucceeded: Successfully provisioned volume pvc-884928e4-c800-435c-bafc-edeea324ce49 Dec 31 06:50:37.562: INFO: At 2022-12-31 06:45:18 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {default-scheduler } Scheduled: Successfully assigned volume-expand-9722/pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1 to i-01238e73720e34636 Dec 31 06:50:37.562: INFO: At 2022-12-31 06:45:21 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-884928e4-c800-435c-bafc-edeea324ce49" Dec 31 06:50:37.562: INFO: At 2022-12-31 06:45:26 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-884928e4-c800-435c-bafc-edeea324ce49" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-884928e4-c800-435c-bafc-edeea324ce49/dev" Dec 31 06:50:37.562: INFO: At 2022-12-31 06:45:26 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-884928e4-c800-435c-bafc-edeea324ce49" volumeMapPath "/var/lib/kubelet/pods/44d9a149-fbd9-4a13-886c-6f4ffba908b0/volumeDevices/kubernetes.io~csi" Dec 31 06:50:37.562: INFO: At 2022-12-31 06:45:26 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "26c9c9fd8ca996d5ab79a8cc4e0741c204341ebcc58c6839c0e20ad50c2fc378": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:50:37.562: INFO: At 2022-12-31 06:45:41 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2aadd2d8049f128ccc2c0e934ae0e52b7ee50cfc9820eb9ee5fcf212240e40ea": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:50:37.562: INFO: At 2022-12-31 06:45:57 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bd6fb561625268538e63afbe00c89f6e4a2072ab0ab236af664c799b869be2c4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:50:37.562: INFO: At 2022-12-31 06:46:08 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "95da901c0290f41e7abd93a9e6d5a2b02c0748fdafd0be9e7359183f517bd5d3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:50:37.562: INFO: At 2022-12-31 06:46:19 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "af451c8184a51638fa3583575322c4538e335e4b6c90514aba88a8605a15a802": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:50:37.562: INFO: At 2022-12-31 06:46:35 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "beebbdb3a0cc86af58d96112a320fde4bfa490f6e7c0bd4a35edb1d0d847be1c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:50:37.562: INFO: At 2022-12-31 06:46:46 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "05ffbb2f3ac780af04229d099c5e8d9165a53f9f704ce7987cf7bb68545a1708": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:50:37.562: INFO: At 2022-12-31 06:47:00 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3828b7276c07f4a67a52e0877284b30846cb8e45460a597919cda33d07f5f141": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:50:37.562: INFO: At 2022-12-31 06:47:12 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b6ab2d0032b0d1079b960ae87c37f66065f2c9966dbb12e22e1d2fe3677571ea": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:50:37.562: INFO: At 2022-12-31 06:47:24 +0000 UTC - event for pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "809c7a4d1d64295c33d2fd0937bde304c8c7922d06d7a648632d3da8ea6580b9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:50:37.593: INFO: POD NODE PHASE GRACE CONDITIONS Dec 31 06:50:37.593: INFO: Dec 31 06:50:37.631: INFO: Logging node info for node i-01238e73720e34636 Dec 31 06:50:37.663: INFO: Node Info: &Node{ObjectMeta:{i-01238e73720e34636 6336cf01-1d9c-435d-8598-300dc5c8cd47 35510 0 2022-12-31 06:25:53 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01238e73720e34636 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01238e73720e34636 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.17 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3583":"i-01238e73720e34636","ebs.csi.aws.com":"i-01238e73720e34636"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:50:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-31 06:50:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01238e73720e34636,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:21 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:21 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:21 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:50:21 +0000 UTC,LastTransitionTime:2022-12-31 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.17,},NodeAddress{Type:ExternalIP,Address:3.96.140.88,},NodeAddress{Type:InternalDNS,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-140-88.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b18c944e5e0e896bb3ef13f5e91a,SystemUUID:ec25b18c-944e-5e0e-896b-b3ef13f5e91a,BootID:429656db-871c-45f8-90c8-d6173d395019,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-3583^616d8a85-88d7-11ed-b9fa-e6ad9d19c67c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-3583^616d8a85-88d7-11ed-b9fa-e6ad9d19c67c,DevicePath:,},},Config:nil,},} Dec 31 06:50:37.663: INFO: Logging kubelet events for node i-01238e73720e34636 Dec 31 06:50:37.699: INFO: Logging pods the kubelet thinks is on node i-01238e73720e34636 Dec 31 06:50:37.737: INFO: netserver-0 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:37.737: INFO: Container webserver ready: true, restart count 0 Dec 31 06:50:37.737: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-jp975 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:37.737: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:37.737: INFO: liveness-b70d75f9-6d71-4d42-8a6f-6c67485e530b started at 2022-12-31 06:50:05 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:37.737: INFO: Container agnhost-container ready: false, restart count 0 Dec 31 06:50:37.737: INFO: busybox-scheduling-37b7f98b-5177-4d1c-8bab-167c37ae7994 started at 2022-12-31 06:50:29 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:37.737: INFO: Container busybox-scheduling-37b7f98b-5177-4d1c-8bab-167c37ae7994 ready: false, restart count 0 Dec 31 06:50:37.737: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xpfkc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:37.737: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:37.737: INFO: ebs-csi-node-5sskd started at 2022-12-31 06:25:54 +0000 UTC (0+3 container statuses recorded) Dec 31 06:50:37.737: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:50:37.737: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:50:37.737: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 31 06:50:37.737: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:45:39 +0000 UTC (0+7 container statuses recorded) Dec 31 06:50:37.737: INFO: Container csi-attacher ready: true, restart count 0 Dec 31 06:50:37.737: INFO: Container csi-provisioner ready: true, restart count 0 Dec 31 06:50:37.737: INFO: Container csi-resizer ready: true, restart count 0 Dec 31 06:50:37.737: INFO: Container csi-snapshotter ready: true, restart count 0 Dec 31 06:50:37.737: INFO: Container hostpath ready: true, restart count 0 Dec 31 06:50:37.737: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:50:37.737: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 31 06:50:37.737: INFO: pod-subpath-test-dynamicpv-fhw8 started at 2022-12-31 06:50:16 +0000 UTC (1+2 container statuses recorded) Dec 31 06:50:37.737: INFO: Init container test-init-subpath-dynamicpv-fhw8 ready: false, restart count 0 Dec 31 06:50:37.737: INFO: Container test-container-subpath-dynamicpv-fhw8 ready: false, restart count 0 Dec 31 06:50:37.737: INFO: Container test-container-volume-dynamicpv-fhw8 ready: false, restart count 0 Dec 31 06:50:37.737: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-t2p68 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:37.737: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:37.737: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-md99c started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:37.737: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:37.737: INFO: cilium-jtczt started at 2022-12-31 06:25:54 +0000 UTC (1+1 container statuses recorded) Dec 31 06:50:37.737: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 31 06:50:37.737: INFO: Container cilium-agent ready: true, restart count 0 Dec 31 06:50:37.737: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-tkxdw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:37.737: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:37.737: INFO: nodeport-test-zdf2l started at 2022-12-31 06:45:24 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:37.737: INFO: Container nodeport-test ready: false, restart count 0 Dec 31 06:50:37.928: INFO: Latency metrics for node i-01238e73720e34636 Dec 31 06:50:37.928: INFO: Logging node info for node i-02803f86e9c119889 Dec 31 06:50:37.960: INFO: Node Info: &Node{ObjectMeta:{i-02803f86e9c119889 4f26fd9b-7bc7-4f71-8b66-a761d4c63f01 35513 0 2022-12-31 06:25:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02803f86e9c119889 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-02803f86e9c119889 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.83 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5953":"i-02803f86e9c119889","ebs.csi.aws.com":"i-02803f86e9c119889"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-02803f86e9c119889,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.83,},NodeAddress{Type:ExternalIP,Address:3.96.199.254,},NodeAddress{Type:InternalDNS,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-199-254.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23319fa293bc90a121ffa207804bf8,SystemUUID:ec23319f-a293-bc90-a121-ffa207804bf8,BootID:443b01ac-cd9d-4547-9748-ec9c7edbc67a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-5953^93ecf6eb-88d6-11ed-aa52-6a9e5ddd1dab],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 31 06:50:37.960: INFO: Logging kubelet events for node i-02803f86e9c119889 Dec 31 06:50:37.996: INFO: Logging pods the kubelet thinks is on node i-02803f86e9c119889 Dec 31 06:50:38.045: INFO: ebs-csi-node-8hn4r started at 2022-12-31 06:25:40 +0000 UTC (0+3 container statuses recorded) Dec 31 06:50:38.045: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:50:38.045: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:50:38.045: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 31 06:50:38.045: INFO: csi-mockplugin-0 started at 2022-12-31 06:38:47 +0000 UTC (0+3 container statuses recorded) Dec 31 06:50:38.045: INFO: Container csi-provisioner ready: true, restart count 0 Dec 31 06:50:38.045: INFO: Container driver-registrar ready: true, restart count 0 Dec 31 06:50:38.045: INFO: Container mock ready: true, restart count 0 Dec 31 06:50:38.045: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:38:48 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:50:38.045: INFO: hostexec-i-02803f86e9c119889-8htdv started at 2022-12-31 06:50:12 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container agnhost-container ready: true, restart count 0 Dec 31 06:50:38.045: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:55 +0000 UTC (0+7 container statuses recorded) Dec 31 06:50:38.045: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container csi-provisioner ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container csi-resizer ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container csi-snapshotter ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container hostpath ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container liveness-probe ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container node-driver-registrar ready: false, restart count 0 Dec 31 06:50:38.045: INFO: inline-volume-tester-2zpb4 started at 2022-12-31 06:44:56 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container csi-volume-tester ready: false, restart count 0 Dec 31 06:50:38.045: INFO: hostexec-i-02803f86e9c119889-487mz started at 2022-12-31 06:50:21 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container agnhost-container ready: true, restart count 0 Dec 31 06:50:38.045: INFO: pod-subpath-test-preprovisionedpv-hzg4 started at 2022-12-31 06:49:30 +0000 UTC (1+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Init container init-volume-preprovisionedpv-hzg4 ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container test-container-subpath-preprovisionedpv-hzg4 ready: false, restart count 0 Dec 31 06:50:38.045: INFO: coredns-autoscaler-7cb5c5b969-pt9s2 started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container autoscaler ready: true, restart count 0 Dec 31 06:50:38.045: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-hthc5 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.045: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:45:38 +0000 UTC (0+7 container statuses recorded) Dec 31 06:50:38.045: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container csi-provisioner ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container csi-resizer ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container csi-snapshotter ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container hostpath ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container liveness-probe ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container node-driver-registrar ready: false, restart count 0 Dec 31 06:50:38.045: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-bhwsk started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.045: INFO: coredns-559769c974-r8xfg started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container coredns ready: true, restart count 0 Dec 31 06:50:38.045: INFO: hostexec-i-02803f86e9c119889-7dr55 started at 2022-12-31 06:49:21 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container agnhost-container ready: true, restart count 0 Dec 31 06:50:38.045: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9564 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.045: INFO: netserver-1 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container webserver ready: false, restart count 0 Dec 31 06:50:38.045: INFO: pod-subpath-test-preprovisionedpv-vtl7 started at 2022-12-31 06:50:29 +0000 UTC (2+2 container statuses recorded) Dec 31 06:50:38.045: INFO: Init container init-volume-preprovisionedpv-vtl7 ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Init container test-init-subpath-preprovisionedpv-vtl7 ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container test-container-subpath-preprovisionedpv-vtl7 ready: false, restart count 0 Dec 31 06:50:38.045: INFO: Container test-container-volume-preprovisionedpv-vtl7 ready: false, restart count 0 Dec 31 06:50:38.045: INFO: local-injector started at 2022-12-31 06:50:30 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container local-injector ready: false, restart count 0 Dec 31 06:50:38.045: INFO: cilium-24dpj started at 2022-12-31 06:25:40 +0000 UTC (1+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 31 06:50:38.045: INFO: Container cilium-agent ready: true, restart count 0 Dec 31 06:50:38.045: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wd9vv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.045: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-sqdwl started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.045: INFO: pvc-volume-tester-m8r85 started at 2022-12-31 06:44:30 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.045: INFO: Container volume-tester ready: false, restart count 0 Dec 31 06:50:38.279: INFO: Latency metrics for node i-02803f86e9c119889 Dec 31 06:50:38.279: INFO: Logging node info for node i-04ba2526d2f93fe75 Dec 31 06:50:38.311: INFO: Node Info: &Node{ObjectMeta:{i-04ba2526d2f93fe75 66716b11-28bf-41d8-82f8-881d9a36efb5 35547 0 2022-12-31 06:25:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04ba2526d2f93fe75 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04ba2526d2f93fe75 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.50.49 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-7116":"i-04ba2526d2f93fe75","ebs.csi.aws.com":"i-04ba2526d2f93fe75"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:45:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-31 06:50:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04ba2526d2f93fe75,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:29 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:29 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:29 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:50:29 +0000 UTC,LastTransitionTime:2022-12-31 06:26:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.50.49,},NodeAddress{Type:ExternalIP,Address:35.182.108.97,},NodeAddress{Type:InternalDNS,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-108-97.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bacfd4cdc1a7d3a3ee77d377f7e34,SystemUUID:ec2bacfd-4cdc-1a7d-3a3e-e77d377f7e34,BootID:c6b8143b-5a4c-4cc7-b066-49b954ceaace,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-7116^678662dc-88d7-11ed-b88b-229e5d9e75a6 kubernetes.io/csi/ebs.csi.aws.com^vol-005302b9e4e7ea2c5 kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2 kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-005302b9e4e7ea2c5,DevicePath:,},},Config:nil,},} Dec 31 06:50:38.312: INFO: Logging kubelet events for node i-04ba2526d2f93fe75 Dec 31 06:50:38.346: INFO: Logging pods the kubelet thinks is on node i-04ba2526d2f93fe75 Dec 31 06:50:38.386: INFO: pod-projected-configmaps-b8587cbb-8506-4722-8faf-8fb0ae032c44 started at 2022-12-31 06:49:29 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container projected-configmap-volume-test ready: false, restart count 0 Dec 31 06:50:38.386: INFO: ebs-csi-node-rq4r2 started at 2022-12-31 06:25:53 +0000 UTC (0+3 container statuses recorded) Dec 31 06:50:38.386: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:50:38.386: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:50:38.386: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 31 06:50:38.386: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wgmwt started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.386: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-rz4lh started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.386: INFO: inline-volume-tester-rg5s8 started at 2022-12-31 06:44:26 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container csi-volume-tester ready: false, restart count 0 Dec 31 06:50:38.386: INFO: ss2-0 started at 2022-12-31 06:49:23 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container webserver ready: false, restart count 0 Dec 31 06:50:38.386: INFO: pod-failure-ignore-zlrmr started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container c ready: false, restart count 0 Dec 31 06:50:38.386: INFO: pod-failure-ignore-jxmrf started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container c ready: false, restart count 0 Dec 31 06:50:38.386: INFO: dns-test-bc7f6354-b3b1-49ed-a319-b3b8a3eb57f3 started at 2022-12-31 06:49:24 +0000 UTC (0+3 container statuses recorded) Dec 31 06:50:38.386: INFO: Container jessie-querier ready: false, restart count 0 Dec 31 06:50:38.386: INFO: Container querier ready: false, restart count 0 Dec 31 06:50:38.386: INFO: Container webserver ready: false, restart count 0 Dec 31 06:50:38.386: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9xgv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.386: INFO: inline-volume-tester-6zlk7 started at 2022-12-31 06:39:27 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container csi-volume-tester ready: false, restart count 0 Dec 31 06:50:38.386: INFO: csi-mockplugin-0 started at 2022-12-31 06:46:38 +0000 UTC (0+3 container statuses recorded) Dec 31 06:50:38.386: INFO: Container csi-provisioner ready: true, restart count 0 Dec 31 06:50:38.386: INFO: Container driver-registrar ready: true, restart count 0 Dec 31 06:50:38.386: INFO: Container mock ready: true, restart count 0 Dec 31 06:50:38.386: INFO: netserver-2 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container webserver ready: false, restart count 0 Dec 31 06:50:38.386: INFO: pod-projected-secrets-5f396008-04ce-487d-9532-13fce0c1a47c started at 2022-12-31 06:49:58 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container projected-secret-volume-test ready: false, restart count 0 Dec 31 06:50:38.386: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:46:38 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container csi-resizer ready: false, restart count 0 Dec 31 06:50:38.386: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-j5hrc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.386: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kxjl4 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.386: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:46:38 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:50:38.386: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:49:23 +0000 UTC (0+7 container statuses recorded) Dec 31 06:50:38.386: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:50:38.386: INFO: Container csi-provisioner ready: false, restart count 0 Dec 31 06:50:38.386: INFO: Container csi-resizer ready: false, restart count 0 Dec 31 06:50:38.386: INFO: Container csi-snapshotter ready: false, restart count 0 Dec 31 06:50:38.386: INFO: Container hostpath ready: false, restart count 0 Dec 31 06:50:38.386: INFO: Container liveness-probe ready: false, restart count 0 Dec 31 06:50:38.386: INFO: Container node-driver-registrar ready: false, restart count 0 Dec 31 06:50:38.386: INFO: pvc-volume-tester-z9p46 started at 2022-12-31 06:50:25 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container volume-tester ready: false, restart count 0 Dec 31 06:50:38.386: INFO: nodeport-test-kd22w started at 2022-12-31 06:45:24 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container nodeport-test ready: true, restart count 0 Dec 31 06:50:38.386: INFO: cilium-jswjf started at 2022-12-31 06:25:53 +0000 UTC (1+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 31 06:50:38.386: INFO: Container cilium-agent ready: true, restart count 0 Dec 31 06:50:38.386: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kl6rx started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.386: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.599: INFO: Latency metrics for node i-04ba2526d2f93fe75 Dec 31 06:50:38.599: INFO: Logging node info for node i-0623d19705b93fa12 Dec 31 06:50:38.631: INFO: Node Info: &Node{ObjectMeta:{i-0623d19705b93fa12 42adab5d-2a9f-490b-8d96-b2134aee6d35 34236 0 2022-12-31 06:23:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0623d19705b93fa12 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.244 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0623d19705b93fa12"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-31 06:23:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-31 06:24:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:24:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-31 06:46:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0623d19705b93fa12,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:24:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.244,},NodeAddress{Type:ExternalIP,Address:3.96.201.212,},NodeAddress{Type:InternalDNS,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-201-212.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27d827c769aef19bbb1df3025ce86a,SystemUUID:ec27d827-c769-aef1-9bbb-1df3025ce86a,BootID:e238e24c-8167-4573-a762-5c346ea34877,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451628,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805582,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967330,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 31 06:50:38.631: INFO: Logging kubelet events for node i-0623d19705b93fa12 Dec 31 06:50:38.668: INFO: Logging pods the kubelet thinks is on node i-0623d19705b93fa12 Dec 31 06:50:38.706: INFO: cilium-5qps9 started at 2022-12-31 06:24:30 +0000 UTC (1+1 container statuses recorded) Dec 31 06:50:38.706: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 31 06:50:38.706: INFO: Container cilium-agent ready: true, restart count 0 Dec 31 06:50:38.706: INFO: kops-controller-5j56z started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.706: INFO: Container kops-controller ready: true, restart count 0 Dec 31 06:50:38.706: INFO: ebs-csi-controller-89b649c94-wxqzv started at 2022-12-31 06:24:30 +0000 UTC (0+5 container statuses recorded) Dec 31 06:50:38.706: INFO: Container csi-attacher ready: true, restart count 0 Dec 31 06:50:38.706: INFO: Container csi-provisioner ready: true, restart count 0 Dec 31 06:50:38.706: INFO: Container csi-resizer ready: true, restart count 0 Dec 31 06:50:38.706: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:50:38.706: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:50:38.706: INFO: kube-controller-manager-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.706: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 31 06:50:38.706: INFO: kube-scheduler-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.706: INFO: Container kube-scheduler ready: true, restart count 0 Dec 31 06:50:38.706: INFO: kube-apiserver-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+2 container statuses recorded) Dec 31 06:50:38.706: INFO: Container healthcheck ready: true, restart count 0 Dec 31 06:50:38.706: INFO: Container kube-apiserver ready: true, restart count 1 Dec 31 06:50:38.706: INFO: ebs-csi-node-pnmdn started at 2022-12-31 06:24:30 +0000 UTC (0+3 container statuses recorded) Dec 31 06:50:38.706: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:50:38.706: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:50:38.706: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 31 06:50:38.706: INFO: aws-cloud-controller-manager-68vsl started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.706: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Dec 31 06:50:38.706: INFO: cilium-operator-5dd44dc49f-gwnh5 started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.706: INFO: Container cilium-operator ready: true, restart count 0 Dec 31 06:50:38.706: INFO: dns-controller-69987775c6-989tg started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.706: INFO: Container dns-controller ready: true, restart count 0 Dec 31 06:50:38.706: INFO: etcd-manager-events-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.706: INFO: Container etcd-manager ready: true, restart count 0 Dec 31 06:50:38.706: INFO: etcd-manager-main-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.706: INFO: Container etcd-manager ready: true, restart count 0 Dec 31 06:50:38.880: INFO: Latency metrics for node i-0623d19705b93fa12 Dec 31 06:50:38.880: INFO: Logging node info for node i-07e0b1652877916dd Dec 31 06:50:38.912: INFO: Node Info: &Node{ObjectMeta:{i-07e0b1652877916dd 503d2e8d-789d-4154-983b-d84a9e1f26d3 35507 0 2022-12-31 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07e0b1652877916dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-07e0b1652877916dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.32 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2668":"i-07e0b1652877916dd","csi-mock-csi-mock-volumes-3959":"i-07e0b1652877916dd","ebs.csi.aws.com":"i-07e0b1652877916dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2022-12-31 06:45:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-07e0b1652877916dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:26:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.32,},NodeAddress{Type:ExternalIP,Address:3.96.208.158,},NodeAddress{Type:InternalDNS,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-208-158.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23f46c8ef59d08a0747ddba3b48b3e,SystemUUID:ec23f46c-8ef5-9d08-a074-7ddba3b48b3e,BootID:7f531ed6-40f4-44aa-95ac-677cf2d148cb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2668^b7704c85-88d6-11ed-bda0-764bfc430f4f kubernetes.io/csi/csi-mock-csi-mock-volumes-3959^a09d1446-88d6-11ed-9ca5-ce024c9251f3],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 31 06:50:38.912: INFO: Logging kubelet events for node i-07e0b1652877916dd Dec 31 06:50:38.946: INFO: Logging pods the kubelet thinks is on node i-07e0b1652877916dd Dec 31 06:50:38.994: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:45:37 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:50:38.995: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:44:25 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:50:38.995: INFO: cilium-4xz2s started at 2022-12-31 06:25:52 +0000 UTC (1+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 31 06:50:38.995: INFO: Container cilium-agent ready: true, restart count 0 Dec 31 06:50:38.995: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xxrt2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.995: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-s49xp started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:38.995: INFO: pvc-volume-tester-9hhmr started at 2022-12-31 06:44:51 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Container volume-tester ready: false, restart count 0 Dec 31 06:50:38.995: INFO: ebs-csi-node-sgtqp started at 2022-12-31 06:25:52 +0000 UTC (0+3 container statuses recorded) Dec 31 06:50:38.995: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:50:38.995: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:50:38.995: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 31 06:50:38.995: INFO: pvc-volume-tester-cn5lf started at 2022-12-31 06:45:32 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Container volume-tester ready: false, restart count 0 Dec 31 06:50:38.995: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Container csi-resizer ready: false, restart count 0 Dec 31 06:50:38.995: INFO: csi-mockplugin-0 started at 2022-12-31 06:45:37 +0000 UTC (0+3 container statuses recorded) Dec 31 06:50:38.995: INFO: Container csi-provisioner ready: false, restart count 0 Dec 31 06:50:38.995: INFO: Container driver-registrar ready: false, restart count 0 Dec 31 06:50:38.995: INFO: Container mock ready: false, restart count 0 Dec 31 06:50:38.995: INFO: csi-mockplugin-0 started at 2022-12-31 06:39:09 +0000 UTC (0+3 container statuses recorded) Dec 31 06:50:38.995: INFO: Container csi-provisioner ready: true, restart count 0 Dec 31 06:50:38.995: INFO: Container driver-registrar ready: true, restart count 0 Dec 31 06:50:38.995: INFO: Container mock ready: true, restart count 0 Dec 31 06:50:38.995: INFO: netserver-3 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Container webserver ready: false, restart count 0 Dec 31 06:50:38.995: INFO: csi-mockplugin-0 started at 2022-12-31 06:44:25 +0000 UTC (0+3 container statuses recorded) Dec 31 06:50:38.995: INFO: Container csi-provisioner ready: true, restart count 0 Dec 31 06:50:38.995: INFO: Container driver-registrar ready: true, restart count 0 Dec 31 06:50:38.995: INFO: Container mock ready: true, restart count 0 Dec 31 06:50:38.995: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:50:38.995: INFO: coredns-559769c974-tz7zd started at 2022-12-31 06:26:19 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Container coredns ready: true, restart count 0 Dec 31 06:50:38.995: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wnd2m started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:50:38.995: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:50:39.283: INFO: Latency metrics for node i-07e0b1652877916dd [DeferCleanup (Each)] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "volume-expand-9722" for this suite. �[38;5;243m12/31/22 06:50:39.283�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\svolumes\sshould\sstore\sdata$'
test/e2e/framework/volume/fixtures.go:571
k8s.io/kubernetes/test/e2e/framework/volume.InjectContent(0xc000fb85a0, {{0xc003d8a0e0, 0xb}, {0x75c30d7, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...)
test/e2e/framework/volume/fixtures.go:571 +0x279
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/volumes.go:185 +0x457
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/31/22 06:45:32.555�[0m
Dec 31 06:45:32.555: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename volume �[38;5;243m12/31/22 06:45:32.556�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/31/22 06:45:32.653�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/31/22 06:45:32.714�[0m
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
test/e2e/framework/metrics/init/init.go:31
[It] should store data
test/e2e/storage/testsuites/volumes.go:158
Dec 31 06:45:32.775: INFO: Creating resource for dynamic PV
Dec 31 06:45:32.775: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass volume-1830-e2e-scqmtkj �[38;5;243m12/31/22 06:45:32.776�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m12/31/22 06:45:32.807�[0m
Dec 31 06:45:32.808: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m starting external-injector �[38;5;243m12/31/22 06:45:32.872�[0m
Dec 31 06:45:32.906: INFO: Waiting up to 5m0s for pod "external-injector" in namespace "volume-1830" to be "running"
Dec 31 06:45:32.937: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 31.089506ms
Dec 31 06:45:34.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062287539s
Dec 31 06:45:36.994: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.087764834s
Dec 31 06:45:38.978: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.071519799s
Dec 31 06:45:40.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.063656019s
Dec 31 06:45:42.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 10.063696236s
Dec 31 06:45:44.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 12.062761979s
Dec 31 06:45:46.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 14.062770956s
Dec 31 06:45:48.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 16.062911562s
Dec 31 06:45:50.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 18.062570316s
Dec 31 06:45:52.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 20.063264545s
Dec 31 06:45:54.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 22.063144049s
Dec 31 06:45:56.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 24.062901947s
Dec 31 06:45:58.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 26.063210951s
Dec 31 06:46:00.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 28.062742221s
Dec 31 06:46:02.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 30.063337471s
Dec 31 06:46:04.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 32.062744434s
Dec 31 06:46:06.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 34.06284418s
Dec 31 06:46:08.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 36.062946902s
Dec 31 06:46:10.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 38.064278487s
Dec 31 06:46:12.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 40.062732665s
Dec 31 06:46:14.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 42.063282701s
Dec 31 06:46:16.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 44.06257607s
Dec 31 06:46:18.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 46.06385283s
Dec 31 06:46:20.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 48.062583057s
Dec 31 06:46:22.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 50.062761797s
Dec 31 06:46:24.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 52.062726535s
Dec 31 06:46:26.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 54.062755171s
Dec 31 06:46:28.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 56.063341625s
Dec 31 06:46:30.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 58.063969685s
Dec 31 06:46:32.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.062489896s
Dec 31 06:46:34.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.063107797s
Dec 31 06:46:36.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.063300254s
Dec 31 06:46:38.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.063183632s
Dec 31 06:46:40.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.062291276s
Dec 31 06:46:42.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.06394596s
Dec 31 06:46:44.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.063089628s
Dec 31 06:46:46.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.062848s
Dec 31 06:46:48.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.063170144s
Dec 31 06:46:50.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.063285438s
Dec 31 06:46:52.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.062798731s
Dec 31 06:46:54.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.062658934s
Dec 31 06:46:56.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.062349585s
Dec 31 06:46:58.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.062836836s
Dec 31 06:47:00.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.062977172s
Dec 31 06:47:02.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.064015715s
Dec 31 06:47:04.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.062543891s
Dec 31 06:47:06.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.06235893s
Dec 31 06:47:08.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.063535565s
Dec 31 06:47:10.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.062247485s
Dec 31 06:47:12.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.062780013s
Dec 31 06:47:14.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.063411196s
Dec 31 06:47:16.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.064203729s
Dec 31 06:47:18.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.063248304s
Dec 31 06:47:20.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.062570169s
Dec 31 06:47:22.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.063083937s
Dec 31 06:47:24.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.062937884s
Dec 31 06:47:26.972: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.066057933s
Dec 31 06:47:28.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.063577763s
Dec 31 06:47:30.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.063003804s
Dec 31 06:47:32.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.062850794s
Dec 31 06:47:34.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.063239773s
Dec 31 06:47:36.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.063310238s
Dec 31 06:47:38.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.063625478s
Dec 31 06:47:40.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.06221867s
Dec 31 06:47:42.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.062395445s
Dec 31 06:47:44.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.062736494s
Dec 31 06:47:46.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.062842474s
Dec 31 06:47:48.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.063535697s
Dec 31 06:47:50.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.064006581s
Dec 31 06:47:52.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.063052948s
Dec 31 06:47:54.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.06303314s
Dec 31 06:47:56.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.062410634s
Dec 31 06:47:58.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.062647766s
Dec 31 06:48:00.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.063680699s
Dec 31 06:48:02.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.062744183s
Dec 31 06:48:04.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.063050525s
Dec 31 06:48:06.972: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.065689217s
Dec 31 06:48:08.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.062677253s
Dec 31 06:48:10.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.063106671s
Dec 31 06:48:12.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.06263553s
Dec 31 06:48:14.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.063156594s
Dec 31 06:48:16.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.06308913s
Dec 31 06:48:18.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.063043469s
Dec 31 06:48:20.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.063048371s
Dec 31 06:48:22.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.062716186s
Dec 31 06:48:24.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.063204711s
Dec 31 06:48:26.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.062823214s
Dec 31 06:48:28.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.062459426s
Dec 31 06:48:30.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.063762759s
Dec 31 06:48:32.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.062326704s
Dec 31 06:48:34.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.063261726s
Dec 31 06:48:36.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.063386572s
Dec 31 06:48:38.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.062685674s
Dec 31 06:48:40.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.062481589s
Dec 31 06:48:42.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.063529651s
Dec 31 06:48:44.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.062716569s
Dec 31 06:48:46.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.062287195s
Dec 31 06:48:48.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.063471378s
Dec 31 06:48:50.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.063310973s
Dec 31 06:48:52.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.062783275s
Dec 31 06:48:54.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.06290945s
Dec 31 06:48:56.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.062311324s
Dec 31 06:48:58.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.062872004s
Dec 31 06:49:00.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.062763173s
Dec 31 06:49:02.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.063079014s
Dec 31 06:49:04.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.062582568s
Dec 31 06:49:06.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.063902298s
Dec 31 06:49:08.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.063183322s
Dec 31 06:49:10.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.062347585s
Dec 31 06:49:12.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.062271433s
Dec 31 06:49:14.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.062887991s
Dec 31 06:49:16.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.062675849s
Dec 31 06:49:18.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.062835521s
Dec 31 06:49:20.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.063538172s
Dec 31 06:49:22.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.0641275s
Dec 31 06:49:24.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.063635196s
Dec 31 06:49:26.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.063215025s
Dec 31 06:49:28.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.062464887s
Dec 31 06:49:30.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.062783705s
Dec 31 06:49:32.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.063698427s
Dec 31 06:49:34.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.063337113s
Dec 31 06:49:36.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.062900614s
Dec 31 06:49:38.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.0636593s
Dec 31 06:49:40.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.063822283s
Dec 31 06:49:42.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.063229398s
Dec 31 06:49:44.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.063627164s
Dec 31 06:49:46.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.063898735s
Dec 31 06:49:48.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.063672079s
Dec 31 06:49:50.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.063719296s
Dec 31 06:49:52.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.063746435s
Dec 31 06:49:54.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.063297954s
Dec 31 06:49:56.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.063488708s
Dec 31 06:49:58.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.062617255s
Dec 31 06:50:00.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.063294262s
Dec 31 06:50:02.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.063775919s
Dec 31 06:50:04.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.063643554s
Dec 31 06:50:06.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.062938259s
Dec 31 06:50:08.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.064002025s
Dec 31 06:50:10.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.064369704s
Dec 31 06:50:12.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.063682299s
Dec 31 06:50:14.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.063705227s
Dec 31 06:50:16.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.062655199s
Dec 31 06:50:18.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.063454996s
Dec 31 06:50:20.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.063708318s
Dec 31 06:50:22.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.063948322s
Dec 31 06:50:24.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.063062389s
Dec 31 06:50:26.968: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.062122442s
Dec 31 06:50:28.970: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.063654598s
Dec 31 06:50:30.971: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.064783349s
Dec 31 06:50:32.969: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.063126493s
Dec 31 06:50:33.001: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.094509975s
�[1mSTEP:�[0m Deleting pod external-injector in namespace volume-1830 �[38;5;243m12/31/22 06:50:33.001�[0m
Dec 31 06:50:33.037: INFO: Waiting for pod external-injector to disappear
Dec 31 06:50:33.068: INFO: Pod external-injector still exists
Dec 31 06:50:35.069: INFO: Waiting for pod external-injector to disappear
Dec 31 06:50:35.100: INFO: Pod external-injector no longer exists
Dec 31 06:50:35.100: FAIL: Failed to create injector pod: timed out while waiting for pod volume-1830/external-injector to be running
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/volume.InjectContent(0xc000fb85a0, {{0xc003d8a0e0, 0xb}, {0x75c30d7, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...)
test/e2e/framework/volume/fixtures.go:571 +0x279
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/volumes.go:185 +0x457
�[1mSTEP:�[0m cleaning the environment after external �[38;5;243m12/31/22 06:50:35.1�[0m
�[1mSTEP:�[0m Deleting pvc �[38;5;243m12/31/22 06:50:35.1�[0m
Dec 31 06:50:35.163: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com5vwmv"
Dec 31 06:50:35.198: INFO: Waiting up to 5m0s for PersistentVolume pvc-4354687d-b71b-4f37-b399-5fd6715d9531 to get deleted
Dec 31 06:50:35.232: INFO: PersistentVolume pvc-4354687d-b71b-4f37-b399-5fd6715d9531 found and phase=Released (34.043339ms)
Dec 31 06:50:40.263: INFO: PersistentVolume pvc-4354687d-b71b-4f37-b399-5fd6715d9531 found and phase=Released (5.065298529s)
Dec 31 06:50:45.297: INFO: PersistentVolume pvc-4354687d-b71b-4f37-b399-5fd6715d9531 found and phase=Released (10.098942692s)
Dec 31 06:50:50.332: INFO: PersistentVolume pvc-4354687d-b71b-4f37-b399-5fd6715d9531 found and phase=Released (15.133993284s)
Dec 31 06:50:55.364: INFO: PersistentVolume pvc-4354687d-b71b-4f37-b399-5fd6715d9531 was removed
�[1mSTEP:�[0m Deleting sc �[38;5;243m12/31/22 06:50:55.364�[0m
[AfterEach] [Testpattern: Dynamic PV (default fs)] volumes
test/e2e/framework/node/init/init.go:32
Dec 31 06:50:55.400: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m12/31/22 06:50:55.435�[0m
�[1mSTEP:�[0m Collecting events from namespace "volume-1830". �[38;5;243m12/31/22 06:50:55.435�[0m
�[1mSTEP:�[0m Found 16 events. �[38;5;243m12/31/22 06:50:55.468�[0m
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:45:32 +0000 UTC - event for ebs.csi.aws.com5vwmv: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:45:32 +0000 UTC - event for ebs.csi.aws.com5vwmv: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:45:32 +0000 UTC - event for ebs.csi.aws.com5vwmv: {ebs.csi.aws.com_ebs-csi-controller-89b649c94-wxqzv_57c0034f-3597-4ac7-8161-5faf40bb36c5 } Provisioning: External provisioner is provisioning volume for claim "volume-1830/ebs.csi.aws.com5vwmv"
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:45:36 +0000 UTC - event for ebs.csi.aws.com5vwmv: {ebs.csi.aws.com_ebs-csi-controller-89b649c94-wxqzv_57c0034f-3597-4ac7-8161-5faf40bb36c5 } ProvisioningSucceeded: Successfully provisioned volume pvc-4354687d-b71b-4f37-b399-5fd6715d9531
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:45:36 +0000 UTC - event for external-injector: {default-scheduler } Scheduled: Successfully assigned volume-1830/external-injector to i-04ba2526d2f93fe75
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:45:39 +0000 UTC - event for external-injector: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-4354687d-b71b-4f37-b399-5fd6715d9531"
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:45:45 +0000 UTC - event for external-injector: {kubelet i-04ba2526d2f93fe75} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "58289060ee5c51a1c3d8b8aa7176f6e946e5c3c5534846e6b75d77342c8c7f2f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:45:56 +0000 UTC - event for external-injector: {kubelet i-04ba2526d2f93fe75} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "15cdf8160887456b31adcd95d56b9ce6342cf50ee6a9dd8eaf9446a40637277b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:46:08 +0000 UTC - event for external-injector: {kubelet i-04ba2526d2f93fe75} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "baa048dff3e879f00550b4df63382745e62029970198cd7591ff67d98efd96a7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:46:22 +0000 UTC - event for external-injector: {kubelet i-04ba2526d2f93fe75} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6d3aa7b4a536486f7a152676e41e1f57a363e549108ba2c12334068351cad6e7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:46:35 +0000 UTC - event for external-injector: {kubelet i-04ba2526d2f93fe75} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "125c19434fe5f4576e7e8e780877cd42d4aa6a1e8dd666a7037d73fee838b0b0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:46:50 +0000 UTC - event for external-injector: {kubelet i-04ba2526d2f93fe75} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "567fbc79e52b86f4be334109ef76019d624093d8eb536b71fcb0254cc9216ba8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:47:02 +0000 UTC - event for external-injector: {kubelet i-04ba2526d2f93fe75} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b5eef6a67b7ee810f52473c79b6d17e5f69d4bfc67a4f33fb7caeac91bf91254": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:47:16 +0000 UTC - event for external-injector: {kubelet i-04ba2526d2f93fe75} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "07ef0ee2a54c8f998dcae588e3e7cb14953cdaf34fc429f6288f359c1eceda30": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:47:27 +0000 UTC - event for external-injector: {kubelet i-04ba2526d2f93fe75} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "276db60b05f74025b1eacdd41e22adb3eb26a3e7ed6036bfbb97b55f16cd46b3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:55.468: INFO: At 2022-12-31 06:47:42 +0000 UTC - event for external-injector: {kubelet i-04ba2526d2f93fe75} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8851ae152dec5ffe549de9245e0b244f399953ccf028840cbfb03a7680efb6a8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:55.501: INFO: POD NODE PHASE GRACE CONDITIONS
Dec 31 06:50:55.501: INFO:
Dec 31 06:50:55.544: INFO:
Logging node info for node i-01238e73720e34636
Dec 31 06:50:55.575: INFO: Node Info: &Node{ObjectMeta:{i-01238e73720e34636 6336cf01-1d9c-435d-8598-300dc5c8cd47 36313 0 2022-12-31 06:25:53 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01238e73720e34636 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01238e73720e34636 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.17 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3583":"i-01238e73720e34636","csi-mock-csi-mock-volumes-8286":"i-01238e73720e34636","ebs.csi.aws.com":"i-01238e73720e34636"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2022-12-31 06:50:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2022-12-31 06:50:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01238e73720e34636,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:52 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:52 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:52 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:50:52 +0000 UTC,LastTransitionTime:2022-12-31 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.17,},NodeAddress{Type:ExternalIP,Address:3.96.140.88,},NodeAddress{Type:InternalDNS,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-140-88.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b18c944e5e0e896bb3ef13f5e91a,SystemUUID:ec25b18c-944e-5e0e-896b-b3ef13f5e91a,BootID:429656db-871c-45f8-90c8-d6173d395019,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-8286^767a7d2d-88d7-11ed-8565-6224a62e5e37,DevicePath:,},},Config:nil,},}
Dec 31 06:50:55.576: INFO:
Logging kubelet events for node i-01238e73720e34636
Dec 31 06:50:55.609: INFO:
Logging pods the kubelet thinks is on node i-01238e73720e34636
Dec 31 06:50:55.655: INFO: pvc-volume-tester-4z8j7 started at 2022-12-31 06:50:51 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:55.655: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:50:55.655: INFO: pod-init-59672285-acd4-466f-b965-f2a4de814c8b started at 2022-12-31 06:50:49 +0000 UTC (2+1 container statuses recorded)
Dec 31 06:50:55.655: INFO: Init container init1 ready: false, restart count 1
Dec 31 06:50:55.655: INFO: Init container init2 ready: false, restart count 0
Dec 31 06:50:55.655: INFO: Container run1 ready: false, restart count 0
Dec 31 06:50:55.655: INFO: ebs-csi-node-5sskd started at 2022-12-31 06:25:54 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:55.655: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:55.655: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:55.655: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:55.655: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:45:39 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:50:55.655: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:55.655: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:55.655: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:50:55.655: INFO: Container csi-snapshotter ready: true, restart count 0
Dec 31 06:50:55.655: INFO: Container hostpath ready: true, restart count 0
Dec 31 06:50:55.655: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:55.655: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:55.655: INFO: cilium-jtczt started at 2022-12-31 06:25:54 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:55.655: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:50:55.655: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:50:55.655: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:50:40 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:55.655: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:55.655: INFO: hostexec-i-01238e73720e34636-4z9p8 started at 2022-12-31 06:50:49 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:55.655: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:50:55.655: INFO: csi-mockplugin-0 started at 2022-12-31 06:50:40 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:55.655: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:55.655: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:50:55.655: INFO: Container mock ready: true, restart count 0
Dec 31 06:50:55.655: INFO: netserver-0 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:55.655: INFO: Container webserver ready: true, restart count 0
Dec 31 06:50:55.655: INFO: liveness-b70d75f9-6d71-4d42-8a6f-6c67485e530b started at 2022-12-31 06:50:05 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:55.655: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:50:55.655: INFO: busybox-scheduling-37b7f98b-5177-4d1c-8bab-167c37ae7994 started at 2022-12-31 06:50:29 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:55.655: INFO: Container busybox-scheduling-37b7f98b-5177-4d1c-8bab-167c37ae7994 ready: true, restart count 0
Dec 31 06:50:55.934: INFO:
Latency metrics for node i-01238e73720e34636
Dec 31 06:50:55.934: INFO:
Logging node info for node i-02803f86e9c119889
Dec 31 06:50:55.966: INFO: Node Info: &Node{ObjectMeta:{i-02803f86e9c119889 4f26fd9b-7bc7-4f71-8b66-a761d4c63f01 36342 0 2022-12-31 06:25:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02803f86e9c119889 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-02803f86e9c119889 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.83 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-5143":"i-02803f86e9c119889","csi-hostpath-ephemeral-8236":"i-02803f86e9c119889","csi-mock-csi-mock-volumes-5953":"i-02803f86e9c119889","ebs.csi.aws.com":"i-02803f86e9c119889"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:50:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2022-12-31 06:50:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-02803f86e9c119889,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.83,},NodeAddress{Type:ExternalIP,Address:3.96.199.254,},NodeAddress{Type:InternalDNS,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-199-254.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23319fa293bc90a121ffa207804bf8,SystemUUID:ec23319f-a293-bc90-a121-ffa207804bf8,BootID:443b01ac-cd9d-4547-9748-ec9c7edbc67a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-5953^93ecf6eb-88d6-11ed-aa52-6a9e5ddd1dab],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-5143^765fecbb-88d7-11ed-a0f1-e2c08298e02d,DevicePath:,},},Config:nil,},}
Dec 31 06:50:55.966: INFO:
Logging kubelet events for node i-02803f86e9c119889
Dec 31 06:50:56.008: INFO:
Logging pods the kubelet thinks is on node i-02803f86e9c119889
Dec 31 06:50:56.051: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:38:48 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:56.051: INFO: hostexec-i-02803f86e9c119889-8htdv started at 2022-12-31 06:50:12 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:50:56.051: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:55 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container csi-snapshotter ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container hostpath ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:56.051: INFO: inline-volume-tester-2zpb4 started at 2022-12-31 06:44:56 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:50:56.051: INFO: pod-subpath-test-preprovisionedpv-hzg4 started at 2022-12-31 06:49:30 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Init container init-volume-preprovisionedpv-hzg4 ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container test-container-subpath-preprovisionedpv-hzg4 ready: true, restart count 0
Dec 31 06:50:56.051: INFO: local-client started at 2022-12-31 06:50:53 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container local-client ready: false, restart count 0
Dec 31 06:50:56.051: INFO: coredns-autoscaler-7cb5c5b969-pt9s2 started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container autoscaler ready: true, restart count 0
Dec 31 06:50:56.051: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:45:38 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container csi-snapshotter ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container hostpath ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:56.051: INFO: coredns-559769c974-r8xfg started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container coredns ready: true, restart count 0
Dec 31 06:50:56.051: INFO: hostexec-i-02803f86e9c119889-7dr55 started at 2022-12-31 06:49:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:50:56.051: INFO: hostexec-i-02803f86e9c119889-k8cb6 started at 2022-12-31 06:50:51 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:50:56.051: INFO: netserver-1 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container webserver ready: false, restart count 0
Dec 31 06:50:56.051: INFO: cilium-24dpj started at 2022-12-31 06:25:40 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:50:56.051: INFO: inline-volume-tester-blcmm started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.051: INFO: pvc-volume-tester-m8r85 started at 2022-12-31 06:44:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:50:56.051: INFO: ebs-csi-node-8hn4r started at 2022-12-31 06:25:40 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:56.051: INFO: csi-mockplugin-0 started at 2022-12-31 06:38:47 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container mock ready: true, restart count 0
Dec 31 06:50:56.051: INFO: pod-handle-http-request started at 2022-12-31 06:50:47 +0000 UTC (0+2 container statuses recorded)
Dec 31 06:50:56.051: INFO: Container container-handle-http-request ready: true, restart count 0
Dec 31 06:50:56.051: INFO: Container container-handle-https-request ready: true, restart count 0
Dec 31 06:50:56.296: INFO:
Latency metrics for node i-02803f86e9c119889
Dec 31 06:50:56.296: INFO:
Logging node info for node i-04ba2526d2f93fe75
Dec 31 06:50:56.329: INFO: Node Info: &Node{ObjectMeta:{i-04ba2526d2f93fe75 66716b11-28bf-41d8-82f8-881d9a36efb5 36177 0 2022-12-31 06:25:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04ba2526d2f93fe75 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04ba2526d2f93fe75 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.50.49 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-1866":"i-04ba2526d2f93fe75","csi-mock-csi-mock-volumes-7116":"i-04ba2526d2f93fe75","ebs.csi.aws.com":"i-04ba2526d2f93fe75"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:50:45 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-31 06:50:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04ba2526d2f93fe75,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:50 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:50 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:50 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:50:50 +0000 UTC,LastTransitionTime:2022-12-31 06:26:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.50.49,},NodeAddress{Type:ExternalIP,Address:35.182.108.97,},NodeAddress{Type:InternalDNS,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-108-97.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bacfd4cdc1a7d3a3ee77d377f7e34,SystemUUID:ec2bacfd-4cdc-1a7d-3a3e-e77d377f7e34,BootID:c6b8143b-5a4c-4cc7-b066-49b954ceaace,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-1866^7294d859-88d7-11ed-b81f-567d5eb104df kubernetes.io/csi/csi-mock-csi-mock-volumes-7116^678662dc-88d7-11ed-b88b-229e5d9e75a6 kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2 kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-7116^678662dc-88d7-11ed-b88b-229e5d9e75a6,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-1866^7294d859-88d7-11ed-b81f-567d5eb104df,DevicePath:,},},Config:nil,},}
Dec 31 06:50:56.329: INFO:
Logging kubelet events for node i-04ba2526d2f93fe75
Dec 31 06:50:56.363: INFO:
Logging pods the kubelet thinks is on node i-04ba2526d2f93fe75
Dec 31 06:50:56.412: INFO: cilium-jswjf started at 2022-12-31 06:25:53 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:56.412: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:50:56.412: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:50:56.412: INFO: pod-service-account-defaultsa-nomountspec started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.412: INFO: pod-service-account-mountsa-nomountspec started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.412: INFO: pod-with-poststart-exec-hook started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.412: INFO: pod-projected-configmaps-b8587cbb-8506-4722-8faf-8fb0ae032c44 started at 2022-12-31 06:49:29 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.412: INFO: Container projected-configmap-volume-test ready: false, restart count 0
Dec 31 06:50:56.412: INFO: ebs-csi-node-rq4r2 started at 2022-12-31 06:25:53 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:56.412: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:56.412: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:56.412: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:56.412: INFO: pod-service-account-defaultsa-mountspec started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.412: INFO: pod-service-account-nomountsa-nomountspec started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.412: INFO: inline-volume-tester-rg5s8 started at 2022-12-31 06:44:26 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.412: INFO: Container csi-volume-tester ready: true, restart count 0
Dec 31 06:50:56.412: INFO: ss2-0 started at 2022-12-31 06:49:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.412: INFO: Container webserver ready: false, restart count 0
Dec 31 06:50:56.412: INFO: pod-failure-ignore-zlrmr started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.412: INFO: Container c ready: false, restart count 0
Dec 31 06:50:56.412: INFO: pod-failure-ignore-jxmrf started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.412: INFO: Container c ready: false, restart count 0
Dec 31 06:50:56.412: INFO: pod-service-account-nomountsa started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.412: INFO: pod-7d37fe93-4e2c-4481-a1a8-42e3b39fa124 started at 2022-12-31 06:50:44 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.412: INFO: Container write-pod ready: false, restart count 0
Dec 31 06:50:56.412: INFO: pod-service-account-nomountsa-mountspec started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.412: INFO: inline-volume-tester-6zlk7 started at 2022-12-31 06:39:27 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.412: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:50:56.412: INFO: csi-mockplugin-0 started at 2022-12-31 06:46:38 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:56.412: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:56.412: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:50:56.413: INFO: Container mock ready: true, restart count 0
Dec 31 06:50:56.413: INFO: netserver-2 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.413: INFO: Container webserver ready: false, restart count 0
Dec 31 06:50:56.413: INFO: pod-service-account-mountsa started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.413: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:46:38 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.413: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:50:56.413: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:46:38 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.413: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:56.413: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:49:23 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:50:56.413: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:56.413: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:56.413: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:50:56.413: INFO: Container csi-snapshotter ready: true, restart count 0
Dec 31 06:50:56.413: INFO: Container hostpath ready: true, restart count 0
Dec 31 06:50:56.413: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:56.413: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:56.413: INFO: pod-failure-ignore-vxrm2 started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.413: INFO: pod-service-account-defaultsa started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.413: INFO: pvc-volume-tester-z9p46 started at 2022-12-31 06:50:25 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.413: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:50:56.413: INFO: nodeport-test-kd22w started at 2022-12-31 06:45:24 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.413: INFO: Container nodeport-test ready: true, restart count 0
Dec 31 06:50:56.413: INFO: pod-service-account-mountsa-mountspec started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.413: INFO: rand-non-local-wsb29 started at <nil> (0+0 container statuses recorded)
Dec 31 06:50:56.724: INFO:
Latency metrics for node i-04ba2526d2f93fe75
Dec 31 06:50:56.724: INFO:
Logging node info for node i-0623d19705b93fa12
Dec 31 06:50:56.755: INFO: Node Info: &Node{ObjectMeta:{i-0623d19705b93fa12 42adab5d-2a9f-490b-8d96-b2134aee6d35 34236 0 2022-12-31 06:23:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0623d19705b93fa12 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.244 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0623d19705b93fa12"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-31 06:23:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-31 06:24:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:24:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-31 06:46:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0623d19705b93fa12,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:24:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.244,},NodeAddress{Type:ExternalIP,Address:3.96.201.212,},NodeAddress{Type:InternalDNS,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-201-212.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27d827c769aef19bbb1df3025ce86a,SystemUUID:ec27d827-c769-aef1-9bbb-1df3025ce86a,BootID:e238e24c-8167-4573-a762-5c346ea34877,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451628,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805582,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967330,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:50:56.756: INFO:
Logging kubelet events for node i-0623d19705b93fa12
Dec 31 06:50:56.790: INFO:
Logging pods the kubelet thinks is on node i-0623d19705b93fa12
Dec 31 06:50:56.827: INFO: cilium-operator-5dd44dc49f-gwnh5 started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.827: INFO: Container cilium-operator ready: true, restart count 0
Dec 31 06:50:56.827: INFO: dns-controller-69987775c6-989tg started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.827: INFO: Container dns-controller ready: true, restart count 0
Dec 31 06:50:56.827: INFO: etcd-manager-events-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.827: INFO: Container etcd-manager ready: true, restart count 0
Dec 31 06:50:56.827: INFO: etcd-manager-main-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.827: INFO: Container etcd-manager ready: true, restart count 0
Dec 31 06:50:56.827: INFO: kube-apiserver-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+2 container statuses recorded)
Dec 31 06:50:56.827: INFO: Container healthcheck ready: true, restart count 0
Dec 31 06:50:56.827: INFO: Container kube-apiserver ready: true, restart count 1
Dec 31 06:50:56.827: INFO: ebs-csi-node-pnmdn started at 2022-12-31 06:24:30 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:56.827: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:56.827: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:56.827: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:56.827: INFO: aws-cloud-controller-manager-68vsl started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.827: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Dec 31 06:50:56.827: INFO: kube-controller-manager-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.827: INFO: Container kube-controller-manager ready: true, restart count 2
Dec 31 06:50:56.827: INFO: kube-scheduler-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.827: INFO: Container kube-scheduler ready: true, restart count 0
Dec 31 06:50:56.827: INFO: cilium-5qps9 started at 2022-12-31 06:24:30 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:56.827: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:50:56.827: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:50:56.827: INFO: kops-controller-5j56z started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:56.827: INFO: Container kops-controller ready: true, restart count 0
Dec 31 06:50:56.827: INFO: ebs-csi-controller-89b649c94-wxqzv started at 2022-12-31 06:24:30 +0000 UTC (0+5 container statuses recorded)
Dec 31 06:50:56.827: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:56.827: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:56.827: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:50:56.827: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:56.827: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:56.991: INFO:
Latency metrics for node i-0623d19705b93fa12
Dec 31 06:50:56.991: INFO:
Logging node info for node i-07e0b1652877916dd
Dec 31 06:50:57.022: INFO: Node Info: &Node{ObjectMeta:{i-07e0b1652877916dd 503d2e8d-789d-4154-983b-d84a9e1f26d3 36256 0 2022-12-31 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07e0b1652877916dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-07e0b1652877916dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.32 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2254":"i-07e0b1652877916dd","csi-mock-csi-mock-volumes-2668":"i-07e0b1652877916dd","csi-mock-csi-mock-volumes-3959":"i-07e0b1652877916dd","ebs.csi.aws.com":"i-07e0b1652877916dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2022-12-31 06:50:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-07e0b1652877916dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:51 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:51 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:50:51 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:50:51 +0000 UTC,LastTransitionTime:2022-12-31 06:26:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.32,},NodeAddress{Type:ExternalIP,Address:3.96.208.158,},NodeAddress{Type:InternalDNS,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-208-158.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23f46c8ef59d08a0747ddba3b48b3e,SystemUUID:ec23f46c-8ef5-9d08-a074-7ddba3b48b3e,BootID:7f531ed6-40f4-44aa-95ac-677cf2d148cb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:50:57.022: INFO:
Logging kubelet events for node i-07e0b1652877916dd
Dec 31 06:50:57.056: INFO:
Logging pods the kubelet thinks is on node i-07e0b1652877916dd
Dec 31 06:50:57.095: INFO: csi-mockplugin-0 started at 2022-12-31 06:44:25 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:57.095: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:57.095: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:50:57.095: INFO: Container mock ready: true, restart count 0
Dec 31 06:50:57.095: INFO: coredns-559769c974-tz7zd started at 2022-12-31 06:26:19 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:57.095: INFO: Container coredns ready: true, restart count 0
Dec 31 06:50:57.095: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:57.095: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:57.095: INFO: cilium-4xz2s started at 2022-12-31 06:25:52 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:57.095: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:50:57.095: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:50:57.095: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:45:37 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:57.095: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:57.095: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:44:25 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:57.095: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:57.095: INFO: ebs-csi-node-sgtqp started at 2022-12-31 06:25:52 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:57.095: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:57.095: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:57.095: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:57.095: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:57.095: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:50:57.095: INFO: netserver-3 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:57.095: INFO: Container webserver ready: false, restart count 0
Dec 31 06:50:57.095: INFO: csi-mockplugin-0 started at 2022-12-31 06:45:37 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:57.095: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:57.095: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:50:57.095: INFO: Container mock ready: true, restart count 0
Dec 31 06:50:57.095: INFO: csi-mockplugin-0 started at 2022-12-31 06:39:09 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:57.095: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:57.095: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:50:57.095: INFO: Container mock ready: true, restart count 0
Dec 31 06:50:57.332: INFO:
Latency metrics for node i-07e0b1652877916dd
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "volume-1830" for this suite. �[38;5;243m12/31/22 06:50:57.332�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAggregator\sShould\sbe\sable\sto\ssupport\sthe\s1\.17\sSample\sAPI\sServer\susing\sthe\scurrent\sAggregator\s\[Conformance\]$'
test/e2e/apimachinery/aggregator.go:333
k8s.io/kubernetes/test/e2e/apimachinery.TestSampleAPIServer(0xc00078a4b0, 0xc00500c768, {0xc00501aa80, 0x37})
test/e2e/apimachinery/aggregator.go:333 +0x2c05
k8s.io/kubernetes/test/e2e/apimachinery.glob..func1.3()
test/e2e/apimachinery/aggregator.go:102 +0x125
[BeforeEach] [sig-api-machinery] Aggregator
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/31/22 06:45:14.945�[0m
Dec 31 06:45:14.945: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename aggregator �[38;5;243m12/31/22 06:45:14.946�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/31/22 06:45:15.044�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/31/22 06:45:15.106�[0m
[BeforeEach] [sig-api-machinery] Aggregator
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] Aggregator
test/e2e/apimachinery/aggregator.go:78
Dec 31 06:45:15.168: INFO: >>> kubeConfig: /root/.kube/config
[It] Should be able to support the 1.17 Sample API Server using the current Aggregator [Conformance]
test/e2e/apimachinery/aggregator.go:100
�[1mSTEP:�[0m Registering the sample API server. �[38;5;243m12/31/22 06:45:15.169�[0m
Dec 31 06:45:16.028: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:18.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:20.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:22.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:24.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:26.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:28.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:30.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:32.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:34.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:36.063: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:38.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:40.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:42.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:44.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:46.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:48.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:50.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:52.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:54.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:56.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:45:58.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:00.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:02.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:04.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:06.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:08.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:10.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:12.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:14.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:16.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:18.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:20.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:22.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:24.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:26.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:28.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:30.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:32.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:34.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:36.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:38.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:40.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:42.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:44.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:46.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:48.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:50.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:52.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:54.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:56.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:46:58.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:00.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:02.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:04.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:06.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:08.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:10.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:12.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:14.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:16.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:18.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:20.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:22.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:24.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:26.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:28.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:30.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:32.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:34.062: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:36.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:38.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:40.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:42.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:44.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:46.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:48.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:50.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:52.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:54.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:56.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:47:58.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:00.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:02.062: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:04.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:06.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:08.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:10.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:12.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:14.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:16.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:18.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:20.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:22.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:24.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:26.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:28.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:30.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:32.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:34.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:36.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:38.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:40.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:42.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:44.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:46.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:48.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:50.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:52.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:54.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:56.063: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:48:58.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:00.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:02.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:04.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:06.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:08.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:10.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:12.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:14.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:16.062: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:18.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:20.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:22.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:24.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:26.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:28.064: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:30.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:32.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:34.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:36.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:38.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:40.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:42.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:44.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:46.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:48.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:50.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:52.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:54.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:56.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:49:58.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:50:00.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:50:02.060: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:50:04.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:50:06.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:50:08.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:50:10.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:50:12.062: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:50:14.061: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:50:16.065: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:50:16.096: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Dec 31 06:50:16.096: INFO: Unexpected error: deploying extension apiserver in namespace aggregator-9598:
<*errors.errorString | 0xc003f40ac0>: {
s: "error waiting for deployment \"sample-apiserver-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"sample-apiserver-deployment-55bd96fd47\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}",
}
Dec 31 06:50:16.096: FAIL: deploying extension apiserver in namespace aggregator-9598: error waiting for deployment "sample-apiserver-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), LastTransitionTime:time.Date(2022, time.December, 31, 6, 45, 15, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-apiserver-deployment-55bd96fd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.TestSampleAPIServer(0xc00078a4b0, 0xc00500c768, {0xc00501aa80, 0x37})
test/e2e/apimachinery/aggregator.go:333 +0x2c05
k8s.io/kubernetes/test/e2e/apimachinery.glob..func1.3()
test/e2e/apimachinery/aggregator.go:102 +0x125
[AfterEach] [sig-api-machinery] Aggregator
test/e2e/apimachinery/aggregator.go:68
[AfterEach] [sig-api-machinery] Aggregator
test/e2e/framework/node/init/init.go:32
Dec 31 06:50:16.403: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-api-machinery] Aggregator
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] Aggregator
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m12/31/22 06:50:16.436�[0m
�[1mSTEP:�[0m Collecting events from namespace "aggregator-9598". �[38;5;243m12/31/22 06:50:16.436�[0m
�[1mSTEP:�[0m Found 13 events. �[38;5;243m12/31/22 06:50:16.468�[0m
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:45:15 +0000 UTC - event for sample-apiserver-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-apiserver-deployment-55bd96fd47 to 1
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:45:15 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47: {replicaset-controller } SuccessfulCreate: Created pod: sample-apiserver-deployment-55bd96fd47-b49pn
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:45:15 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-b49pn: {default-scheduler } Scheduled: Successfully assigned aggregator-9598/sample-apiserver-deployment-55bd96fd47-b49pn to i-01238e73720e34636
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:45:16 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-b49pn: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "93ca50822fa935e96f459e20f7028d9fcffcf63ec3d55ae820e27eb37fa54458": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:45:26 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-b49pn: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "43e52e7137cf7b06f73edffdecc686c300bf485d59ec1525be55f5a2ccc3b00a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:45:41 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-b49pn: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1056e5cc707a3b7338c4c4e49bb6c1cfe3b547db56196a30b3c3649bd9cff61d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:45:54 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-b49pn: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "467720eb2c188232a719084e575fdda0228151c208773436fde3bd9f4ff74b22": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:46:05 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-b49pn: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6f04838830f5545920de24ec47e3e864fbc88fa4bde5c01084f18ea460ad026c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:46:16 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-b49pn: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7cd06731d431f35b1ec2036eee2dfea6ab4c6d8bef60ef5e3527b3e6e3408024": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:46:27 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-b49pn: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4aaf7ebeafe4e33ab166e515b0275d5aec28dc73269e232232db5b302bedfbb1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:46:42 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-b49pn: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dd986aa93b572fe1fac55d23ffd25bdf6287ae4bb4f1e56336d30025a6174886": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:46:54 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-b49pn: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d7e50157a52b7f850610134d1e1a2973a5b861c3dee63315c992d391d1bfc26d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:16.468: INFO: At 2022-12-31 06:47:05 +0000 UTC - event for sample-apiserver-deployment-55bd96fd47-b49pn: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a0375a2d66ae667c969731d35c0ebffee131c394a8599169e15e36d161b8ebf1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:50:16.499: INFO: POD NODE PHASE GRACE CONDITIONS
Dec 31 06:50:16.499: INFO:
Dec 31 06:50:16.535: INFO:
Logging node info for node i-01238e73720e34636
Dec 31 06:50:16.566: INFO: Node Info: &Node{ObjectMeta:{i-01238e73720e34636 6336cf01-1d9c-435d-8598-300dc5c8cd47 35356 0 2022-12-31 06:25:53 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01238e73720e34636 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01238e73720e34636 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.17 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-3583":"i-01238e73720e34636","ebs.csi.aws.com":"i-01238e73720e34636"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:45:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-31 06:50:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01238e73720e34636,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.17,},NodeAddress{Type:ExternalIP,Address:3.96.140.88,},NodeAddress{Type:InternalDNS,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-140-88.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b18c944e5e0e896bb3ef13f5e91a,SystemUUID:ec25b18c-944e-5e0e-896b-b3ef13f5e91a,BootID:429656db-871c-45f8-90c8-d6173d395019,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-017852f53c72a0ef1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-017852f53c72a0ef1,DevicePath:,},},Config:nil,},}
Dec 31 06:50:16.567: INFO:
Logging kubelet events for node i-01238e73720e34636
Dec 31 06:50:16.601: INFO:
Logging pods the kubelet thinks is on node i-01238e73720e34636
Dec 31 06:50:16.640: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-fppmn started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.640: INFO: cilium-jtczt started at 2022-12-31 06:25:54 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:50:16.640: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:50:16.640: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-57rjk started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.640: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-tkxdw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.640: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-mb5bq started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.640: INFO: nodeport-test-zdf2l started at 2022-12-31 06:45:24 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container nodeport-test ready: false, restart count 0
Dec 31 06:50:16.640: INFO: netserver-0 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container webserver ready: true, restart count 0
Dec 31 06:50:16.640: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-jp975 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.640: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-dbm42 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.640: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-t9sfw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.640: INFO: liveness-b70d75f9-6d71-4d42-8a6f-6c67485e530b started at 2022-12-31 06:50:05 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container agnhost-container ready: false, restart count 0
Dec 31 06:50:16.640: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xpfkc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.640: INFO: pod-subpath-test-dynamicpv-fhw8 started at 2022-12-31 06:50:16 +0000 UTC (1+2 container statuses recorded)
Dec 31 06:50:16.640: INFO: Init container test-init-subpath-dynamicpv-fhw8 ready: false, restart count 0
Dec 31 06:50:16.640: INFO: Container test-container-subpath-dynamicpv-fhw8 ready: false, restart count 0
Dec 31 06:50:16.640: INFO: Container test-container-volume-dynamicpv-fhw8 ready: false, restart count 0
Dec 31 06:50:16.640: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-t2p68 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.640: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-md99c started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.640: INFO: ebs-csi-node-5sskd started at 2022-12-31 06:25:54 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:16.640: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:16.640: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:16.640: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:45:39 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:50:16.640: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:16.640: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:16.640: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:50:16.640: INFO: Container csi-snapshotter ready: true, restart count 0
Dec 31 06:50:16.640: INFO: Container hostpath ready: true, restart count 0
Dec 31 06:50:16.640: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:16.640: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:16.846: INFO:
Latency metrics for node i-01238e73720e34636
Dec 31 06:50:16.846: INFO:
Logging node info for node i-02803f86e9c119889
Dec 31 06:50:16.878: INFO: Node Info: &Node{ObjectMeta:{i-02803f86e9c119889 4f26fd9b-7bc7-4f71-8b66-a761d4c63f01 35144 0 2022-12-31 06:25:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02803f86e9c119889 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-02803f86e9c119889 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.83 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5953":"i-02803f86e9c119889","ebs.csi.aws.com":"i-02803f86e9c119889"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:49:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-02803f86e9c119889,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:49:36 +0000 UTC,LastTransitionTime:2022-12-31 06:25:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.83,},NodeAddress{Type:ExternalIP,Address:3.96.199.254,},NodeAddress{Type:InternalDNS,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-199-254.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23319fa293bc90a121ffa207804bf8,SystemUUID:ec23319f-a293-bc90-a121-ffa207804bf8,BootID:443b01ac-cd9d-4547-9748-ec9c7edbc67a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-5953^93ecf6eb-88d6-11ed-aa52-6a9e5ddd1dab],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:50:16.878: INFO:
Logging kubelet events for node i-02803f86e9c119889
Dec 31 06:50:16.912: INFO:
Logging pods the kubelet thinks is on node i-02803f86e9c119889
Dec 31 06:50:16.953: INFO: inline-volume-tester-2zpb4 started at 2022-12-31 06:44:56 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:50:16.953: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:55 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:50:16.953: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-vrzch started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.953: INFO: pod-subpath-test-preprovisionedpv-hzg4 started at 2022-12-31 06:49:30 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Init container init-volume-preprovisionedpv-hzg4 ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container test-container-subpath-preprovisionedpv-hzg4 ready: false, restart count 0
Dec 31 06:50:16.953: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:45:38 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:50:16.953: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:50:16.953: INFO: coredns-autoscaler-7cb5c5b969-pt9s2 started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container autoscaler ready: true, restart count 0
Dec 31 06:50:16.953: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-hthc5 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.953: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xjng7 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.953: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-bhwsk started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.953: INFO: coredns-559769c974-r8xfg started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container coredns ready: true, restart count 0
Dec 31 06:50:16.953: INFO: hostexec-i-02803f86e9c119889-7dr55 started at 2022-12-31 06:49:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:50:16.953: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-dc2f2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.953: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9564 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.953: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-sqdwl started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.953: INFO: pvc-volume-tester-m8r85 started at 2022-12-31 06:44:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:50:16.953: INFO: netserver-1 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container webserver ready: false, restart count 0
Dec 31 06:50:16.953: INFO: cilium-24dpj started at 2022-12-31 06:25:40 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:50:16.953: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:50:16.953: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wd9vv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.953: INFO: ebs-csi-node-8hn4r started at 2022-12-31 06:25:40 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:16.953: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:16.953: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:16.953: INFO: csi-mockplugin-0 started at 2022-12-31 06:38:47 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:16.953: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:50:16.953: INFO: Container mock ready: true, restart count 0
Dec 31 06:50:16.953: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-j64b2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:16.953: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-nv2qw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0
Dec 31 06:50:16.953: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:38:48 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:50:16.953: INFO: hostexec-i-02803f86e9c119889-8htdv started at 2022-12-31 06:50:12 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:16.953: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:50:17.196: INFO:
Latency metrics for node i-02803f86e9c119889
Dec 31 06:50:17.196: INFO:
Logging node info for node i-04ba2526d2f93fe75
Dec 31 06:50:17.228: INFO: Node Info: &Node{ObjectMeta:{i-04ba2526d2f93fe75 66716b11-28bf-41d8-82f8-881d9a36efb5 34799 0 2022-12-31 06:25:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04ba2526d2f93fe75 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04ba2526d2f93fe75 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.50.49 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-7116":"i-04ba2526d2f93fe75","ebs.csi.aws.com":"i-04ba2526d2f93fe75"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:45:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-31 06:49:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04ba2526d2f93fe75,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:26:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.50.49,},NodeAddress{Type:ExternalIP,Address:35.182.108.97,},NodeAddress{Type:InternalDNS,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-108-97.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bacfd4cdc1a7d3a3ee77d377f7e34,SystemUUID:ec2bacfd-4cdc-1a7d-3a3e-e77d377f7e34,BootID:c6b8143b-5a4c-4cc7-b066-49b954ceaace,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-005302b9e4e7ea2c5 kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2 kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-005302b9e4e7ea2c5,DevicePath:,},},Config:nil,},}
Dec 31 06:50:17.228: INFO:
Logging kubelet events for node i-04ba2526d2f93fe75
Dec 31 06:50:17.263: INFO:
Logging pods the kubelet thinks is on node i-04ba2526d2f93fe75
Dec 31 06:50:17.308: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kl6rx started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.308: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-24srg started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.308: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-nq9pj started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.308: INFO: ss2-0 started at 2022-12-31 06:49:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container webserver ready: false, restart count 0
Dec 31 06:50:17.308: INFO: pod-failure-ignore-zlrmr started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container c ready: false, restart count 0
Dec 31 06:50:17.308: INFO: external-injector started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container external-injector ready: false, restart count 0
Dec 31 06:50:17.308: INFO: pod-projected-configmaps-b8587cbb-8506-4722-8faf-8fb0ae032c44 started at 2022-12-31 06:49:29 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container projected-configmap-volume-test ready: false, restart count 0
Dec 31 06:50:17.308: INFO: ebs-csi-node-rq4r2 started at 2022-12-31 06:25:53 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:17.308: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:17.308: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:17.308: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wgmwt started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.308: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-rz4lh started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.308: INFO: inline-volume-tester-rg5s8 started at 2022-12-31 06:44:26 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:50:17.308: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9xgv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.308: INFO: pod-failure-ignore-jxmrf started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container c ready: false, restart count 0
Dec 31 06:50:17.308: INFO: dns-test-bc7f6354-b3b1-49ed-a319-b3b8a3eb57f3 started at 2022-12-31 06:49:24 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container jessie-querier ready: false, restart count 0
Dec 31 06:50:17.308: INFO: Container querier ready: false, restart count 0
Dec 31 06:50:17.308: INFO: Container webserver ready: false, restart count 0
Dec 31 06:50:17.308: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-tr8ff started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.308: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-swkmw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.308: INFO: inline-volume-tester-6zlk7 started at 2022-12-31 06:39:27 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:50:17.308: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-j5hrc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.308: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kxjl4 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.308: INFO: csi-mockplugin-0 started at 2022-12-31 06:46:38 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:17.308: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:50:17.308: INFO: Container mock ready: true, restart count 0
Dec 31 06:50:17.308: INFO: netserver-2 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container webserver ready: false, restart count 0
Dec 31 06:50:17.308: INFO: pod-projected-secrets-5f396008-04ce-487d-9532-13fce0c1a47c started at 2022-12-31 06:49:58 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container projected-secret-volume-test ready: false, restart count 0
Dec 31 06:50:17.308: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:46:38 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:50:17.308: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:46:38 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:50:17.308: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:49:23 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:50:17.308: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:50:17.308: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:50:17.308: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:50:17.308: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:50:17.308: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:50:17.308: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:50:17.308: INFO: nodeport-test-kd22w started at 2022-12-31 06:45:24 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Container nodeport-test ready: true, restart count 0
Dec 31 06:50:17.308: INFO: cilium-jswjf started at 2022-12-31 06:25:53 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:17.308: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:50:17.308: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:50:17.550: INFO:
Latency metrics for node i-04ba2526d2f93fe75
Dec 31 06:50:17.550: INFO:
Logging node info for node i-0623d19705b93fa12
Dec 31 06:50:17.582: INFO: Node Info: &Node{ObjectMeta:{i-0623d19705b93fa12 42adab5d-2a9f-490b-8d96-b2134aee6d35 34236 0 2022-12-31 06:23:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0623d19705b93fa12 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.244 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0623d19705b93fa12"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-31 06:23:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-31 06:24:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:24:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-31 06:46:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0623d19705b93fa12,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:24:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.244,},NodeAddress{Type:ExternalIP,Address:3.96.201.212,},NodeAddress{Type:InternalDNS,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-201-212.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27d827c769aef19bbb1df3025ce86a,SystemUUID:ec27d827-c769-aef1-9bbb-1df3025ce86a,BootID:e238e24c-8167-4573-a762-5c346ea34877,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451628,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805582,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967330,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:50:17.583: INFO:
Logging kubelet events for node i-0623d19705b93fa12
Dec 31 06:50:17.616: INFO:
Logging pods the kubelet thinks is on node i-0623d19705b93fa12
Dec 31 06:50:17.653: INFO: kube-controller-manager-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.653: INFO: Container kube-controller-manager ready: true, restart count 2
Dec 31 06:50:17.653: INFO: kube-scheduler-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.653: INFO: Container kube-scheduler ready: true, restart count 0
Dec 31 06:50:17.653: INFO: cilium-5qps9 started at 2022-12-31 06:24:30 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:17.653: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:50:17.653: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:50:17.653: INFO: kops-controller-5j56z started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.653: INFO: Container kops-controller ready: true, restart count 0
Dec 31 06:50:17.653: INFO: ebs-csi-controller-89b649c94-wxqzv started at 2022-12-31 06:24:30 +0000 UTC (0+5 container statuses recorded)
Dec 31 06:50:17.653: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:50:17.653: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:17.653: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:50:17.653: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:17.653: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:17.653: INFO: dns-controller-69987775c6-989tg started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.653: INFO: Container dns-controller ready: true, restart count 0
Dec 31 06:50:17.653: INFO: etcd-manager-events-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.653: INFO: Container etcd-manager ready: true, restart count 0
Dec 31 06:50:17.653: INFO: etcd-manager-main-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.653: INFO: Container etcd-manager ready: true, restart count 0
Dec 31 06:50:17.653: INFO: kube-apiserver-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+2 container statuses recorded)
Dec 31 06:50:17.653: INFO: Container healthcheck ready: true, restart count 0
Dec 31 06:50:17.653: INFO: Container kube-apiserver ready: true, restart count 1
Dec 31 06:50:17.653: INFO: ebs-csi-node-pnmdn started at 2022-12-31 06:24:30 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:17.653: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:17.653: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:17.653: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:17.653: INFO: aws-cloud-controller-manager-68vsl started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.653: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Dec 31 06:50:17.653: INFO: cilium-operator-5dd44dc49f-gwnh5 started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.653: INFO: Container cilium-operator ready: true, restart count 0
Dec 31 06:50:17.851: INFO:
Latency metrics for node i-0623d19705b93fa12
Dec 31 06:50:17.851: INFO:
Logging node info for node i-07e0b1652877916dd
Dec 31 06:50:17.883: INFO: Node Info: &Node{ObjectMeta:{i-07e0b1652877916dd 503d2e8d-789d-4154-983b-d84a9e1f26d3 33533 0 2022-12-31 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07e0b1652877916dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-07e0b1652877916dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.32 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2668":"i-07e0b1652877916dd","csi-mock-csi-mock-volumes-3959":"i-07e0b1652877916dd","ebs.csi.aws.com":"i-07e0b1652877916dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:45:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-07e0b1652877916dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:26:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.32,},NodeAddress{Type:ExternalIP,Address:3.96.208.158,},NodeAddress{Type:InternalDNS,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-208-158.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23f46c8ef59d08a0747ddba3b48b3e,SystemUUID:ec23f46c-8ef5-9d08-a074-7ddba3b48b3e,BootID:7f531ed6-40f4-44aa-95ac-677cf2d148cb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2668^b7704c85-88d6-11ed-bda0-764bfc430f4f kubernetes.io/csi/csi-mock-csi-mock-volumes-3959^a09d1446-88d6-11ed-9ca5-ce024c9251f3],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:50:17.883: INFO:
Logging kubelet events for node i-07e0b1652877916dd
Dec 31 06:50:17.917: INFO:
Logging pods the kubelet thinks is on node i-07e0b1652877916dd
Dec 31 06:50:17.957: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-lcw6r started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.957: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wnd2m started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.957: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:44:25 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:50:17.957: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-pswrk started at 2022-12-31 06:38:47 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.957: INFO: cilium-4xz2s started at 2022-12-31 06:25:52 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:50:17.957: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:50:17.957: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-zltlv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.957: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:45:37 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:50:17.957: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xxrt2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.957: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-s49xp started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.957: INFO: pvc-volume-tester-9hhmr started at 2022-12-31 06:44:51 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:50:17.957: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-5d4zx started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0
Dec 31 06:50:17.957: INFO: ebs-csi-node-sgtqp started at 2022-12-31 06:25:52 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:50:17.957: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:50:17.957: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:50:17.957: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-6plfw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.957: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-bzltr started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.957: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:50:17.957: INFO: pvc-volume-tester-cn5lf started at 2022-12-31 06:45:32 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:50:17.957: INFO: netserver-3 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container webserver ready: false, restart count 0
Dec 31 06:50:17.957: INFO: csi-mockplugin-0 started at 2022-12-31 06:45:37 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:50:17.957: INFO: Container driver-registrar ready: false, restart count 0
Dec 31 06:50:17.957: INFO: Container mock ready: false, restart count 0
Dec 31 06:50:17.957: INFO: csi-mockplugin-0 started at 2022-12-31 06:39:09 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:17.957: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:50:17.957: INFO: Container mock ready: true, restart count 0
Dec 31 06:50:17.957: INFO: csi-mockplugin-0 started at 2022-12-31 06:44:25 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:50:17.957: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:50:17.957: INFO: Container mock ready: true, restart count 0
Dec 31 06:50:17.957: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-7tbwm started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:50:17.957: INFO: coredns-559769c974-tz7zd started at 2022-12-31 06:26:19 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container coredns ready: true, restart count 0
Dec 31 06:50:17.957: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:50:17.957: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:50:18.206: INFO:
Latency metrics for node i-07e0b1652877916dd
[DeferCleanup (Each)] [sig-api-machinery] Aggregator
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "aggregator-9598" for this suite. �[38;5;243m12/31/22 06:50:18.206�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sStatefulSet\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\shave\sa\sworking\sscale\ssubresource\s\[Conformance\]$'
test/e2e/framework/statefulset/wait.go:58
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunning({0x801e128?, 0xc001d5e9c0}, 0x1, 0x1, 0xc004630500)
test/e2e/framework/statefulset/wait.go:58 +0xf9
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunningAndReady(...)
test/e2e/framework/statefulset/wait.go:80
k8s.io/kubernetes/test/e2e/apps.glob..func10.2.13()
test/e2e/apps/statefulset.go:854 +0x210
[BeforeEach] [sig-apps] StatefulSet
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/31/22 06:39:14.361�[0m
Dec 31 06:39:14.362: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename statefulset �[38;5;243m12/31/22 06:39:14.362�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/31/22 06:39:14.457�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/31/22 06:39:14.519�[0m
[BeforeEach] [sig-apps] StatefulSet
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] StatefulSet
test/e2e/apps/statefulset.go:98
[BeforeEach] Basic StatefulSet functionality [StatefulSetBasic]
test/e2e/apps/statefulset.go:113
�[1mSTEP:�[0m Creating service test in namespace statefulset-3748 �[38;5;243m12/31/22 06:39:14.58�[0m
[It] should have a working scale subresource [Conformance]
test/e2e/apps/statefulset.go:848
�[1mSTEP:�[0m Creating statefulset ss in namespace statefulset-3748 �[38;5;243m12/31/22 06:39:14.613�[0m
Dec 31 06:39:14.678: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:39:24.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:39:34.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:39:44.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:39:54.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:40:04.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:40:14.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:40:24.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:40:34.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:40:44.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:40:54.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:41:04.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:41:14.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:41:24.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:41:34.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:41:44.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:41:54.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:42:04.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:42:14.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:42:24.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:42:34.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:42:44.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:42:54.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:43:04.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:43:14.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:43:24.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:43:34.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:43:44.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:43:54.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:44:04.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:44:14.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:44:24.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:44:34.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:44:44.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:44:54.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:45:04.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:45:14.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:45:24.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:45:34.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:45:44.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:45:54.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:46:04.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:46:14.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:46:24.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:46:34.712: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:46:44.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:46:54.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:47:04.712: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:47:14.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:47:24.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:47:34.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:47:44.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:47:54.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:48:04.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:48:14.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:48:24.711: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:48:34.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:48:44.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:48:54.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:49:04.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:49:14.710: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:49:14.741: INFO: Waiting for pod ss-0 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:49:14.741: FAIL: Failed waiting for pods to enter running: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunning({0x801e128?, 0xc001d5e9c0}, 0x1, 0x1, 0xc004630500)
test/e2e/framework/statefulset/wait.go:58 +0xf9
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunningAndReady(...)
test/e2e/framework/statefulset/wait.go:80
k8s.io/kubernetes/test/e2e/apps.glob..func10.2.13()
test/e2e/apps/statefulset.go:854 +0x210
[AfterEach] Basic StatefulSet functionality [StatefulSetBasic]
test/e2e/apps/statefulset.go:124
Dec 31 06:49:14.772: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-3748 describe po ss-0'
Dec 31 06:49:15.179: INFO: stderr: ""
Dec 31 06:49:15.179: INFO: stdout: "Name: ss-0\nNamespace: statefulset-3748\nPriority: 0\nService Account: default\nNode: i-01238e73720e34636/172.20.60.17\nStart Time: Sat, 31 Dec 2022 06:39:14 +0000\nLabels: baz=blah\n controller-revision-hash=ss-7b6c9599d5\n foo=bar\n statefulset.kubernetes.io/pod-name=ss-0\nAnnotations: <none>\nStatus: Pending\nIP: \nIPs: <none>\nControlled By: StatefulSet/ss\nContainers:\n webserver:\n Container ID: \n Image: registry.k8s.io/e2e-test-images/httpd:2.4.38-4\n Image ID: \n Port: <none>\n Host Port: <none>\n State: Waiting\n Reason: ContainerCreating\n Ready: False\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-q8pw6 (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n kube-api-access-q8pw6:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3748/ss-0 to i-01238e73720e34636\n Warning FailedCreatePodSandBox 9m59s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"5c27fa93f096198cc1bc38a581482bc4af3c51f9bff3c6bea9f390849fc9dd8d\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 9m48s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"5fda44d28d5eaced89de86349706dd71d3ccef10d4ed5035cb9c3306e0d0cb21\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 9m34s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"1b2098b06645e6eaec4cb1b2da18a7ef71822ff5ab2bb18a4e08045f290aae25\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 9m20s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"34c75a26552a2a476f68b6955b15c9a3786bed6d51bc47cf8e1231d075971213\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 9m7s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"46d283f0dc4d46b0ee2d14e6c35318f429a217c201777b77d4ab52786e7c1073\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m55s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"a0f372e5329513779732442ae75ccdaf689253a7a6abe0dcdc7a46a713a78cc7\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m41s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"c7a3baf4b8c103114d51d158be4fae8271dec814f7c013be3edd180c515f85d5\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m30s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"53170ea6144f59928bbb483731f78220cc8711c533a88c9678e2370bde75a409\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m15s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"2904650c1c0281715536bdc70eab661bd72a005270d38193e20cc4b852027024\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 4m39s (x17 over 8m4s) kubelet (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"e4efb36dd0ce7a4edee3746566a050a9ed9af89982c2dac5e0aba640c8042b7b\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n"
Dec 31 06:49:15.179: INFO:
Output of kubectl describe ss-0:
Name: ss-0
Namespace: statefulset-3748
Priority: 0
Service Account: default
Node: i-01238e73720e34636/172.20.60.17
Start Time: Sat, 31 Dec 2022 06:39:14 +0000
Labels: baz=blah
controller-revision-hash=ss-7b6c9599d5
foo=bar
statefulset.kubernetes.io/pod-name=ss-0
Annotations: <none>
Status: Pending
IP:
IPs: <none>
Controlled By: StatefulSet/ss
Containers:
webserver:
Container ID:
Image: registry.k8s.io/e2e-test-images/httpd:2.4.38-4
Image ID:
Port: <none>
Host Port: <none>
State: Waiting
Reason: ContainerCreating
Ready: False
Restart Count: 0
Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-q8pw6 (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-q8pw6:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 10m default-scheduler Successfully assigned statefulset-3748/ss-0 to i-01238e73720e34636
Warning FailedCreatePodSandBox 9m59s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5c27fa93f096198cc1bc38a581482bc4af3c51f9bff3c6bea9f390849fc9dd8d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 9m48s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5fda44d28d5eaced89de86349706dd71d3ccef10d4ed5035cb9c3306e0d0cb21": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 9m34s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1b2098b06645e6eaec4cb1b2da18a7ef71822ff5ab2bb18a4e08045f290aae25": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 9m20s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "34c75a26552a2a476f68b6955b15c9a3786bed6d51bc47cf8e1231d075971213": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 9m7s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "46d283f0dc4d46b0ee2d14e6c35318f429a217c201777b77d4ab52786e7c1073": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 8m55s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a0f372e5329513779732442ae75ccdaf689253a7a6abe0dcdc7a46a713a78cc7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 8m41s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c7a3baf4b8c103114d51d158be4fae8271dec814f7c013be3edd180c515f85d5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 8m30s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "53170ea6144f59928bbb483731f78220cc8711c533a88c9678e2370bde75a409": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 8m15s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2904650c1c0281715536bdc70eab661bd72a005270d38193e20cc4b852027024": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 4m39s (x17 over 8m4s) kubelet (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e4efb36dd0ce7a4edee3746566a050a9ed9af89982c2dac5e0aba640c8042b7b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:15.179: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-3748 logs ss-0 --tail=100'
Dec 31 06:49:15.574: INFO: rc: 1
Dec 31 06:49:15.574: INFO:
Last 100 log lines of ss-0:
Dec 31 06:49:15.574: INFO: Deleting all statefulset in ns statefulset-3748
Dec 31 06:49:15.606: INFO: Scaling statefulset ss to 0
Dec 31 06:49:25.735: INFO: Waiting for statefulset status.replicas updated to 0
Dec 31 06:49:25.766: INFO: Deleting statefulset ss
[AfterEach] [sig-apps] StatefulSet
test/e2e/framework/node/init/init.go:32
Dec 31 06:49:25.861: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] StatefulSet
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] StatefulSet
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m12/31/22 06:49:25.894�[0m
�[1mSTEP:�[0m Collecting events from namespace "statefulset-3748". �[38;5;243m12/31/22 06:49:25.894�[0m
�[1mSTEP:�[0m Found 13 events. �[38;5;243m12/31/22 06:49:25.925�[0m
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:39:14 +0000 UTC - event for ss: {statefulset-controller } SuccessfulCreate: create Pod ss-0 in StatefulSet ss successful
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:39:14 +0000 UTC - event for ss-0: {default-scheduler } Scheduled: Successfully assigned statefulset-3748/ss-0 to i-01238e73720e34636
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:39:16 +0000 UTC - event for ss-0: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5c27fa93f096198cc1bc38a581482bc4af3c51f9bff3c6bea9f390849fc9dd8d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:39:27 +0000 UTC - event for ss-0: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5fda44d28d5eaced89de86349706dd71d3ccef10d4ed5035cb9c3306e0d0cb21": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:39:41 +0000 UTC - event for ss-0: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1b2098b06645e6eaec4cb1b2da18a7ef71822ff5ab2bb18a4e08045f290aae25": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:39:55 +0000 UTC - event for ss-0: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "34c75a26552a2a476f68b6955b15c9a3786bed6d51bc47cf8e1231d075971213": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:40:08 +0000 UTC - event for ss-0: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "46d283f0dc4d46b0ee2d14e6c35318f429a217c201777b77d4ab52786e7c1073": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:40:20 +0000 UTC - event for ss-0: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a0f372e5329513779732442ae75ccdaf689253a7a6abe0dcdc7a46a713a78cc7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:40:34 +0000 UTC - event for ss-0: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c7a3baf4b8c103114d51d158be4fae8271dec814f7c013be3edd180c515f85d5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:40:45 +0000 UTC - event for ss-0: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "53170ea6144f59928bbb483731f78220cc8711c533a88c9678e2370bde75a409": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:41:00 +0000 UTC - event for ss-0: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2904650c1c0281715536bdc70eab661bd72a005270d38193e20cc4b852027024": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:41:11 +0000 UTC - event for ss-0: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e4efb36dd0ce7a4edee3746566a050a9ed9af89982c2dac5e0aba640c8042b7b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:25.925: INFO: At 2022-12-31 06:49:15 +0000 UTC - event for ss: {statefulset-controller } SuccessfulDelete: delete Pod ss-0 in StatefulSet ss successful
Dec 31 06:49:25.956: INFO: POD NODE PHASE GRACE CONDITIONS
Dec 31 06:49:25.956: INFO:
Dec 31 06:49:25.989: INFO:
Logging node info for node i-01238e73720e34636
Dec 31 06:49:26.020: INFO: Node Info: &Node{ObjectMeta:{i-01238e73720e34636 6336cf01-1d9c-435d-8598-300dc5c8cd47 33396 0 2022-12-31 06:25:53 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01238e73720e34636 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01238e73720e34636 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.17 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01238e73720e34636"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:45:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-31 06:45:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01238e73720e34636,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.17,},NodeAddress{Type:ExternalIP,Address:3.96.140.88,},NodeAddress{Type:InternalDNS,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-140-88.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b18c944e5e0e896bb3ef13f5e91a,SystemUUID:ec25b18c-944e-5e0e-896b-b3ef13f5e91a,BootID:429656db-871c-45f8-90c8-d6173d395019,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-017852f53c72a0ef1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-017852f53c72a0ef1,DevicePath:,},},Config:nil,},}
Dec 31 06:49:26.020: INFO:
Logging kubelet events for node i-01238e73720e34636
Dec 31 06:49:26.056: INFO:
Logging pods the kubelet thinks is on node i-01238e73720e34636
Dec 31 06:49:26.093: INFO: dns-test-5925a097-8949-4b9e-ae20-3cd9dafe31de started at 2022-12-31 06:46:00 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container jessie-querier ready: true, restart count 0
Dec 31 06:49:26.093: INFO: Container querier ready: true, restart count 0
Dec 31 06:49:26.093: INFO: Container webserver ready: true, restart count 0
Dec 31 06:49:26.093: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-dbm42 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.093: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-t9sfw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.093: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xpfkc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.093: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-t2p68 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.093: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-md99c started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.093: INFO: ebs-csi-node-5sskd started at 2022-12-31 06:25:54 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:26.093: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:26.093: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:49:26.093: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:45:39 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:26.093: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:49:26.093: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:26.093: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:49:26.093: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:49:26.093: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:49:26.093: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:49:26.093: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-fppmn started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.093: INFO: cilium-jtczt started at 2022-12-31 06:25:54 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:49:26.093: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:49:26.093: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-57rjk started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.093: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-tkxdw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.093: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-mb5bq started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.093: INFO: pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1 started at 2022-12-31 06:45:18 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container write-pod ready: false, restart count 0
Dec 31 06:49:26.093: INFO: sample-apiserver-deployment-55bd96fd47-b49pn started at 2022-12-31 06:45:15 +0000 UTC (0+2 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container etcd ready: false, restart count 0
Dec 31 06:49:26.093: INFO: Container sample-apiserver ready: false, restart count 0
Dec 31 06:49:26.093: INFO: nodeport-test-zdf2l started at 2022-12-31 06:45:24 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container nodeport-test ready: false, restart count 0
Dec 31 06:49:26.093: INFO: netserver-0 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container webserver ready: true, restart count 0
Dec 31 06:49:26.093: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-jp975 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.093: INFO: liveness-76925a35-eff7-4a2b-b7b3-43a02cc3460a started at 2022-12-31 06:45:10 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.093: INFO: Container agnhost-container ready: false, restart count 0
Dec 31 06:49:26.286: INFO:
Latency metrics for node i-01238e73720e34636
Dec 31 06:49:26.286: INFO:
Logging node info for node i-02803f86e9c119889
Dec 31 06:49:26.317: INFO: Node Info: &Node{ObjectMeta:{i-02803f86e9c119889 4f26fd9b-7bc7-4f71-8b66-a761d4c63f01 32793 0 2022-12-31 06:25:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02803f86e9c119889 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-02803f86e9c119889 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.83 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5953":"i-02803f86e9c119889","ebs.csi.aws.com":"i-02803f86e9c119889"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:44:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-02803f86e9c119889,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.83,},NodeAddress{Type:ExternalIP,Address:3.96.199.254,},NodeAddress{Type:InternalDNS,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-199-254.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23319fa293bc90a121ffa207804bf8,SystemUUID:ec23319f-a293-bc90-a121-ffa207804bf8,BootID:443b01ac-cd9d-4547-9748-ec9c7edbc67a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-5953^93ecf6eb-88d6-11ed-aa52-6a9e5ddd1dab],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:49:26.318: INFO:
Logging kubelet events for node i-02803f86e9c119889
Dec 31 06:49:26.354: INFO:
Logging pods the kubelet thinks is on node i-02803f86e9c119889
Dec 31 06:49:26.394: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:38:48 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:26.394: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-vrzch started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.394: INFO: inline-volume-tester-2zpb4 started at 2022-12-31 06:44:56 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:49:26.394: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:55 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:49:26.394: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-hthc5 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.394: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:45:38 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:49:26.394: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:49:26.394: INFO: coredns-autoscaler-7cb5c5b969-pt9s2 started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container autoscaler ready: true, restart count 0
Dec 31 06:49:26.394: INFO: hostexec-i-02803f86e9c119889-7dr55 started at 2022-12-31 06:49:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:49:26.394: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xjng7 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.394: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-bhwsk started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.394: INFO: coredns-559769c974-r8xfg started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container coredns ready: true, restart count 0
Dec 31 06:49:26.394: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9564 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.394: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-dc2f2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.394: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wd9vv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.394: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-sqdwl started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.394: INFO: pvc-volume-tester-m8r85 started at 2022-12-31 06:44:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:49:26.394: INFO: netserver-1 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container webserver ready: false, restart count 0
Dec 31 06:49:26.394: INFO: cilium-24dpj started at 2022-12-31 06:25:40 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:49:26.394: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:49:26.394: INFO: csi-mockplugin-0 started at 2022-12-31 06:38:47 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:49:26.394: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:49:26.394: INFO: Container mock ready: true, restart count 0
Dec 31 06:49:26.394: INFO: ebs-csi-node-8hn4r started at 2022-12-31 06:25:40 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:26.394: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:26.394: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:49:26.394: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-nv2qw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0
Dec 31 06:49:26.394: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-j64b2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.394: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.613: INFO:
Latency metrics for node i-02803f86e9c119889
Dec 31 06:49:26.613: INFO:
Logging node info for node i-04ba2526d2f93fe75
Dec 31 06:49:26.644: INFO: Node Info: &Node{ObjectMeta:{i-04ba2526d2f93fe75 66716b11-28bf-41d8-82f8-881d9a36efb5 34799 0 2022-12-31 06:25:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04ba2526d2f93fe75 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04ba2526d2f93fe75 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.50.49 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-7116":"i-04ba2526d2f93fe75","ebs.csi.aws.com":"i-04ba2526d2f93fe75"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:45:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-31 06:49:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04ba2526d2f93fe75,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:26:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.50.49,},NodeAddress{Type:ExternalIP,Address:35.182.108.97,},NodeAddress{Type:InternalDNS,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-108-97.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bacfd4cdc1a7d3a3ee77d377f7e34,SystemUUID:ec2bacfd-4cdc-1a7d-3a3e-e77d377f7e34,BootID:c6b8143b-5a4c-4cc7-b066-49b954ceaace,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-005302b9e4e7ea2c5 kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2 kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-005302b9e4e7ea2c5,DevicePath:,},},Config:nil,},}
Dec 31 06:49:26.645: INFO:
Logging kubelet events for node i-04ba2526d2f93fe75
Dec 31 06:49:26.679: INFO:
Logging pods the kubelet thinks is on node i-04ba2526d2f93fe75
Dec 31 06:49:26.719: INFO: cilium-jswjf started at 2022-12-31 06:25:53 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:49:26.719: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:49:26.719: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kl6rx started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.719: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-24srg started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.719: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-nq9pj started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.719: INFO: ebs-csi-node-rq4r2 started at 2022-12-31 06:25:53 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:26.719: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:26.719: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:49:26.719: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wgmwt started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.719: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-rz4lh started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.719: INFO: inline-volume-tester-rg5s8 started at 2022-12-31 06:44:26 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:49:26.719: INFO: ss2-0 started at 2022-12-31 06:49:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container webserver ready: false, restart count 0
Dec 31 06:49:26.719: INFO: pod-failure-ignore-zlrmr started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container c ready: false, restart count 0
Dec 31 06:49:26.719: INFO: external-injector started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container external-injector ready: false, restart count 0
Dec 31 06:49:26.719: INFO: pod-failure-ignore-jxmrf started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container c ready: false, restart count 0
Dec 31 06:49:26.719: INFO: dns-test-bc7f6354-b3b1-49ed-a319-b3b8a3eb57f3 started at 2022-12-31 06:49:24 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container jessie-querier ready: false, restart count 0
Dec 31 06:49:26.719: INFO: Container querier ready: false, restart count 0
Dec 31 06:49:26.719: INFO: Container webserver ready: false, restart count 0
Dec 31 06:49:26.719: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-tr8ff started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.719: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9xgv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.719: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-swkmw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.719: INFO: inline-volume-tester-6zlk7 started at 2022-12-31 06:39:27 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:49:26.719: INFO: csi-mockplugin-0 started at 2022-12-31 06:46:38 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:49:26.719: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:49:26.719: INFO: Container mock ready: true, restart count 0
Dec 31 06:49:26.719: INFO: netserver-2 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container webserver ready: false, restart count 0
Dec 31 06:49:26.719: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:46:38 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:26.719: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-j5hrc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.719: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kxjl4 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:26.719: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:46:38 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:26.719: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:49:23 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:26.719: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:49:26.719: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:26.719: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:49:26.719: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:49:26.719: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:49:26.719: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:49:26.719: INFO: nodeport-test-kd22w started at 2022-12-31 06:45:24 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:26.719: INFO: Container nodeport-test ready: true, restart count 0
Dec 31 06:49:26.921: INFO:
Latency metrics for node i-04ba2526d2f93fe75
Dec 31 06:49:26.921: INFO:
Logging node info for node i-0623d19705b93fa12
Dec 31 06:49:26.953: INFO: Node Info: &Node{ObjectMeta:{i-0623d19705b93fa12 42adab5d-2a9f-490b-8d96-b2134aee6d35 34236 0 2022-12-31 06:23:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0623d19705b93fa12 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.244 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0623d19705b93fa12"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-31 06:23:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-31 06:24:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:24:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-31 06:46:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0623d19705b93fa12,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:24:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.244,},NodeAddress{Type:ExternalIP,Address:3.96.201.212,},NodeAddress{Type:InternalDNS,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-201-212.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27d827c769aef19bbb1df3025ce86a,SystemUUID:ec27d827-c769-aef1-9bbb-1df3025ce86a,BootID:e238e24c-8167-4573-a762-5c346ea34877,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451628,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805582,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967330,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:49:26.953: INFO:
Logging kubelet events for node i-0623d19705b93fa12
Dec 31 06:49:26.987: INFO:
Logging pods the kubelet thinks is on node i-0623d19705b93fa12
Dec 31 06:49:27.025: INFO: etcd-manager-events-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.025: INFO: Container etcd-manager ready: true, restart count 0
Dec 31 06:49:27.025: INFO: etcd-manager-main-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.025: INFO: Container etcd-manager ready: true, restart count 0
Dec 31 06:49:27.025: INFO: kube-apiserver-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+2 container statuses recorded)
Dec 31 06:49:27.025: INFO: Container healthcheck ready: true, restart count 0
Dec 31 06:49:27.025: INFO: Container kube-apiserver ready: true, restart count 1
Dec 31 06:49:27.025: INFO: ebs-csi-node-pnmdn started at 2022-12-31 06:24:30 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:27.025: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:27.025: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:27.025: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:49:27.025: INFO: aws-cloud-controller-manager-68vsl started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.025: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Dec 31 06:49:27.025: INFO: cilium-operator-5dd44dc49f-gwnh5 started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.025: INFO: Container cilium-operator ready: true, restart count 0
Dec 31 06:49:27.025: INFO: dns-controller-69987775c6-989tg started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.025: INFO: Container dns-controller ready: true, restart count 0
Dec 31 06:49:27.025: INFO: kube-controller-manager-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.025: INFO: Container kube-controller-manager ready: true, restart count 2
Dec 31 06:49:27.025: INFO: kube-scheduler-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.025: INFO: Container kube-scheduler ready: true, restart count 0
Dec 31 06:49:27.025: INFO: cilium-5qps9 started at 2022-12-31 06:24:30 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:49:27.025: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:49:27.025: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:49:27.025: INFO: kops-controller-5j56z started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.025: INFO: Container kops-controller ready: true, restart count 0
Dec 31 06:49:27.025: INFO: ebs-csi-controller-89b649c94-wxqzv started at 2022-12-31 06:24:30 +0000 UTC (0+5 container statuses recorded)
Dec 31 06:49:27.025: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:49:27.025: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:49:27.025: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:49:27.025: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:27.025: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:27.179: INFO:
Latency metrics for node i-0623d19705b93fa12
Dec 31 06:49:27.179: INFO:
Logging node info for node i-07e0b1652877916dd
Dec 31 06:49:27.210: INFO: Node Info: &Node{ObjectMeta:{i-07e0b1652877916dd 503d2e8d-789d-4154-983b-d84a9e1f26d3 33533 0 2022-12-31 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07e0b1652877916dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-07e0b1652877916dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.32 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2668":"i-07e0b1652877916dd","csi-mock-csi-mock-volumes-3959":"i-07e0b1652877916dd","ebs.csi.aws.com":"i-07e0b1652877916dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:45:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-07e0b1652877916dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:26:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.32,},NodeAddress{Type:ExternalIP,Address:3.96.208.158,},NodeAddress{Type:InternalDNS,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-208-158.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23f46c8ef59d08a0747ddba3b48b3e,SystemUUID:ec23f46c-8ef5-9d08-a074-7ddba3b48b3e,BootID:7f531ed6-40f4-44aa-95ac-677cf2d148cb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2668^b7704c85-88d6-11ed-bda0-764bfc430f4f kubernetes.io/csi/csi-mock-csi-mock-volumes-3959^a09d1446-88d6-11ed-9ca5-ce024c9251f3],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:49:27.211: INFO:
Logging kubelet events for node i-07e0b1652877916dd
Dec 31 06:49:27.244: INFO:
Logging pods the kubelet thinks is on node i-07e0b1652877916dd
Dec 31 06:49:27.283: INFO: coredns-559769c974-tz7zd started at 2022-12-31 06:26:19 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container coredns ready: true, restart count 0
Dec 31 06:49:27.283: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:27.283: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-7tbwm started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:27.283: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-lcw6r started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:27.283: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wnd2m started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:27.283: INFO: cilium-4xz2s started at 2022-12-31 06:25:52 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:49:27.283: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:49:27.283: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-zltlv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:27.283: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:45:37 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:27.283: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:44:25 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:27.283: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-pswrk started at 2022-12-31 06:38:47 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:27.283: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xxrt2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:27.283: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-s49xp started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:27.283: INFO: ebs-csi-node-sgtqp started at 2022-12-31 06:25:52 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:27.283: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:27.283: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:49:27.283: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-6plfw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:27.283: INFO: pvc-volume-tester-9hhmr started at 2022-12-31 06:44:51 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:49:27.283: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-5d4zx started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0
Dec 31 06:49:27.283: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:27.283: INFO: pvc-volume-tester-cn5lf started at 2022-12-31 06:45:32 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:49:27.283: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-bzltr started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:27.283: INFO: netserver-3 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container webserver ready: false, restart count 0
Dec 31 06:49:27.283: INFO: csi-mockplugin-0 started at 2022-12-31 06:45:37 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:49:27.283: INFO: Container driver-registrar ready: false, restart count 0
Dec 31 06:49:27.283: INFO: Container mock ready: false, restart count 0
Dec 31 06:49:27.283: INFO: csi-mockplugin-0 started at 2022-12-31 06:39:09 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:49:27.283: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:49:27.283: INFO: Container mock ready: true, restart count 0
Dec 31 06:49:27.283: INFO: csi-mockplugin-0 started at 2022-12-31 06:44:25 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:27.283: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:49:27.283: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:49:27.283: INFO: Container mock ready: true, restart count 0
Dec 31 06:49:27.479: INFO:
Latency metrics for node i-07e0b1652877916dd
[DeferCleanup (Each)] [sig-apps] StatefulSet
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "statefulset-3748" for this suite. �[38;5;243m12/31/22 06:49:27.479�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sStatefulSet\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\sperform\srolling\supdates\sand\sroll\sbacks\sof\stemplate\smodifications\s\[Conformance\]$'
test/e2e/framework/statefulset/wait.go:74
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForState({0x801e128?, 0xc002f66b60}, 0xc002b02000, 0xc00160c540)
test/e2e/framework/statefulset/wait.go:74 +0xfe
k8s.io/kubernetes/test/e2e/apps.waitForRollingUpdate({0x801e128, 0xc002f66b60}, 0xc002b02000)
test/e2e/apps/wait.go:124 +0x1cc
k8s.io/kubernetes/test/e2e/apps.rollbackTest({0x801e128, 0xc002f66b60}, {0xc004bbf8f0, 0x10}, 0xc000c45900)
test/e2e/apps/statefulset.go:1645 +0x15bd
k8s.io/kubernetes/test/e2e/apps.glob..func10.2.7()
test/e2e/apps/statefulset.go:309 +0xe6
[BeforeEach] [sig-apps] StatefulSet
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/31/22 06:37:14.592�[0m
Dec 31 06:37:14.592: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename statefulset �[38;5;243m12/31/22 06:37:14.593�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/31/22 06:37:14.688�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/31/22 06:37:14.749�[0m
[BeforeEach] [sig-apps] StatefulSet
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] StatefulSet
test/e2e/apps/statefulset.go:98
[BeforeEach] Basic StatefulSet functionality [StatefulSetBasic]
test/e2e/apps/statefulset.go:113
�[1mSTEP:�[0m Creating service test in namespace statefulset-9565 �[38;5;243m12/31/22 06:37:14.809�[0m
[It] should perform rolling updates and roll backs of template modifications [Conformance]
test/e2e/apps/statefulset.go:306
�[1mSTEP:�[0m Creating a new StatefulSet �[38;5;243m12/31/22 06:37:14.848�[0m
Dec 31 06:37:14.916: INFO: Found 1 stateful pods, waiting for 3
Dec 31 06:37:24.948: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Dec 31 06:37:24.948: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Dec 31 06:37:24.948: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Dec 31 06:37:34.949: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Dec 31 06:37:34.949: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Dec 31 06:37:34.949: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Running - Ready=true
Dec 31 06:37:35.044: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-9565 exec ss2-1 -- /bin/sh -x -c mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true'
Dec 31 06:37:35.546: INFO: stderr: "+ mv -v /usr/local/apache2/htdocs/index.html /tmp/\n"
Dec 31 06:37:35.546: INFO: stdout: "'/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html'\n"
Dec 31 06:37:35.546: INFO: stdout of mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true on ss2-1: '/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html'
�[1mSTEP:�[0m Updating StatefulSet template: update image from registry.k8s.io/e2e-test-images/httpd:2.4.38-4 to registry.k8s.io/e2e-test-images/httpd:2.4.39-4 �[38;5;243m12/31/22 06:37:45.678�[0m
Dec 31 06:37:45.753: INFO: Updating stateful set ss2
�[1mSTEP:�[0m Creating a new revision �[38;5;243m12/31/22 06:37:45.753�[0m
�[1mSTEP:�[0m Updating Pods in reverse ordinal order �[38;5;243m12/31/22 06:37:45.832�[0m
Dec 31 06:37:45.863: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-9565 exec ss2-1 -- /bin/sh -x -c mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true'
Dec 31 06:37:46.372: INFO: stderr: "+ mv -v /tmp/index.html /usr/local/apache2/htdocs/\n"
Dec 31 06:37:46.372: INFO: stdout: "'/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html'\n"
Dec 31 06:37:46.372: INFO: stdout of mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true on ss2-1: '/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html'
Dec 31 06:37:46.498: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:37:46.498: INFO: Waiting for Pod statefulset-9565/ss2-0 to have revision ss2-5459d8585b update revision ss2-7b6c9599d5
Dec 31 06:37:46.498: INFO: Waiting for Pod statefulset-9565/ss2-1 to have revision ss2-5459d8585b update revision ss2-7b6c9599d5
Dec 31 06:37:46.498: INFO: Waiting for Pod statefulset-9565/ss2-2 to have revision ss2-5459d8585b update revision ss2-7b6c9599d5
Dec 31 06:37:56.561: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:37:56.561: INFO: Waiting for Pod statefulset-9565/ss2-0 to have revision ss2-5459d8585b update revision ss2-7b6c9599d5
Dec 31 06:37:56.561: INFO: Waiting for Pod statefulset-9565/ss2-1 to have revision ss2-5459d8585b update revision ss2-7b6c9599d5
Dec 31 06:38:06.565: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:38:06.565: INFO: Waiting for Pod statefulset-9565/ss2-0 to have revision ss2-5459d8585b update revision ss2-7b6c9599d5
Dec 31 06:38:16.561: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
�[1mSTEP:�[0m Rolling back to a previous revision �[38;5;243m12/31/22 06:38:26.632�[0m
Dec 31 06:38:26.632: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-9565 exec ss2-1 -- /bin/sh -x -c mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true'
Dec 31 06:38:27.122: INFO: stderr: "+ mv -v /usr/local/apache2/htdocs/index.html /tmp/\n"
Dec 31 06:38:27.122: INFO: stdout: "'/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html'\n"
Dec 31 06:38:27.122: INFO: stdout of mv -v /usr/local/apache2/htdocs/index.html /tmp/ || true on ss2-1: '/usr/local/apache2/htdocs/index.html' -> '/tmp/index.html'
Dec 31 06:38:37.333: INFO: Updating stateful set ss2
�[1mSTEP:�[0m Rolling back update in reverse ordinal order �[38;5;243m12/31/22 06:38:37.398�[0m
Dec 31 06:38:37.430: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-9565 exec ss2-1 -- /bin/sh -x -c mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true'
Dec 31 06:38:38.126: INFO: stderr: "+ mv -v /tmp/index.html /usr/local/apache2/htdocs/\n"
Dec 31 06:38:38.126: INFO: stdout: "'/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html'\n"
Dec 31 06:38:38.126: INFO: stdout of mv -v /tmp/index.html /usr/local/apache2/htdocs/ || true on ss2-1: '/tmp/index.html' -> '/usr/local/apache2/htdocs/index.html'
Dec 31 06:39:08.313: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:39:08.313: INFO: Waiting for Pod statefulset-9565/ss2-0 to have revision ss2-7b6c9599d5 update revision ss2-5459d8585b
Dec 31 06:39:08.313: INFO: Waiting for Pod statefulset-9565/ss2-1 to have revision ss2-7b6c9599d5 update revision ss2-5459d8585b
Dec 31 06:39:08.313: INFO: Waiting for Pod statefulset-9565/ss2-2 to have revision ss2-7b6c9599d5 update revision ss2-5459d8585b
Dec 31 06:39:18.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:39:18.377: INFO: Waiting for Pod statefulset-9565/ss2-0 to have revision ss2-7b6c9599d5 update revision ss2-5459d8585b
Dec 31 06:39:28.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:39:38.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:39:48.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:39:58.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:40:08.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:40:18.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:40:28.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:40:38.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:40:48.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:40:58.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:41:08.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:41:18.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:41:28.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:41:38.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:41:48.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:41:58.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:42:08.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:42:18.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:42:28.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:42:38.379: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:42:48.376: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:42:58.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:43:08.376: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:43:18.383: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:43:28.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:43:38.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:43:48.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:43:58.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:44:08.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:44:18.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:44:28.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:44:38.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:44:48.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:44:58.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:45:08.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:45:18.379: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:45:28.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:45:38.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:45:48.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:45:58.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:46:08.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:46:18.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:46:28.379: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:46:38.382: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:46:48.376: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:46:58.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:47:08.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:47:18.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:47:28.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:47:38.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:47:48.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:47:58.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:48:08.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:48:18.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:48:28.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:48:38.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:48:48.378: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:48:58.382: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:49:08.377: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:49:08.440: INFO: Waiting for StatefulSet statefulset-9565/ss2 to complete update
Dec 31 06:49:08.440: FAIL: Failed waiting for state update: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForState({0x801e128?, 0xc002f66b60}, 0xc002b02000, 0xc00160c540)
test/e2e/framework/statefulset/wait.go:74 +0xfe
k8s.io/kubernetes/test/e2e/apps.waitForRollingUpdate({0x801e128, 0xc002f66b60}, 0xc002b02000)
test/e2e/apps/wait.go:124 +0x1cc
k8s.io/kubernetes/test/e2e/apps.rollbackTest({0x801e128, 0xc002f66b60}, {0xc004bbf8f0, 0x10}, 0xc000c45900)
test/e2e/apps/statefulset.go:1645 +0x15bd
k8s.io/kubernetes/test/e2e/apps.glob..func10.2.7()
test/e2e/apps/statefulset.go:309 +0xe6
[AfterEach] Basic StatefulSet functionality [StatefulSetBasic]
test/e2e/apps/statefulset.go:124
Dec 31 06:49:08.473: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-9565 describe po ss2-0'
Dec 31 06:49:08.903: INFO: stderr: ""
Dec 31 06:49:08.903: INFO: stdout: "Name: ss2-0\nNamespace: statefulset-9565\nPriority: 0\nService Account: default\nNode: i-02803f86e9c119889/172.20.43.83\nStart Time: Sat, 31 Dec 2022 06:39:28 +0000\nLabels: baz=blah\n controller-revision-hash=ss2-7b6c9599d5\n foo=bar\n statefulset.kubernetes.io/pod-name=ss2-0\nAnnotations: <none>\nStatus: Pending\nIP: \nIPs: <none>\nControlled By: StatefulSet/ss2\nContainers:\n webserver:\n Container ID: \n Image: registry.k8s.io/e2e-test-images/httpd:2.4.38-4\n Image ID: \n Port: <none>\n Host Port: <none>\n State: Waiting\n Reason: ContainerCreating\n Ready: False\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-dgwfh (ro)\nConditions:\n Type Status\n Initialized True \n Ready False \n ContainersReady False \n PodScheduled True \nVolumes:\n kube-api-access-dgwfh:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 9m40s default-scheduler Successfully assigned statefulset-9565/ss2-0 to i-02803f86e9c119889\n Warning FailedCreatePodSandBox 9m40s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"29cd63fa14161b64c58cb247da2ad147e97300bc5a340f2b24c41bc27e8e9ab8\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 9m26s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"cfa313c15de1e24927de51a42ba398836f40026ad7234e59cd2c33352b8e2bf1\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 9m14s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"127ea1916ddd457a1d1762a0351cefe43c59906eecacb35aa417dd3ddc96ae32\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m59s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"e8546e3e6a1c5b526f2f6a4cc0e915ba8264b89ac63780b4769ad6e9aebfb2e9\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m45s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"b6883523c817395bc21d8f48eee1c92c59350a1d7d0b991d87d7a56c6ac0fb1c\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m32s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"631bd1ff2cd262bde17540b67a1844f77cb6661a0b9199f47e7f49f6cf6c9e90\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m18s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"c9bed900020d42e6bc927975a76eb78d9fe1adf87852fc5aa4f8d44b1f1f53db\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 8m4s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"4036fa515dc2f75dbe6ce2916c8da5c810d294055bda9d2e1539e9c4b0851ba0\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 7m49s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"02616d9bd713bf9f866153ae47149d9f3c26ab4ceb882dd07984a503c945838d\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Warning FailedCreatePodSandBox 4m1s (x17 over 7m38s) kubelet (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"47113be9e0d05fa169c3538540942ba68fecdc2aa5bdeed9caf3a46848f5828b\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n"
Dec 31 06:49:08.904: INFO:
Output of kubectl describe ss2-0:
Name: ss2-0
Namespace: statefulset-9565
Priority: 0
Service Account: default
Node: i-02803f86e9c119889/172.20.43.83
Start Time: Sat, 31 Dec 2022 06:39:28 +0000
Labels: baz=blah
controller-revision-hash=ss2-7b6c9599d5
foo=bar
statefulset.kubernetes.io/pod-name=ss2-0
Annotations: <none>
Status: Pending
IP:
IPs: <none>
Controlled By: StatefulSet/ss2
Containers:
webserver:
Container ID:
Image: registry.k8s.io/e2e-test-images/httpd:2.4.38-4
Image ID:
Port: <none>
Host Port: <none>
State: Waiting
Reason: ContainerCreating
Ready: False
Restart Count: 0
Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-dgwfh (ro)
Conditions:
Type Status
Initialized True
Ready False
ContainersReady False
PodScheduled True
Volumes:
kube-api-access-dgwfh:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m40s default-scheduler Successfully assigned statefulset-9565/ss2-0 to i-02803f86e9c119889
Warning FailedCreatePodSandBox 9m40s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "29cd63fa14161b64c58cb247da2ad147e97300bc5a340f2b24c41bc27e8e9ab8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 9m26s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cfa313c15de1e24927de51a42ba398836f40026ad7234e59cd2c33352b8e2bf1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 9m14s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "127ea1916ddd457a1d1762a0351cefe43c59906eecacb35aa417dd3ddc96ae32": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 8m59s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e8546e3e6a1c5b526f2f6a4cc0e915ba8264b89ac63780b4769ad6e9aebfb2e9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 8m45s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b6883523c817395bc21d8f48eee1c92c59350a1d7d0b991d87d7a56c6ac0fb1c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 8m32s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "631bd1ff2cd262bde17540b67a1844f77cb6661a0b9199f47e7f49f6cf6c9e90": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 8m18s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c9bed900020d42e6bc927975a76eb78d9fe1adf87852fc5aa4f8d44b1f1f53db": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 8m4s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4036fa515dc2f75dbe6ce2916c8da5c810d294055bda9d2e1539e9c4b0851ba0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 7m49s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "02616d9bd713bf9f866153ae47149d9f3c26ab4ceb882dd07984a503c945838d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Warning FailedCreatePodSandBox 4m1s (x17 over 7m38s) kubelet (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "47113be9e0d05fa169c3538540942ba68fecdc2aa5bdeed9caf3a46848f5828b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:08.904: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-9565 logs ss2-0 --tail=100'
Dec 31 06:49:09.342: INFO: rc: 1
Dec 31 06:49:09.342: INFO:
Last 100 log lines of ss2-0:
Dec 31 06:49:09.342: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-9565 describe po ss2-1'
Dec 31 06:49:09.774: INFO: stderr: ""
Dec 31 06:49:09.774: INFO: stdout: "Name: ss2-1\nNamespace: statefulset-9565\nPriority: 0\nService Account: default\nNode: i-01238e73720e34636/172.20.60.17\nStart Time: Sat, 31 Dec 2022 06:39:14 +0000\nLabels: baz=blah\n controller-revision-hash=ss2-7b6c9599d5\n foo=bar\n statefulset.kubernetes.io/pod-name=ss2-1\nAnnotations: <none>\nStatus: Running\nIP: 172.20.33.194\nIPs:\n IP: 172.20.33.194\nControlled By: StatefulSet/ss2\nContainers:\n webserver:\n Container ID: containerd://40a63e9740a0618e5b39277eb8e07ebe32f12c53da461906e9cef5ccdc550efd\n Image: registry.k8s.io/e2e-test-images/httpd:2.4.38-4\n Image ID: registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22\n Port: <none>\n Host Port: <none>\n State: Running\n Started: Sat, 31 Dec 2022 06:39:27 +0000\n Ready: True\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-gkqxg (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n kube-api-access-gkqxg:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 9m55s default-scheduler Successfully assigned statefulset-9565/ss2-1 to i-01238e73720e34636\n Warning FailedCreatePodSandBox 9m53s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"96d20f4c29dec744d6cc0b5ee109d45ec5a045d2c85b0c133793be04c01c37c1\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available\n Normal Pulled 9m42s kubelet Container image \"registry.k8s.io/e2e-test-images/httpd:2.4.38-4\" already present on machine\n Normal Created 9m42s kubelet Created container webserver\n Normal Started 9m42s kubelet Started container webserver\n"
Dec 31 06:49:09.774: INFO:
Output of kubectl describe ss2-1:
Name: ss2-1
Namespace: statefulset-9565
Priority: 0
Service Account: default
Node: i-01238e73720e34636/172.20.60.17
Start Time: Sat, 31 Dec 2022 06:39:14 +0000
Labels: baz=blah
controller-revision-hash=ss2-7b6c9599d5
foo=bar
statefulset.kubernetes.io/pod-name=ss2-1
Annotations: <none>
Status: Running
IP: 172.20.33.194
IPs:
IP: 172.20.33.194
Controlled By: StatefulSet/ss2
Containers:
webserver:
Container ID: containerd://40a63e9740a0618e5b39277eb8e07ebe32f12c53da461906e9cef5ccdc550efd
Image: registry.k8s.io/e2e-test-images/httpd:2.4.38-4
Image ID: registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22
Port: <none>
Host Port: <none>
State: Running
Started: Sat, 31 Dec 2022 06:39:27 +0000
Ready: True
Restart Count: 0
Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-gkqxg (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
kube-api-access-gkqxg:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 9m55s default-scheduler Successfully assigned statefulset-9565/ss2-1 to i-01238e73720e34636
Warning FailedCreatePodSandBox 9m53s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "96d20f4c29dec744d6cc0b5ee109d45ec5a045d2c85b0c133793be04c01c37c1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Normal Pulled 9m42s kubelet Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Normal Created 9m42s kubelet Created container webserver
Normal Started 9m42s kubelet Started container webserver
Dec 31 06:49:09.774: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-9565 logs ss2-1 --tail=100'
Dec 31 06:49:10.184: INFO: stderr: ""
Dec 31 06:49:10.184: INFO: stdout: "172.20.60.17 - - [31/Dec/2022:06:47:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:47:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:48:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:49:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:49:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:49:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:49:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:49:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:49:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:49:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:49:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:49:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:49:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.60.17 - - [31/Dec/2022:06:49:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n"
Dec 31 06:49:10.184: INFO:
Last 100 log lines of ss2-1:
172.20.60.17 - - [31/Dec/2022:06:47:31 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:32 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:33 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:34 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:35 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:36 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:37 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:38 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:39 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:40 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:41 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:42 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:43 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:44 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:45 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:46 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:47 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:48 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:49 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:50 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:51 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:52 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:53 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:54 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:55 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:56 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:57 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:58 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:47:59 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:00 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:01 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:02 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:03 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:04 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:05 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:06 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:07 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:08 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:09 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:10 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:11 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:12 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:13 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:14 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:15 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:16 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:17 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:18 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:19 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:20 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:21 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:22 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:23 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:24 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:25 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:26 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:27 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:28 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:29 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:30 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:31 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:32 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:33 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:34 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:35 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:36 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:37 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:38 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:39 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:40 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:41 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:42 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:43 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:44 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:45 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:46 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:47 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:48 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:49 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:50 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:51 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:52 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:53 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:54 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:55 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:56 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:57 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:58 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:48:59 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:49:00 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:49:01 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:49:02 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:49:03 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:49:04 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:49:05 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:49:06 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:49:07 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:49:08 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:49:09 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.60.17 - - [31/Dec/2022:06:49:10 +0000] "GET /index.html HTTP/1.1" 200 45
Dec 31 06:49:10.184: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-9565 describe po ss2-2'
Dec 31 06:49:10.604: INFO: stderr: ""
Dec 31 06:49:10.604: INFO: stdout: "Name: ss2-2\nNamespace: statefulset-9565\nPriority: 0\nService Account: default\nNode: i-04ba2526d2f93fe75/172.20.50.49\nStart Time: Sat, 31 Dec 2022 06:39:10 +0000\nLabels: baz=blah\n controller-revision-hash=ss2-7b6c9599d5\n foo=bar\n statefulset.kubernetes.io/pod-name=ss2-2\nAnnotations: <none>\nStatus: Running\nIP: 172.20.59.213\nIPs:\n IP: 172.20.59.213\nControlled By: StatefulSet/ss2\nContainers:\n webserver:\n Container ID: containerd://c9b1b25e47c51e1c7f2a0665ae56f5c0f116c0d6c074d30ea7d17dc214dd818e\n Image: registry.k8s.io/e2e-test-images/httpd:2.4.38-4\n Image ID: registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22\n Port: <none>\n Host Port: <none>\n State: Running\n Started: Sat, 31 Dec 2022 06:39:11 +0000\n Ready: True\n Restart Count: 0\n Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n Environment: <none>\n Mounts:\n /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-k76th (ro)\nConditions:\n Type Status\n Initialized True \n Ready True \n ContainersReady True \n PodScheduled True \nVolumes:\n kube-api-access-k76th:\n Type: Projected (a volume that contains injected data from multiple sources)\n TokenExpirationSeconds: 3607\n ConfigMapName: kube-root-ca.crt\n ConfigMapOptional: <nil>\n DownwardAPI: true\nQoS Class: BestEffort\nNode-Selectors: <none>\nTolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n Type Reason Age From Message\n ---- ------ ---- ---- -------\n Normal Scheduled 10m default-scheduler Successfully assigned statefulset-9565/ss2-2 to i-04ba2526d2f93fe75\n Normal Pulled 9m59s kubelet Container image \"registry.k8s.io/e2e-test-images/httpd:2.4.38-4\" already present on machine\n Normal Created 9m59s kubelet Created container webserver\n Normal Started 9m59s kubelet Started container webserver\n"
Dec 31 06:49:10.604: INFO:
Output of kubectl describe ss2-2:
Name: ss2-2
Namespace: statefulset-9565
Priority: 0
Service Account: default
Node: i-04ba2526d2f93fe75/172.20.50.49
Start Time: Sat, 31 Dec 2022 06:39:10 +0000
Labels: baz=blah
controller-revision-hash=ss2-7b6c9599d5
foo=bar
statefulset.kubernetes.io/pod-name=ss2-2
Annotations: <none>
Status: Running
IP: 172.20.59.213
IPs:
IP: 172.20.59.213
Controlled By: StatefulSet/ss2
Containers:
webserver:
Container ID: containerd://c9b1b25e47c51e1c7f2a0665ae56f5c0f116c0d6c074d30ea7d17dc214dd818e
Image: registry.k8s.io/e2e-test-images/httpd:2.4.38-4
Image ID: registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22
Port: <none>
Host Port: <none>
State: Running
Started: Sat, 31 Dec 2022 06:39:11 +0000
Ready: True
Restart Count: 0
Readiness: http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1
Environment: <none>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-k76th (ro)
Conditions:
Type Status
Initialized True
Ready True
ContainersReady True
PodScheduled True
Volumes:
kube-api-access-k76th:
Type: Projected (a volume that contains injected data from multiple sources)
TokenExpirationSeconds: 3607
ConfigMapName: kube-root-ca.crt
ConfigMapOptional: <nil>
DownwardAPI: true
QoS Class: BestEffort
Node-Selectors: <none>
Tolerations: node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 10m default-scheduler Successfully assigned statefulset-9565/ss2-2 to i-04ba2526d2f93fe75
Normal Pulled 9m59s kubelet Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Normal Created 9m59s kubelet Created container webserver
Normal Started 9m59s kubelet Started container webserver
Dec 31 06:49:10.604: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-9565 logs ss2-2 --tail=100'
Dec 31 06:49:11.014: INFO: stderr: ""
Dec 31 06:49:11.014: INFO: stdout: "172.20.50.49 - - [31/Dec/2022:06:47:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:47:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:48:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:49:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:49:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:49:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:49:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:49:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:49:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:49:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:49:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:49:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:49:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.50.49 - - [31/Dec/2022:06:49:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n"
Dec 31 06:49:11.014: INFO:
Last 100 log lines of ss2-2:
172.20.50.49 - - [31/Dec/2022:06:47:31 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:32 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:33 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:34 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:35 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:36 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:37 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:38 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:39 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:40 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:41 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:42 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:43 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:44 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:45 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:46 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:47 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:48 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:49 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:50 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:51 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:52 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:53 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:54 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:55 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:56 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:57 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:58 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:47:59 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:00 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:01 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:02 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:03 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:04 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:05 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:06 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:07 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:08 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:09 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:10 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:11 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:12 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:13 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:14 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:15 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:16 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:17 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:18 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:19 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:20 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:21 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:22 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:23 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:24 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:25 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:26 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:27 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:28 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:29 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:30 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:31 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:32 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:33 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:34 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:35 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:36 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:37 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:38 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:39 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:40 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:41 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:42 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:43 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:44 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:45 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:46 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:47 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:48 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:49 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:50 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:51 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:52 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:53 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:54 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:55 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:56 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:57 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:58 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:48:59 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:49:00 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:49:01 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:49:02 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:49:03 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:49:04 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:49:05 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:49:06 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:49:07 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:49:08 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:49:09 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.50.49 - - [31/Dec/2022:06:49:10 +0000] "GET /index.html HTTP/1.1" 200 45
Dec 31 06:49:11.014: INFO: Deleting all statefulset in ns statefulset-9565
Dec 31 06:49:11.046: INFO: Scaling statefulset ss2 to 0
Dec 31 06:49:21.178: INFO: Waiting for statefulset status.replicas updated to 0
Dec 31 06:49:21.209: INFO: Deleting statefulset ss2
[AfterEach] [sig-apps] StatefulSet
test/e2e/framework/node/init/init.go:32
Dec 31 06:49:21.307: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] StatefulSet
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] StatefulSet
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m12/31/22 06:49:21.339�[0m
�[1mSTEP:�[0m Collecting events from namespace "statefulset-9565". �[38;5;243m12/31/22 06:49:21.339�[0m
�[1mSTEP:�[0m Found 63 events. �[38;5;243m12/31/22 06:49:21.376�[0m
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:14 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-0 in StatefulSet ss2 successful
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:14 +0000 UTC - event for ss2-0: {default-scheduler } Scheduled: Successfully assigned statefulset-9565/ss2-0 to i-07e0b1652877916dd
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:15 +0000 UTC - event for ss2-0: {kubelet i-07e0b1652877916dd} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:15 +0000 UTC - event for ss2-0: {kubelet i-07e0b1652877916dd} Created: Created container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:16 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-1 in StatefulSet ss2 successful
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:16 +0000 UTC - event for ss2-0: {kubelet i-07e0b1652877916dd} Started: Started container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:16 +0000 UTC - event for ss2-1: {default-scheduler } Scheduled: Successfully assigned statefulset-9565/ss2-1 to i-02803f86e9c119889
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:19 +0000 UTC - event for ss2-1: {kubelet i-02803f86e9c119889} Created: Created container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:19 +0000 UTC - event for ss2-1: {kubelet i-02803f86e9c119889} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:20 +0000 UTC - event for ss2-1: {kubelet i-02803f86e9c119889} Started: Started container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:24 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-2 in StatefulSet ss2 successful
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:24 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Created: Created container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:24 +0000 UTC - event for ss2-2: {default-scheduler } Scheduled: Successfully assigned statefulset-9565/ss2-2 to i-04ba2526d2f93fe75
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:24 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:25 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Started: Started container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:36 +0000 UTC - event for ss2-1: {kubelet i-02803f86e9c119889} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 404
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:46 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-2 in StatefulSet ss2 successful
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:46 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Killing: Stopping container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:48 +0000 UTC - event for ss2-2: {default-scheduler } Scheduled: Successfully assigned statefulset-9565/ss2-2 to i-04ba2526d2f93fe75
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:50 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.39-4" already present on machine
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:50 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Created: Created container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:50 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Started: Started container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:57 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-1 in StatefulSet ss2 successful
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:57 +0000 UTC - event for ss2-1: {kubelet i-02803f86e9c119889} Killing: Stopping container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:59 +0000 UTC - event for ss2-1: {kubelet i-01238e73720e34636} Pulling: Pulling image "registry.k8s.io/e2e-test-images/httpd:2.4.39-4"
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:37:59 +0000 UTC - event for ss2-1: {default-scheduler } Scheduled: Successfully assigned statefulset-9565/ss2-1 to i-01238e73720e34636
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:05 +0000 UTC - event for ss2-1: {kubelet i-01238e73720e34636} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/httpd:2.4.39-4" in 5.447719057s (5.447739189s including waiting)
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:05 +0000 UTC - event for ss2-1: {kubelet i-01238e73720e34636} Started: Started container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:05 +0000 UTC - event for ss2-1: {kubelet i-01238e73720e34636} Created: Created container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:09 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-0 in StatefulSet ss2 successful
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:09 +0000 UTC - event for ss2-0: {kubelet i-07e0b1652877916dd} Killing: Stopping container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:09 +0000 UTC - event for ss2-0: {kubelet i-07e0b1652877916dd} Unhealthy: Readiness probe failed: Get "http://172.20.52.228:80/index.html": dial tcp 172.20.52.228:80: connect: connection refused
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:15 +0000 UTC - event for ss2-0: {default-scheduler } Scheduled: Successfully assigned statefulset-9565/ss2-0 to i-07e0b1652877916dd
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:16 +0000 UTC - event for ss2-0: {kubelet i-07e0b1652877916dd} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.39-4" already present on machine
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:16 +0000 UTC - event for ss2-0: {kubelet i-07e0b1652877916dd} Created: Created container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:16 +0000 UTC - event for ss2-0: {kubelet i-07e0b1652877916dd} Started: Started container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:27 +0000 UTC - event for ss2-1: {kubelet i-01238e73720e34636} Unhealthy: Readiness probe failed: HTTP probe failed with statuscode: 404
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:59 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Killing: Stopping container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:38:59 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Unhealthy: Readiness probe failed: Get "http://172.20.43.176:80/index.html": dial tcp 172.20.43.176:80: connect: connection refused
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:10 +0000 UTC - event for ss2-2: {default-scheduler } Scheduled: Successfully assigned statefulset-9565/ss2-2 to i-04ba2526d2f93fe75
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:11 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Started: Started container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:11 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:11 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Created: Created container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:13 +0000 UTC - event for ss2-1: {kubelet i-01238e73720e34636} Killing: Stopping container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:14 +0000 UTC - event for ss2-1: {default-scheduler } Scheduled: Successfully assigned statefulset-9565/ss2-1 to i-01238e73720e34636
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:16 +0000 UTC - event for ss2-1: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "96d20f4c29dec744d6cc0b5ee109d45ec5a045d2c85b0c133793be04c01c37c1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:27 +0000 UTC - event for ss2-0: {kubelet i-07e0b1652877916dd} Killing: Stopping container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:27 +0000 UTC - event for ss2-1: {kubelet i-01238e73720e34636} Started: Started container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:27 +0000 UTC - event for ss2-1: {kubelet i-01238e73720e34636} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:27 +0000 UTC - event for ss2-1: {kubelet i-01238e73720e34636} Created: Created container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:28 +0000 UTC - event for ss2-0: {default-scheduler } Scheduled: Successfully assigned statefulset-9565/ss2-0 to i-02803f86e9c119889
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:28 +0000 UTC - event for ss2-0: {kubelet i-02803f86e9c119889} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "29cd63fa14161b64c58cb247da2ad147e97300bc5a340f2b24c41bc27e8e9ab8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:42 +0000 UTC - event for ss2-0: {kubelet i-02803f86e9c119889} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cfa313c15de1e24927de51a42ba398836f40026ad7234e59cd2c33352b8e2bf1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:39:54 +0000 UTC - event for ss2-0: {kubelet i-02803f86e9c119889} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "127ea1916ddd457a1d1762a0351cefe43c59906eecacb35aa417dd3ddc96ae32": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:40:09 +0000 UTC - event for ss2-0: {kubelet i-02803f86e9c119889} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e8546e3e6a1c5b526f2f6a4cc0e915ba8264b89ac63780b4769ad6e9aebfb2e9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:40:23 +0000 UTC - event for ss2-0: {kubelet i-02803f86e9c119889} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b6883523c817395bc21d8f48eee1c92c59350a1d7d0b991d87d7a56c6ac0fb1c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:40:36 +0000 UTC - event for ss2-0: {kubelet i-02803f86e9c119889} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "631bd1ff2cd262bde17540b67a1844f77cb6661a0b9199f47e7f49f6cf6c9e90": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:40:50 +0000 UTC - event for ss2-0: {kubelet i-02803f86e9c119889} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c9bed900020d42e6bc927975a76eb78d9fe1adf87852fc5aa4f8d44b1f1f53db": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:41:04 +0000 UTC - event for ss2-0: {kubelet i-02803f86e9c119889} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4036fa515dc2f75dbe6ce2916c8da5c810d294055bda9d2e1539e9c4b0851ba0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:41:19 +0000 UTC - event for ss2-0: {kubelet i-02803f86e9c119889} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "02616d9bd713bf9f866153ae47149d9f3c26ab4ceb882dd07984a503c945838d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:41:30 +0000 UTC - event for ss2-0: {kubelet i-02803f86e9c119889} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "47113be9e0d05fa169c3538540942ba68fecdc2aa5bdeed9caf3a46848f5828b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:49:11 +0000 UTC - event for ss2-2: {kubelet i-04ba2526d2f93fe75} Killing: Stopping container webserver
Dec 31 06:49:21.376: INFO: At 2022-12-31 06:49:12 +0000 UTC - event for ss2-1: {kubelet i-01238e73720e34636} Killing: Stopping container webserver
Dec 31 06:49:21.408: INFO: POD NODE PHASE GRACE CONDITIONS
Dec 31 06:49:21.408: INFO:
Dec 31 06:49:21.440: INFO:
Logging node info for node i-01238e73720e34636
Dec 31 06:49:21.471: INFO: Node Info: &Node{ObjectMeta:{i-01238e73720e34636 6336cf01-1d9c-435d-8598-300dc5c8cd47 33396 0 2022-12-31 06:25:53 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01238e73720e34636 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01238e73720e34636 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.17 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01238e73720e34636"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:45:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-31 06:45:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01238e73720e34636,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:45:25 +0000 UTC,LastTransitionTime:2022-12-31 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.17,},NodeAddress{Type:ExternalIP,Address:3.96.140.88,},NodeAddress{Type:InternalDNS,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-140-88.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b18c944e5e0e896bb3ef13f5e91a,SystemUUID:ec25b18c-944e-5e0e-896b-b3ef13f5e91a,BootID:429656db-871c-45f8-90c8-d6173d395019,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-017852f53c72a0ef1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-017852f53c72a0ef1,DevicePath:,},},Config:nil,},}
Dec 31 06:49:21.472: INFO:
Logging kubelet events for node i-01238e73720e34636
Dec 31 06:49:21.514: INFO:
Logging pods the kubelet thinks is on node i-01238e73720e34636
Dec 31 06:49:21.559: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xpfkc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.559: INFO: ebs-csi-node-5sskd started at 2022-12-31 06:25:54 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:21.559: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:21.559: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:49:21.559: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:45:39 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:21.559: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:49:21.559: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:21.559: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:49:21.559: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:49:21.559: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:49:21.559: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:49:21.559: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-t2p68 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.559: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-md99c started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.559: INFO: cilium-jtczt started at 2022-12-31 06:25:54 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:49:21.559: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:49:21.559: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-57rjk started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.559: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-fppmn started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.559: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-tkxdw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.559: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-mb5bq started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.559: INFO: pod-7e7c87a8-d2b7-4785-bffe-e3722a7eb3d1 started at 2022-12-31 06:45:18 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container write-pod ready: false, restart count 0
Dec 31 06:49:21.559: INFO: sample-apiserver-deployment-55bd96fd47-b49pn started at 2022-12-31 06:45:15 +0000 UTC (0+2 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container etcd ready: false, restart count 0
Dec 31 06:49:21.559: INFO: Container sample-apiserver ready: false, restart count 0
Dec 31 06:49:21.559: INFO: nodeport-test-zdf2l started at 2022-12-31 06:45:24 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container nodeport-test ready: false, restart count 0
Dec 31 06:49:21.559: INFO: liveness-76925a35-eff7-4a2b-b7b3-43a02cc3460a started at 2022-12-31 06:45:10 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container agnhost-container ready: false, restart count 0
Dec 31 06:49:21.559: INFO: successful-jobs-history-limit-27874486-tglfj started at 2022-12-31 06:46:00 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container c ready: false, restart count 0
Dec 31 06:49:21.559: INFO: netserver-0 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container webserver ready: true, restart count 0
Dec 31 06:49:21.559: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-jp975 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.559: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-t9sfw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.559: INFO: dns-test-5925a097-8949-4b9e-ae20-3cd9dafe31de started at 2022-12-31 06:46:00 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container jessie-querier ready: false, restart count 0
Dec 31 06:49:21.559: INFO: Container querier ready: false, restart count 0
Dec 31 06:49:21.559: INFO: Container webserver ready: false, restart count 0
Dec 31 06:49:21.559: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-dbm42 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.559: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.773: INFO:
Latency metrics for node i-01238e73720e34636
Dec 31 06:49:21.773: INFO:
Logging node info for node i-02803f86e9c119889
Dec 31 06:49:21.804: INFO: Node Info: &Node{ObjectMeta:{i-02803f86e9c119889 4f26fd9b-7bc7-4f71-8b66-a761d4c63f01 32793 0 2022-12-31 06:25:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02803f86e9c119889 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-02803f86e9c119889 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.83 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5953":"i-02803f86e9c119889","ebs.csi.aws.com":"i-02803f86e9c119889"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:44:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-02803f86e9c119889,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.83,},NodeAddress{Type:ExternalIP,Address:3.96.199.254,},NodeAddress{Type:InternalDNS,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-199-254.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23319fa293bc90a121ffa207804bf8,SystemUUID:ec23319f-a293-bc90-a121-ffa207804bf8,BootID:443b01ac-cd9d-4547-9748-ec9c7edbc67a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-5953^93ecf6eb-88d6-11ed-aa52-6a9e5ddd1dab],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:49:21.805: INFO:
Logging kubelet events for node i-02803f86e9c119889
Dec 31 06:49:21.838: INFO:
Logging pods the kubelet thinks is on node i-02803f86e9c119889
Dec 31 06:49:21.886: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:55 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:49:21.886: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-vrzch started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.886: INFO: inline-volume-tester-2zpb4 started at 2022-12-31 06:44:56 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:49:21.886: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:45:38 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:49:21.886: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:49:21.886: INFO: coredns-autoscaler-7cb5c5b969-pt9s2 started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container autoscaler ready: true, restart count 0
Dec 31 06:49:21.886: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-hthc5 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.886: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-bhwsk started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.886: INFO: coredns-559769c974-r8xfg started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container coredns ready: true, restart count 0
Dec 31 06:49:21.886: INFO: hostexec-i-02803f86e9c119889-7dr55 started at 2022-12-31 06:49:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container agnhost-container ready: false, restart count 0
Dec 31 06:49:21.886: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xjng7 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.886: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-dc2f2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.886: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9564 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.886: INFO: pvc-volume-tester-m8r85 started at 2022-12-31 06:44:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:49:21.886: INFO: netserver-1 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container webserver ready: false, restart count 0
Dec 31 06:49:21.886: INFO: cilium-24dpj started at 2022-12-31 06:25:40 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:49:21.886: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:49:21.886: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wd9vv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.886: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-sqdwl started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.886: INFO: ebs-csi-node-8hn4r started at 2022-12-31 06:25:40 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:21.886: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:21.886: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:49:21.886: INFO: csi-mockplugin-0 started at 2022-12-31 06:38:47 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:49:21.886: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:49:21.886: INFO: Container mock ready: true, restart count 0
Dec 31 06:49:21.886: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-j64b2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:21.886: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-nv2qw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0
Dec 31 06:49:21.886: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:38:48 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:21.886: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:22.163: INFO:
Latency metrics for node i-02803f86e9c119889
Dec 31 06:49:22.163: INFO:
Logging node info for node i-04ba2526d2f93fe75
Dec 31 06:49:22.195: INFO: Node Info: &Node{ObjectMeta:{i-04ba2526d2f93fe75 66716b11-28bf-41d8-82f8-881d9a36efb5 34799 0 2022-12-31 06:25:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04ba2526d2f93fe75 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04ba2526d2f93fe75 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.50.49 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-7116":"i-04ba2526d2f93fe75","ebs.csi.aws.com":"i-04ba2526d2f93fe75"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:45:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-31 06:49:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04ba2526d2f93fe75,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:45:44 +0000 UTC,LastTransitionTime:2022-12-31 06:26:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.50.49,},NodeAddress{Type:ExternalIP,Address:35.182.108.97,},NodeAddress{Type:InternalDNS,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-108-97.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bacfd4cdc1a7d3a3ee77d377f7e34,SystemUUID:ec2bacfd-4cdc-1a7d-3a3e-e77d377f7e34,BootID:c6b8143b-5a4c-4cc7-b066-49b954ceaace,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-005302b9e4e7ea2c5 kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2 kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-005302b9e4e7ea2c5,DevicePath:,},},Config:nil,},}
Dec 31 06:49:22.196: INFO:
Logging kubelet events for node i-04ba2526d2f93fe75
Dec 31 06:49:22.230: INFO:
Logging pods the kubelet thinks is on node i-04ba2526d2f93fe75
Dec 31 06:49:22.279: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-swkmw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.279: INFO: inline-volume-tester-6zlk7 started at 2022-12-31 06:39:27 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:49:22.279: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:46:38 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:22.279: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-j5hrc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.279: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kxjl4 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.279: INFO: csi-mockplugin-0 started at 2022-12-31 06:46:38 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:49:22.279: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:49:22.279: INFO: Container mock ready: true, restart count 0
Dec 31 06:49:22.279: INFO: netserver-2 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container webserver ready: false, restart count 0
Dec 31 06:49:22.279: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:46:38 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:22.279: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:05 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:22.279: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:49:22.279: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:22.279: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:49:22.279: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:49:22.279: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:49:22.279: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:49:22.279: INFO: nodeport-test-kd22w started at 2022-12-31 06:45:24 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container nodeport-test ready: true, restart count 0
Dec 31 06:49:22.279: INFO: cilium-jswjf started at 2022-12-31 06:25:53 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:49:22.279: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:49:22.279: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-nq9pj started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.279: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kl6rx started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.279: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-24srg started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.279: INFO: inline-volume-tester-rg5s8 started at 2022-12-31 06:44:26 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.279: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:49:22.279: INFO: pod-failure-ignore-zlrmr started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.280: INFO: Container c ready: false, restart count 0
Dec 31 06:49:22.280: INFO: external-injector started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.280: INFO: Container external-injector ready: false, restart count 0
Dec 31 06:49:22.280: INFO: ebs-csi-node-rq4r2 started at 2022-12-31 06:25:53 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:22.280: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:22.280: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:22.280: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:49:22.280: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wgmwt started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.280: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.280: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-rz4lh started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.280: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.280: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9xgv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.280: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.280: INFO: pod-failure-ignore-jxmrf started at 2022-12-31 06:45:36 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.280: INFO: Container c ready: false, restart count 0
Dec 31 06:49:22.280: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-tr8ff started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.280: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.481: INFO:
Latency metrics for node i-04ba2526d2f93fe75
Dec 31 06:49:22.481: INFO:
Logging node info for node i-0623d19705b93fa12
Dec 31 06:49:22.512: INFO: Node Info: &Node{ObjectMeta:{i-0623d19705b93fa12 42adab5d-2a9f-490b-8d96-b2134aee6d35 34236 0 2022-12-31 06:23:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0623d19705b93fa12 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.244 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0623d19705b93fa12"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-31 06:23:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-31 06:24:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:24:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-31 06:46:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0623d19705b93fa12,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:46:53 +0000 UTC,LastTransitionTime:2022-12-31 06:24:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.244,},NodeAddress{Type:ExternalIP,Address:3.96.201.212,},NodeAddress{Type:InternalDNS,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-201-212.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27d827c769aef19bbb1df3025ce86a,SystemUUID:ec27d827-c769-aef1-9bbb-1df3025ce86a,BootID:e238e24c-8167-4573-a762-5c346ea34877,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451628,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805582,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967330,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:49:22.513: INFO:
Logging kubelet events for node i-0623d19705b93fa12
Dec 31 06:49:22.547: INFO:
Logging pods the kubelet thinks is on node i-0623d19705b93fa12
Dec 31 06:49:22.585: INFO: dns-controller-69987775c6-989tg started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.585: INFO: Container dns-controller ready: true, restart count 0
Dec 31 06:49:22.585: INFO: etcd-manager-events-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.585: INFO: Container etcd-manager ready: true, restart count 0
Dec 31 06:49:22.585: INFO: etcd-manager-main-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.585: INFO: Container etcd-manager ready: true, restart count 0
Dec 31 06:49:22.585: INFO: kube-apiserver-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+2 container statuses recorded)
Dec 31 06:49:22.585: INFO: Container healthcheck ready: true, restart count 0
Dec 31 06:49:22.585: INFO: Container kube-apiserver ready: true, restart count 1
Dec 31 06:49:22.585: INFO: ebs-csi-node-pnmdn started at 2022-12-31 06:24:30 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:22.585: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:22.585: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:22.585: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:49:22.585: INFO: aws-cloud-controller-manager-68vsl started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.585: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Dec 31 06:49:22.585: INFO: cilium-operator-5dd44dc49f-gwnh5 started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.585: INFO: Container cilium-operator ready: true, restart count 0
Dec 31 06:49:22.585: INFO: kube-controller-manager-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.585: INFO: Container kube-controller-manager ready: true, restart count 2
Dec 31 06:49:22.585: INFO: kube-scheduler-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.585: INFO: Container kube-scheduler ready: true, restart count 0
Dec 31 06:49:22.585: INFO: cilium-5qps9 started at 2022-12-31 06:24:30 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:49:22.585: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:49:22.585: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:49:22.585: INFO: kops-controller-5j56z started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.585: INFO: Container kops-controller ready: true, restart count 0
Dec 31 06:49:22.585: INFO: ebs-csi-controller-89b649c94-wxqzv started at 2022-12-31 06:24:30 +0000 UTC (0+5 container statuses recorded)
Dec 31 06:49:22.585: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:49:22.585: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:49:22.585: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:49:22.585: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:22.585: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:22.753: INFO:
Latency metrics for node i-0623d19705b93fa12
Dec 31 06:49:22.753: INFO:
Logging node info for node i-07e0b1652877916dd
Dec 31 06:49:22.784: INFO: Node Info: &Node{ObjectMeta:{i-07e0b1652877916dd 503d2e8d-789d-4154-983b-d84a9e1f26d3 33533 0 2022-12-31 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07e0b1652877916dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-07e0b1652877916dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.32 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2668":"i-07e0b1652877916dd","csi-mock-csi-mock-volumes-3959":"i-07e0b1652877916dd","ebs.csi.aws.com":"i-07e0b1652877916dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:45:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-07e0b1652877916dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:45:34 +0000 UTC,LastTransitionTime:2022-12-31 06:26:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.32,},NodeAddress{Type:ExternalIP,Address:3.96.208.158,},NodeAddress{Type:InternalDNS,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-208-158.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23f46c8ef59d08a0747ddba3b48b3e,SystemUUID:ec23f46c-8ef5-9d08-a074-7ddba3b48b3e,BootID:7f531ed6-40f4-44aa-95ac-677cf2d148cb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-2668^b7704c85-88d6-11ed-bda0-764bfc430f4f kubernetes.io/csi/csi-mock-csi-mock-volumes-3959^a09d1446-88d6-11ed-9ca5-ce024c9251f3],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:49:22.784: INFO:
Logging kubelet events for node i-07e0b1652877916dd
Dec 31 06:49:22.818: INFO:
Logging pods the kubelet thinks is on node i-07e0b1652877916dd
Dec 31 06:49:22.858: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-5d4zx started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0
Dec 31 06:49:22.858: INFO: ebs-csi-node-sgtqp started at 2022-12-31 06:25:52 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:49:22.858: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:49:22.858: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:49:22.858: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-6plfw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.858: INFO: pvc-volume-tester-9hhmr started at 2022-12-31 06:44:51 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:49:22.858: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-bzltr started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.858: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:49:22.858: INFO: pvc-volume-tester-cn5lf started at 2022-12-31 06:45:32 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:49:22.858: INFO: netserver-3 started at 2022-12-31 06:45:23 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container webserver ready: false, restart count 0
Dec 31 06:49:22.858: INFO: csi-mockplugin-0 started at 2022-12-31 06:45:37 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:49:22.858: INFO: Container driver-registrar ready: false, restart count 0
Dec 31 06:49:22.858: INFO: Container mock ready: false, restart count 0
Dec 31 06:49:22.858: INFO: csi-mockplugin-0 started at 2022-12-31 06:39:09 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:49:22.858: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:49:22.858: INFO: Container mock ready: true, restart count 0
Dec 31 06:49:22.858: INFO: csi-mockplugin-0 started at 2022-12-31 06:44:25 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:49:22.858: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:49:22.858: INFO: Container mock ready: true, restart count 0
Dec 31 06:49:22.858: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-7tbwm started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.858: INFO: coredns-559769c974-tz7zd started at 2022-12-31 06:26:19 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container coredns ready: true, restart count 0
Dec 31 06:49:22.858: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:22.858: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-lcw6r started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.858: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wnd2m started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.858: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-pswrk started at 2022-12-31 06:38:47 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.858: INFO: cilium-4xz2s started at 2022-12-31 06:25:52 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:49:22.858: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:49:22.858: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-zltlv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.858: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:45:37 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:22.858: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:44:25 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:49:22.858: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xxrt2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:22.858: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-s49xp started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:49:22.858: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:49:23.069: INFO:
Latency metrics for node i-07e0b1652877916dd
[DeferCleanup (Each)] [sig-apps] StatefulSet
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "statefulset-9565" for this suite. �[38;5;243m12/31/22 06:49:23.069�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sPort\sforwarding\sWith\sa\sserver\slistening\son\slocalhost\sshould\ssupport\sforwarding\sover\swebsockets$'
test/e2e/kubectl/portforward.go:372
k8s.io/kubernetes/test/e2e/kubectl.doTestOverWebSockets({0x75c6d52, 0x9}, 0xc000fe44b0)
test/e2e/kubectl/portforward.go:372 +0x2af
k8s.io/kubernetes/test/e2e/kubectl.glob..func2.2.3()
test/e2e/kubectl/portforward.go:493 +0x29
[BeforeEach] [sig-cli] Kubectl Port forwarding
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/31/22 06:40:12.332�[0m
Dec 31 06:40:12.333: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename port-forwarding �[38;5;243m12/31/22 06:40:12.334�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/31/22 06:40:12.43�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/31/22 06:40:12.492�[0m
[BeforeEach] [sig-cli] Kubectl Port forwarding
test/e2e/framework/metrics/init/init.go:31
[It] should support forwarding over websockets
test/e2e/kubectl/portforward.go:492
Dec 31 06:40:12.554: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Creating the pod �[38;5;243m12/31/22 06:40:12.554�[0m
Dec 31 06:40:12.591: INFO: Waiting up to 5m0s for pod "pfpod" in namespace "port-forwarding-6649" to be "running and ready"
Dec 31 06:40:12.624: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 32.263906ms
Dec 31 06:40:12.624: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:14.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2.064891479s
Dec 31 06:40:14.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:16.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4.065607546s
Dec 31 06:40:16.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:18.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 6.064368617s
Dec 31 06:40:18.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:20.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 8.065164885s
Dec 31 06:40:20.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:22.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 10.065075191s
Dec 31 06:40:22.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:24.658: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 12.066410008s
Dec 31 06:40:24.658: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:26.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 14.06508872s
Dec 31 06:40:26.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:28.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 16.065287029s
Dec 31 06:40:28.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:30.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 18.064406617s
Dec 31 06:40:30.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:32.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 20.065727372s
Dec 31 06:40:32.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:34.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 22.06535233s
Dec 31 06:40:34.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:36.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 24.065430523s
Dec 31 06:40:36.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:38.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 26.064410176s
Dec 31 06:40:38.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:40.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 28.064895444s
Dec 31 06:40:40.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:42.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 30.064972086s
Dec 31 06:40:42.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:44.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 32.065296877s
Dec 31 06:40:44.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:46.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 34.065092838s
Dec 31 06:40:46.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:48.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 36.065140454s
Dec 31 06:40:48.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:50.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 38.065480681s
Dec 31 06:40:50.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:52.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 40.065080756s
Dec 31 06:40:52.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:54.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 42.064852322s
Dec 31 06:40:54.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:56.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 44.064601999s
Dec 31 06:40:56.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:40:58.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 46.065020435s
Dec 31 06:40:58.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:00.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 48.064406074s
Dec 31 06:41:00.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:02.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 50.06598724s
Dec 31 06:41:02.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:04.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 52.06553034s
Dec 31 06:41:04.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:06.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 54.065292072s
Dec 31 06:41:06.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:08.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 56.064984598s
Dec 31 06:41:08.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:10.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 58.064696815s
Dec 31 06:41:10.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:12.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.065109721s
Dec 31 06:41:12.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:14.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.065023365s
Dec 31 06:41:14.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:16.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.065067717s
Dec 31 06:41:16.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:18.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.065434448s
Dec 31 06:41:18.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:20.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.064526663s
Dec 31 06:41:20.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:22.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.065498135s
Dec 31 06:41:22.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:24.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.065167174s
Dec 31 06:41:24.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:26.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.06577145s
Dec 31 06:41:26.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:28.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.065020509s
Dec 31 06:41:28.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:30.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.065421882s
Dec 31 06:41:30.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:32.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.065311899s
Dec 31 06:41:32.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:34.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.065561128s
Dec 31 06:41:34.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:36.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.065207722s
Dec 31 06:41:36.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:38.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.065413673s
Dec 31 06:41:38.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:40.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.064420382s
Dec 31 06:41:40.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:42.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.064690592s
Dec 31 06:41:42.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:44.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.065264047s
Dec 31 06:41:44.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:46.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.064758905s
Dec 31 06:41:46.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:48.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.065305326s
Dec 31 06:41:48.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:50.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.064423843s
Dec 31 06:41:50.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:52.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.064750532s
Dec 31 06:41:52.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:54.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.065458241s
Dec 31 06:41:54.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:56.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.064714502s
Dec 31 06:41:56.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:41:58.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.065049376s
Dec 31 06:41:58.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:00.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.064824756s
Dec 31 06:42:00.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:02.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.065474974s
Dec 31 06:42:02.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:04.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.065088364s
Dec 31 06:42:04.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:06.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.065016989s
Dec 31 06:42:06.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:08.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.065582895s
Dec 31 06:42:08.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:10.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.064886257s
Dec 31 06:42:10.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:12.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.064690281s
Dec 31 06:42:12.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:14.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.064491949s
Dec 31 06:42:14.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:16.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.065415096s
Dec 31 06:42:16.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:18.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.065277293s
Dec 31 06:42:18.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:20.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.064266164s
Dec 31 06:42:20.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:22.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.064589508s
Dec 31 06:42:22.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:24.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.065253473s
Dec 31 06:42:24.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:26.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.065548977s
Dec 31 06:42:26.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:28.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.065091922s
Dec 31 06:42:28.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:30.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.064295279s
Dec 31 06:42:30.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:32.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.064605625s
Dec 31 06:42:32.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:34.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.06461912s
Dec 31 06:42:34.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:36.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.065253104s
Dec 31 06:42:36.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:38.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.065074288s
Dec 31 06:42:38.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:40.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.06460551s
Dec 31 06:42:40.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:42.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.065361143s
Dec 31 06:42:42.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:44.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.065657828s
Dec 31 06:42:44.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:46.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.064505115s
Dec 31 06:42:46.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:48.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.065274992s
Dec 31 06:42:48.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:50.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.064185484s
Dec 31 06:42:50.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:52.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.064107655s
Dec 31 06:42:52.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:54.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.065199984s
Dec 31 06:42:54.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:56.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.06444415s
Dec 31 06:42:56.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:42:58.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.065111922s
Dec 31 06:42:58.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:00.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.064956642s
Dec 31 06:43:00.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:02.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.06519611s
Dec 31 06:43:02.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:04.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.065311273s
Dec 31 06:43:04.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:06.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.06525358s
Dec 31 06:43:06.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:08.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.065303631s
Dec 31 06:43:08.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:10.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.064830887s
Dec 31 06:43:10.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:12.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.065299958s
Dec 31 06:43:12.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:14.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.065716418s
Dec 31 06:43:14.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:16.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.06533732s
Dec 31 06:43:16.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:18.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.064980524s
Dec 31 06:43:18.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:20.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.064252552s
Dec 31 06:43:20.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:22.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.065192869s
Dec 31 06:43:22.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:24.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.065326217s
Dec 31 06:43:24.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:26.658: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.06602836s
Dec 31 06:43:26.658: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:28.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.065025361s
Dec 31 06:43:28.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:30.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.064766987s
Dec 31 06:43:30.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:32.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.065283036s
Dec 31 06:43:32.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:34.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.065416188s
Dec 31 06:43:34.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:36.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.065385498s
Dec 31 06:43:36.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:38.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.064851134s
Dec 31 06:43:38.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:40.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.064142859s
Dec 31 06:43:40.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:42.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.064194366s
Dec 31 06:43:42.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:44.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.064849669s
Dec 31 06:43:44.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:46.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.065053505s
Dec 31 06:43:46.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:48.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.06531193s
Dec 31 06:43:48.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:50.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.064806212s
Dec 31 06:43:50.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:52.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.065237s
Dec 31 06:43:52.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:54.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.064364948s
Dec 31 06:43:54.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:56.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.064930631s
Dec 31 06:43:56.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:43:58.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.065403668s
Dec 31 06:43:58.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:00.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.064394796s
Dec 31 06:44:00.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:02.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.064324027s
Dec 31 06:44:02.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:04.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.06456114s
Dec 31 06:44:04.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:06.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.06523501s
Dec 31 06:44:06.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:08.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.064966863s
Dec 31 06:44:08.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:10.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.065345345s
Dec 31 06:44:10.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:12.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.065279396s
Dec 31 06:44:12.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:14.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.064548838s
Dec 31 06:44:14.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:16.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.065634874s
Dec 31 06:44:16.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:18.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.064940522s
Dec 31 06:44:18.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:20.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.064615793s
Dec 31 06:44:20.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:22.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.0642775s
Dec 31 06:44:22.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:24.658: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.06662727s
Dec 31 06:44:24.658: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:26.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.064442276s
Dec 31 06:44:26.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:28.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.064893883s
Dec 31 06:44:28.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:30.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.065174331s
Dec 31 06:44:30.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:32.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.065234586s
Dec 31 06:44:32.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:34.658: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.06687092s
Dec 31 06:44:34.658: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:36.663: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.071125773s
Dec 31 06:44:36.663: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:38.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.064317006s
Dec 31 06:44:38.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:40.660: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.068517873s
Dec 31 06:44:40.660: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:42.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.064889351s
Dec 31 06:44:42.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:44.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.064692373s
Dec 31 06:44:44.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:46.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.065136802s
Dec 31 06:44:46.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:48.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.065094721s
Dec 31 06:44:48.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:50.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.064526409s
Dec 31 06:44:50.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:52.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.06491066s
Dec 31 06:44:52.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:54.655: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.063987712s
Dec 31 06:44:54.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:56.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.064023932s
Dec 31 06:44:56.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:44:58.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.064075816s
Dec 31 06:44:58.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:45:00.660: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.068664433s
Dec 31 06:45:00.660: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:45:02.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.064959665s
Dec 31 06:45:02.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:45:04.657: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.06553707s
Dec 31 06:45:04.657: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:45:06.658: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.066092365s
Dec 31 06:45:06.658: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:45:08.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.064356911s
Dec 31 06:45:08.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:45:10.655: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.063892025s
Dec 31 06:45:10.655: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:45:12.656: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.06494089s
Dec 31 06:45:12.656: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:45:12.688: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.096548956s
Dec 31 06:45:12.688: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Dec 31 06:45:12.688: FAIL: Pod did not start running: timed out while waiting for pod port-forwarding-6649/pfpod to be running and ready
Full Stack Trace
k8s.io/kubernetes/test/e2e/kubectl.doTestOverWebSockets({0x75c6d52, 0x9}, 0xc000fe44b0)
test/e2e/kubectl/portforward.go:372 +0x2af
k8s.io/kubernetes/test/e2e/kubectl.glob..func2.2.3()
test/e2e/kubectl/portforward.go:493 +0x29
[AfterEach] [sig-cli] Kubectl Port forwarding
test/e2e/framework/node/init/init.go:32
Dec 31 06:45:12.688: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m12/31/22 06:45:12.721�[0m
�[1mSTEP:�[0m Collecting events from namespace "port-forwarding-6649". �[38;5;243m12/31/22 06:45:12.721�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m12/31/22 06:45:12.753�[0m
Dec 31 06:45:12.753: INFO: At 2022-12-31 06:40:12 +0000 UTC - event for pfpod: {default-scheduler } Scheduled: Successfully assigned port-forwarding-6649/pfpod to i-01238e73720e34636
Dec 31 06:45:12.753: INFO: At 2022-12-31 06:40:12 +0000 UTC - event for pfpod: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7cb65a7fcfa4b83cfe27bed3836a15cad9a7181d7f6a874e255d76ae710f0088": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:45:12.753: INFO: At 2022-12-31 06:40:24 +0000 UTC - event for pfpod: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0a0c351428425341f3c9711844af3519f68c6deed9321c5e3c47aeed4f0183c7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:45:12.753: INFO: At 2022-12-31 06:40:38 +0000 UTC - event for pfpod: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1b5f0c54b6da59b2524850111cd70581b592ec52da733b8ae6ccf8dada2e9325": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:45:12.753: INFO: At 2022-12-31 06:40:50 +0000 UTC - event for pfpod: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "961ee374d7205368b86dcda368d297f3fdda1140d25e662622b27c4bc5bb27b3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:45:12.753: INFO: At 2022-12-31 06:41:02 +0000 UTC - event for pfpod: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "61c993ca256e2ae8a0f602c2d152a413a481854b54612f48f512c63a6c0f2144": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:45:12.753: INFO: At 2022-12-31 06:41:15 +0000 UTC - event for pfpod: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1bfdd9fedce29fcee729f089ceaaa8161a34d525cf47e2af12e19243df1596eb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:45:12.753: INFO: At 2022-12-31 06:41:28 +0000 UTC - event for pfpod: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e345ec3896f1c0570208fc6d31f783baaf931d27b349d13f0cb7e10a11134e8a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:45:12.753: INFO: At 2022-12-31 06:41:43 +0000 UTC - event for pfpod: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "829c239a923f3d6137c62c7245a2274467489c975395d72af978356aa358f49d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:45:12.753: INFO: At 2022-12-31 06:41:55 +0000 UTC - event for pfpod: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "957600fa228b6fc010e9fe19385b75ad053acb0b794103217b15fd37982a3866": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:45:12.753: INFO: At 2022-12-31 06:42:10 +0000 UTC - event for pfpod: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e0f133dbbc5ae9618153ada234b2d2ea8be9555114700b0e4e30860216de7815": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Dec 31 06:45:12.785: INFO: POD NODE PHASE GRACE CONDITIONS
Dec 31 06:45:12.785: INFO: pfpod i-01238e73720e34636 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2022-12-31 06:40:12 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2022-12-31 06:40:12 +0000 UTC ContainersNotReady containers with unready status: [readiness portforwardtester]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2022-12-31 06:40:12 +0000 UTC ContainersNotReady containers with unready status: [readiness portforwardtester]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2022-12-31 06:40:12 +0000 UTC }]
Dec 31 06:45:12.785: INFO:
Dec 31 06:45:12.818: INFO: Unable to fetch port-forwarding-6649/pfpod/readiness logs: the server rejected our request for an unknown reason (get pods pfpod)
Dec 31 06:45:12.850: INFO: Unable to fetch port-forwarding-6649/pfpod/portforwardtester logs: the server rejected our request for an unknown reason (get pods pfpod)
Dec 31 06:45:12.883: INFO:
Logging node info for node i-01238e73720e34636
Dec 31 06:45:12.915: INFO: Node Info: &Node{ObjectMeta:{i-01238e73720e34636 6336cf01-1d9c-435d-8598-300dc5c8cd47 32820 0 2022-12-31 06:25:53 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01238e73720e34636 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01238e73720e34636 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.17 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01238e73720e34636"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:44:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01238e73720e34636,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:44:34 +0000 UTC,LastTransitionTime:2022-12-31 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.17,},NodeAddress{Type:ExternalIP,Address:3.96.140.88,},NodeAddress{Type:InternalDNS,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-140-88.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b18c944e5e0e896bb3ef13f5e91a,SystemUUID:ec25b18c-944e-5e0e-896b-b3ef13f5e91a,BootID:429656db-871c-45f8-90c8-d6173d395019,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:45:12.915: INFO:
Logging kubelet events for node i-01238e73720e34636
Dec 31 06:45:12.949: INFO:
Logging pods the kubelet thinks is on node i-01238e73720e34636
Dec 31 06:45:12.990: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-fppmn started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:12.990: INFO: cilium-jtczt started at 2022-12-31 06:25:54 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:45:12.990: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:45:12.990: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-57rjk started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:12.990: INFO: ss-0 started at 2022-12-31 06:39:14 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container webserver ready: false, restart count 0
Dec 31 06:45:12.990: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-mb5bq started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:12.990: INFO: successful-jobs-history-limit-27874485-b8cn7 started at 2022-12-31 06:45:00 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container c ready: false, restart count 0
Dec 31 06:45:12.990: INFO: pfpod started at 2022-12-31 06:40:12 +0000 UTC (0+2 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container portforwardtester ready: false, restart count 0
Dec 31 06:45:12.990: INFO: Container readiness ready: false, restart count 0
Dec 31 06:45:12.990: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-tkxdw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:12.990: INFO: pod-configmaps-badfcfb9-559c-4caa-86d1-05cc6364b4c0 started at 2022-12-31 06:43:09 +0000 UTC (0+2 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:45:12.990: INFO: Container configmap-volume-binary-test ready: false, restart count 0
Dec 31 06:45:12.990: INFO: pod-projected-configmaps-3b9a60fb-628f-421f-a936-90869a15c4e5 started at 2022-12-31 06:44:14 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container agnhost-container ready: false, restart count 0
Dec 31 06:45:12.990: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-jp975 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:12.990: INFO: liveness-76925a35-eff7-4a2b-b7b3-43a02cc3460a started at 2022-12-31 06:45:10 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container agnhost-container ready: false, restart count 0
Dec 31 06:45:12.990: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-dbm42 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:12.990: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-t9sfw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:12.990: INFO: ss2-1 started at 2022-12-31 06:39:14 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container webserver ready: true, restart count 0
Dec 31 06:45:12.990: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xpfkc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:12.990: INFO: hostexec-i-01238e73720e34636-rgn7t started at 2022-12-31 06:45:11 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:45:12.990: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-t2p68 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:12.990: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-md99c started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:12.990: INFO: ebs-csi-node-5sskd started at 2022-12-31 06:25:54 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:45:12.990: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:45:12.990: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:45:12.990: INFO: pause-pod-8565ff866b-bzc82 started at 2022-12-31 06:40:17 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container agnhost-pause ready: false, restart count 0
Dec 31 06:45:12.990: INFO: sample-webhook-deployment-865554f4d9-6wlcq started at 2022-12-31 06:40:34 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:12.990: INFO: Container sample-webhook ready: false, restart count 0
Dec 31 06:45:13.223: INFO:
Latency metrics for node i-01238e73720e34636
Dec 31 06:45:13.223: INFO:
Logging node info for node i-02803f86e9c119889
Dec 31 06:45:13.255: INFO: Node Info: &Node{ObjectMeta:{i-02803f86e9c119889 4f26fd9b-7bc7-4f71-8b66-a761d4c63f01 32793 0 2022-12-31 06:25:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02803f86e9c119889 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-02803f86e9c119889 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.83 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5953":"i-02803f86e9c119889","ebs.csi.aws.com":"i-02803f86e9c119889"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:44:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-02803f86e9c119889,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.83,},NodeAddress{Type:ExternalIP,Address:3.96.199.254,},NodeAddress{Type:InternalDNS,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-199-254.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23319fa293bc90a121ffa207804bf8,SystemUUID:ec23319f-a293-bc90-a121-ffa207804bf8,BootID:443b01ac-cd9d-4547-9748-ec9c7edbc67a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-5953^93ecf6eb-88d6-11ed-aa52-6a9e5ddd1dab],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:45:13.256: INFO:
Logging kubelet events for node i-02803f86e9c119889
Dec 31 06:45:13.290: INFO:
Logging pods the kubelet thinks is on node i-02803f86e9c119889
Dec 31 06:45:13.330: INFO: ss2-0 started at 2022-12-31 06:39:28 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container webserver ready: false, restart count 0
Dec 31 06:45:13.330: INFO: coredns-autoscaler-7cb5c5b969-pt9s2 started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container autoscaler ready: true, restart count 0
Dec 31 06:45:13.330: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-hthc5 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.330: INFO: pod-subpath-test-inlinevolume-6nrg started at 2022-12-31 06:44:20 +0000 UTC (2+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Init container init-volume-inlinevolume-6nrg ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Init container test-init-volume-inlinevolume-6nrg ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container test-container-subpath-inlinevolume-6nrg ready: false, restart count 0
Dec 31 06:45:13.330: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-bhwsk started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.330: INFO: coredns-559769c974-r8xfg started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container coredns ready: true, restart count 0
Dec 31 06:45:13.330: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xjng7 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.330: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-dc2f2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.330: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9564 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.330: INFO: cilium-24dpj started at 2022-12-31 06:25:40 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:45:13.330: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:45:13.330: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wd9vv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.330: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-sqdwl started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.330: INFO: pvc-volume-tester-m8r85 started at 2022-12-31 06:44:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:45:13.330: INFO: ebs-csi-node-8hn4r started at 2022-12-31 06:25:40 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:45:13.330: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:45:13.330: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:45:13.330: INFO: csi-mockplugin-0 started at 2022-12-31 06:38:47 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:45:13.330: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:45:13.330: INFO: Container mock ready: true, restart count 0
Dec 31 06:45:13.330: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-j64b2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.330: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-nv2qw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0
Dec 31 06:45:13.330: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:19 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:45:13.330: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:38:48 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:45:13.330: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:55 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:45:13.330: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:45:13.330: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-vrzch started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.330: INFO: inline-volume-tester-2zpb4 started at 2022-12-31 06:44:56 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.330: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:45:13.558: INFO:
Latency metrics for node i-02803f86e9c119889
Dec 31 06:45:13.558: INFO:
Logging node info for node i-04ba2526d2f93fe75
Dec 31 06:45:13.590: INFO: Node Info: &Node{ObjectMeta:{i-04ba2526d2f93fe75 66716b11-28bf-41d8-82f8-881d9a36efb5 32815 0 2022-12-31 06:25:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04ba2526d2f93fe75 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04ba2526d2f93fe75 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.50.49 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-04ba2526d2f93fe75"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:44:28 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-31 06:44:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04ba2526d2f93fe75,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:33 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:33 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:33 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:44:33 +0000 UTC,LastTransitionTime:2022-12-31 06:26:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.50.49,},NodeAddress{Type:ExternalIP,Address:35.182.108.97,},NodeAddress{Type:InternalDNS,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-108-97.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bacfd4cdc1a7d3a3ee77d377f7e34,SystemUUID:ec2bacfd-4cdc-1a7d-3a3e-e77d377f7e34,BootID:c6b8143b-5a4c-4cc7-b066-49b954ceaace,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2 kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885,DevicePath:,},},Config:nil,},}
Dec 31 06:45:13.590: INFO:
Logging kubelet events for node i-04ba2526d2f93fe75
Dec 31 06:45:13.625: INFO:
Logging pods the kubelet thinks is on node i-04ba2526d2f93fe75
Dec 31 06:45:13.666: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:05 +0000 UTC (0+7 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:45:13.666: INFO: Container csi-provisioner ready: false, restart count 0
Dec 31 06:45:13.666: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:45:13.666: INFO: Container csi-snapshotter ready: false, restart count 0
Dec 31 06:45:13.666: INFO: Container hostpath ready: false, restart count 0
Dec 31 06:45:13.666: INFO: Container liveness-probe ready: false, restart count 0
Dec 31 06:45:13.666: INFO: Container node-driver-registrar ready: false, restart count 0
Dec 31 06:45:13.666: INFO: pod-init-93eb93f0-69fc-4167-985e-7ea4d5f2a587 started at 2022-12-31 06:45:09 +0000 UTC (2+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Init container init1 ready: false, restart count 0
Dec 31 06:45:13.666: INFO: Init container init2 ready: false, restart count 0
Dec 31 06:45:13.666: INFO: Container run1 ready: false, restart count 0
Dec 31 06:45:13.666: INFO: pause-pod-8565ff866b-d9r2q started at 2022-12-31 06:40:17 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container agnhost-pause ready: true, restart count 0
Dec 31 06:45:13.666: INFO: echo-sourceip started at 2022-12-31 06:39:47 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:45:13.666: INFO: cilium-jswjf started at 2022-12-31 06:25:53 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:45:13.666: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:45:13.666: INFO: sysctl-424a9654-f58d-4cbd-b17a-158e50d33d84 started at 2022-12-31 06:44:01 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container test-container ready: false, restart count 0
Dec 31 06:45:13.666: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-nq9pj started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.666: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kl6rx started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.666: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-24srg started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.666: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-rz4lh started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.666: INFO: inline-volume-tester-rg5s8 started at 2022-12-31 06:44:26 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:45:13.666: INFO: security-context-2d0c56eb-9c68-406b-bb3f-1e1dc43836fe started at 2022-12-31 06:40:53 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container test-container ready: false, restart count 0
Dec 31 06:45:13.666: INFO: hostexec-i-04ba2526d2f93fe75-zmqh5 started at 2022-12-31 06:44:07 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container agnhost-container ready: true, restart count 0
Dec 31 06:45:13.666: INFO: ebs-csi-node-rq4r2 started at 2022-12-31 06:25:53 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:45:13.666: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:45:13.666: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:45:13.666: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wgmwt started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.666: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-tr8ff started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.666: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9xgv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.666: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-swkmw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.666: INFO: inline-volume-tester-6zlk7 started at 2022-12-31 06:39:27 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container csi-volume-tester ready: false, restart count 0
Dec 31 06:45:13.666: INFO: ss2-2 started at 2022-12-31 06:39:10 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container webserver ready: true, restart count 0
Dec 31 06:45:13.666: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-j5hrc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:13.666: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kxjl4 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0
Dec 31 06:45:13.666: INFO: pod-subpath-test-preprovisionedpv-qpdg started at 2022-12-31 06:44:15 +0000 UTC (2+1 container statuses recorded)
Dec 31 06:45:13.666: INFO: Init container init-volume-preprovisionedpv-qpdg ready: false, restart count 0
Dec 31 06:45:13.666: INFO: Init container test-init-volume-preprovisionedpv-qpdg ready: false, restart count 0
Dec 31 06:45:13.666: INFO: Container test-container-subpath-preprovisionedpv-qpdg ready: false, restart count 0
Dec 31 06:45:13.877: INFO:
Latency metrics for node i-04ba2526d2f93fe75
Dec 31 06:45:13.877: INFO:
Logging node info for node i-0623d19705b93fa12
Dec 31 06:45:13.909: INFO: Node Info: &Node{ObjectMeta:{i-0623d19705b93fa12 42adab5d-2a9f-490b-8d96-b2134aee6d35 31659 0 2022-12-31 06:23:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0623d19705b93fa12 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.244 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0623d19705b93fa12"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-31 06:23:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-31 06:24:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:24:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-31 06:41:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0623d19705b93fa12,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:41:47 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:41:47 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:41:47 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:41:47 +0000 UTC,LastTransitionTime:2022-12-31 06:24:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.244,},NodeAddress{Type:ExternalIP,Address:3.96.201.212,},NodeAddress{Type:InternalDNS,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-201-212.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27d827c769aef19bbb1df3025ce86a,SystemUUID:ec27d827-c769-aef1-9bbb-1df3025ce86a,BootID:e238e24c-8167-4573-a762-5c346ea34877,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451628,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805582,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967330,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:45:13.909: INFO:
Logging kubelet events for node i-0623d19705b93fa12
Dec 31 06:45:13.943: INFO:
Logging pods the kubelet thinks is on node i-0623d19705b93fa12
Dec 31 06:45:13.981: INFO: cilium-5qps9 started at 2022-12-31 06:24:30 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:45:13.981: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:45:13.981: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:45:13.981: INFO: kops-controller-5j56z started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.981: INFO: Container kops-controller ready: true, restart count 0
Dec 31 06:45:13.981: INFO: ebs-csi-controller-89b649c94-wxqzv started at 2022-12-31 06:24:30 +0000 UTC (0+5 container statuses recorded)
Dec 31 06:45:13.981: INFO: Container csi-attacher ready: true, restart count 0
Dec 31 06:45:13.981: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:45:13.981: INFO: Container csi-resizer ready: true, restart count 0
Dec 31 06:45:13.981: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:45:13.981: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:45:13.981: INFO: kube-controller-manager-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.981: INFO: Container kube-controller-manager ready: true, restart count 2
Dec 31 06:45:13.981: INFO: kube-scheduler-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.981: INFO: Container kube-scheduler ready: true, restart count 0
Dec 31 06:45:13.981: INFO: kube-apiserver-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+2 container statuses recorded)
Dec 31 06:45:13.981: INFO: Container healthcheck ready: true, restart count 0
Dec 31 06:45:13.981: INFO: Container kube-apiserver ready: true, restart count 1
Dec 31 06:45:13.981: INFO: ebs-csi-node-pnmdn started at 2022-12-31 06:24:30 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:45:13.981: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:45:13.981: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:45:13.981: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:45:13.981: INFO: aws-cloud-controller-manager-68vsl started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.981: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Dec 31 06:45:13.981: INFO: cilium-operator-5dd44dc49f-gwnh5 started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.981: INFO: Container cilium-operator ready: true, restart count 0
Dec 31 06:45:13.981: INFO: dns-controller-69987775c6-989tg started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.981: INFO: Container dns-controller ready: true, restart count 0
Dec 31 06:45:13.981: INFO: etcd-manager-events-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.981: INFO: Container etcd-manager ready: true, restart count 0
Dec 31 06:45:13.981: INFO: etcd-manager-main-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:13.981: INFO: Container etcd-manager ready: true, restart count 0
Dec 31 06:45:14.239: INFO:
Latency metrics for node i-0623d19705b93fa12
Dec 31 06:45:14.239: INFO:
Logging node info for node i-07e0b1652877916dd
Dec 31 06:45:14.273: INFO: Node Info: &Node{ObjectMeta:{i-07e0b1652877916dd 503d2e8d-789d-4154-983b-d84a9e1f26d3 33128 0 2022-12-31 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07e0b1652877916dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-07e0b1652877916dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.32 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2668":"i-07e0b1652877916dd","csi-mock-csi-mock-volumes-3959":"i-07e0b1652877916dd","ebs.csi.aws.com":"i-07e0b1652877916dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:45:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-07e0b1652877916dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:53 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:53 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:53 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:44:53 +0000 UTC,LastTransitionTime:2022-12-31 06:26:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.32,},NodeAddress{Type:ExternalIP,Address:3.96.208.158,},NodeAddress{Type:InternalDNS,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-208-158.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23f46c8ef59d08a0747ddba3b48b3e,SystemUUID:ec23f46c-8ef5-9d08-a074-7ddba3b48b3e,BootID:7f531ed6-40f4-44aa-95ac-677cf2d148cb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-3959^a09d1446-88d6-11ed-9ca5-ce024c9251f3],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Dec 31 06:45:14.273: INFO:
Logging kubelet events for node i-07e0b1652877916dd
Dec 31 06:45:14.317: INFO:
Logging pods the kubelet thinks is on node i-07e0b1652877916dd
Dec 31 06:45:14.355: INFO: csi-mockplugin-0 started at 2022-12-31 06:44:25 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:45:14.355: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:45:14.355: INFO: Container mock ready: true, restart count 0
Dec 31 06:45:14.355: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-7tbwm started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:14.355: INFO: coredns-559769c974-tz7zd started at 2022-12-31 06:26:19 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container coredns ready: true, restart count 0
Dec 31 06:45:14.355: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:45:14.355: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-lcw6r started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:14.355: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wnd2m started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:14.355: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:44:25 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container csi-attacher ready: false, restart count 0
Dec 31 06:45:14.355: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-pswrk started at 2022-12-31 06:38:47 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:14.355: INFO: cilium-4xz2s started at 2022-12-31 06:25:52 +0000 UTC (1+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Init container clean-cilium-state ready: true, restart count 0
Dec 31 06:45:14.355: INFO: Container cilium-agent ready: true, restart count 0
Dec 31 06:45:14.355: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-zltlv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:14.355: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xxrt2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:14.355: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-s49xp started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:14.355: INFO: pvc-volume-tester-9hhmr started at 2022-12-31 06:44:51 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container volume-tester ready: false, restart count 0
Dec 31 06:45:14.355: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-5d4zx started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0
Dec 31 06:45:14.355: INFO: ebs-csi-node-sgtqp started at 2022-12-31 06:25:52 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container ebs-plugin ready: true, restart count 0
Dec 31 06:45:14.355: INFO: Container liveness-probe ready: true, restart count 0
Dec 31 06:45:14.355: INFO: Container node-driver-registrar ready: true, restart count 0
Dec 31 06:45:14.355: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-6plfw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:14.355: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-bzltr started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0
Dec 31 06:45:14.355: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container csi-resizer ready: false, restart count 0
Dec 31 06:45:14.355: INFO: csi-mockplugin-0 started at 2022-12-31 06:39:09 +0000 UTC (0+3 container statuses recorded)
Dec 31 06:45:14.355: INFO: Container csi-provisioner ready: true, restart count 0
Dec 31 06:45:14.355: INFO: Container driver-registrar ready: true, restart count 0
Dec 31 06:45:14.355: INFO: Container mock ready: true, restart count 0
Dec 31 06:45:14.566: INFO:
Latency metrics for node i-07e0b1652877916dd
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "port-forwarding-6649" for this suite. �[38;5;243m12/31/22 06:45:14.567�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\sreturn\scommand\sexit\scodes\srunning\sa\ssuccessful\scommand$'
test/e2e/kubectl/kubectl.go:415 k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.1() test/e2e/kubectl/kubectl.go:415 +0x245
[BeforeEach] [sig-cli] Kubectl client set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m12/31/22 06:40:08.641�[0m Dec 31 06:40:08.641: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m12/31/22 06:40:08.642�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m12/31/22 06:40:08.737�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m12/31/22 06:40:08.798�[0m [BeforeEach] [sig-cli] Kubectl client test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-cli] Kubectl client test/e2e/kubectl/kubectl.go:274 [BeforeEach] Simple pod test/e2e/kubectl/kubectl.go:411 �[1mSTEP:�[0m creating the pod from �[38;5;243m12/31/22 06:40:08.861�[0m Dec 31 06:40:08.861: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3740 create -f -' Dec 31 06:40:09.828: INFO: stderr: "" Dec 31 06:40:09.828: INFO: stdout: "pod/httpd created\n" Dec 31 06:40:09.828: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd] Dec 31 06:40:09.828: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-3740" to be "running and ready" Dec 31 06:40:09.859: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 31.017747ms Dec 31 06:40:09.859: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:11.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063305679s Dec 31 06:40:11.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:13.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.063134895s Dec 31 06:40:13.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:15.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.063327118s Dec 31 06:40:15.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:17.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.063731296s Dec 31 06:40:17.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:19.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.062552523s Dec 31 06:40:19.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:21.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.063189995s Dec 31 06:40:21.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:23.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.063192012s Dec 31 06:40:23.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:25.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.063130227s Dec 31 06:40:25.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:27.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 18.062897211s Dec 31 06:40:27.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:29.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 20.062913271s Dec 31 06:40:29.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:31.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 22.063349419s Dec 31 06:40:31.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:33.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 24.063243707s Dec 31 06:40:33.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:35.890: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 26.062445664s Dec 31 06:40:35.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:37.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 28.063601814s Dec 31 06:40:37.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:39.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 30.062574278s Dec 31 06:40:39.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:41.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 32.063026029s Dec 31 06:40:41.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:43.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 34.063166951s Dec 31 06:40:43.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:45.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 36.063146013s Dec 31 06:40:45.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:47.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 38.063146411s Dec 31 06:40:47.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:49.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 40.062912191s Dec 31 06:40:49.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:51.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 42.06381847s Dec 31 06:40:51.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:53.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 44.06329937s Dec 31 06:40:53.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:55.890: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 46.062329317s Dec 31 06:40:55.890: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:57.890: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 48.062388756s Dec 31 06:40:57.890: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:40:59.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 50.062888158s Dec 31 06:40:59.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:01.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 52.062950726s Dec 31 06:41:01.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:03.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 54.063534565s Dec 31 06:41:03.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:05.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 56.06306222s Dec 31 06:41:05.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:07.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 58.063075939s Dec 31 06:41:07.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:09.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.062581705s Dec 31 06:41:09.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:11.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.06264741s Dec 31 06:41:11.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:13.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.062673089s Dec 31 06:41:13.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:15.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.063019334s Dec 31 06:41:15.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:17.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.063340803s Dec 31 06:41:17.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:19.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.063582021s Dec 31 06:41:19.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:21.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.063737184s Dec 31 06:41:21.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:23.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.063354271s Dec 31 06:41:23.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:25.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.063222642s Dec 31 06:41:25.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:27.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.063514138s Dec 31 06:41:27.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:29.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.062930232s Dec 31 06:41:29.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:31.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.063163087s Dec 31 06:41:31.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:33.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.062962299s Dec 31 06:41:33.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:35.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.063054232s Dec 31 06:41:35.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:37.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.063066332s Dec 31 06:41:37.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:39.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.06295944s Dec 31 06:41:39.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:41.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.062908766s Dec 31 06:41:41.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:43.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.062714189s Dec 31 06:41:43.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:45.890: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.062430873s Dec 31 06:41:45.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:47.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.062879742s Dec 31 06:41:47.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:49.890: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.062328262s Dec 31 06:41:49.890: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:51.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.063416885s Dec 31 06:41:51.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:53.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.063618205s Dec 31 06:41:53.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:55.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.062813081s Dec 31 06:41:55.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:57.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.062822314s Dec 31 06:41:57.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:41:59.890: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.062395744s Dec 31 06:41:59.890: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:01.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.06293971s Dec 31 06:42:01.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:03.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.063449527s Dec 31 06:42:03.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:05.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.062717311s Dec 31 06:42:05.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:07.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.063390671s Dec 31 06:42:07.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:09.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.06327222s Dec 31 06:42:09.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:11.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.063179557s Dec 31 06:42:11.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:13.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.063192693s Dec 31 06:42:13.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:15.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.062847931s Dec 31 06:42:15.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:17.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.06300023s Dec 31 06:42:17.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:19.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.062740753s Dec 31 06:42:19.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:21.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.062640264s Dec 31 06:42:21.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:23.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.063469658s Dec 31 06:42:23.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:25.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.062905357s Dec 31 06:42:25.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:27.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.062974819s Dec 31 06:42:27.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:29.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.063301115s Dec 31 06:42:29.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:31.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.063265122s Dec 31 06:42:31.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:33.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.0629819s Dec 31 06:42:33.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:35.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.062890909s Dec 31 06:42:35.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:37.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.063258871s Dec 31 06:42:37.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:39.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.062874021s Dec 31 06:42:39.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:41.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.062972275s Dec 31 06:42:41.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:43.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.063331837s Dec 31 06:42:43.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:45.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.062865677s Dec 31 06:42:45.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:47.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.063116035s Dec 31 06:42:47.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:49.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.062618233s Dec 31 06:42:49.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:51.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.063215354s Dec 31 06:42:51.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:53.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.062651692s Dec 31 06:42:53.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:55.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.063120762s Dec 31 06:42:55.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:57.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.063231078s Dec 31 06:42:57.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:42:59.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.062669382s Dec 31 06:42:59.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:01.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.063099825s Dec 31 06:43:01.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:03.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.063308347s Dec 31 06:43:03.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:05.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.062460616s Dec 31 06:43:05.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:07.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.06269412s Dec 31 06:43:07.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:09.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.063122539s Dec 31 06:43:09.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:11.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.063354092s Dec 31 06:43:11.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:13.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.063335738s Dec 31 06:43:13.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:15.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.063021661s Dec 31 06:43:15.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:17.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.062924548s Dec 31 06:43:17.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:19.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.062472551s Dec 31 06:43:19.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:21.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.063171543s Dec 31 06:43:21.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:23.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.063190347s Dec 31 06:43:23.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:25.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.063077812s Dec 31 06:43:25.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:27.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.06374102s Dec 31 06:43:27.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:29.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.06362377s Dec 31 06:43:29.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:31.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.062570552s Dec 31 06:43:31.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:33.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.062762522s Dec 31 06:43:33.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:35.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.063095416s Dec 31 06:43:35.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:37.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.063170824s Dec 31 06:43:37.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:39.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.062898082s Dec 31 06:43:39.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:41.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.063182846s Dec 31 06:43:41.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:43.893: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.064947915s Dec 31 06:43:43.893: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:45.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.062945588s Dec 31 06:43:45.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:47.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.063163666s Dec 31 06:43:47.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:49.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.062490626s Dec 31 06:43:49.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:51.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.063198192s Dec 31 06:43:51.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:53.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.063376011s Dec 31 06:43:53.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:55.940: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.111764574s Dec 31 06:43:55.940: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:57.890: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.062355315s Dec 31 06:43:57.890: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:43:59.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.063418616s Dec 31 06:43:59.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:01.897: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.068734272s Dec 31 06:44:01.897: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:03.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.063359142s Dec 31 06:44:03.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:05.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.062749013s Dec 31 06:44:05.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:07.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.063528058s Dec 31 06:44:07.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:09.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.063197176s Dec 31 06:44:09.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:11.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.064392744s Dec 31 06:44:11.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:13.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.062758445s Dec 31 06:44:13.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:15.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.064310663s Dec 31 06:44:15.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:17.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.062547573s Dec 31 06:44:17.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:19.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.063759002s Dec 31 06:44:19.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:21.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.062501275s Dec 31 06:44:21.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:23.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.062873228s Dec 31 06:44:23.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:25.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.063146616s Dec 31 06:44:25.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:27.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.06295091s Dec 31 06:44:27.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:29.890: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.062384635s Dec 31 06:44:29.890: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:31.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.063366232s Dec 31 06:44:31.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:33.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.062883169s Dec 31 06:44:33.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:35.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.062911926s Dec 31 06:44:35.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:37.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.063038199s Dec 31 06:44:37.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:39.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.063612906s Dec 31 06:44:39.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:41.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.063250503s Dec 31 06:44:41.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:43.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.063074982s Dec 31 06:44:43.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:45.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.062938123s Dec 31 06:44:45.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:47.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.063140959s Dec 31 06:44:47.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:49.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.063055321s Dec 31 06:44:49.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:51.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.063263795s Dec 31 06:44:51.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:53.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.06371399s Dec 31 06:44:53.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:55.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.063042088s Dec 31 06:44:55.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:57.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.063423196s Dec 31 06:44:57.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:44:59.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.063013883s Dec 31 06:44:59.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:45:01.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.063129194s Dec 31 06:45:01.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:45:03.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.063457512s Dec 31 06:45:03.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:45:05.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.063313097s Dec 31 06:45:05.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:45:07.892: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.063642128s Dec 31 06:45:07.892: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:45:09.891: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.06340181s Dec 31 06:45:09.891: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:45:09.923: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.09453804s Dec 31 06:45:09.923: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01238e73720e34636' to be 'Running' but was 'Pending' Dec 31 06:45:09.923: INFO: Pod httpd failed to be running and ready. Dec 31 06:45:09.923: INFO: Wanted all 1 pods to be running and ready. Result: false. Pods: [httpd] Dec 31 06:45:09.923: FAIL: Expected <bool>: false to equal <bool>: true Full Stack Trace k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.1() test/e2e/kubectl/kubectl.go:415 +0x245 [AfterEach] Simple pod test/e2e/kubectl/kubectl.go:417 �[1mSTEP:�[0m using delete to clean up resources �[38;5;243m12/31/22 06:45:09.923�[0m Dec 31 06:45:09.923: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3740 delete --grace-period=0 --force -f -' Dec 31 06:45:10.311: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Dec 31 06:45:10.312: INFO: stdout: "pod \"httpd\" force deleted\n" Dec 31 06:45:10.312: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3740 get rc,svc -l name=httpd --no-headers' Dec 31 06:45:10.700: INFO: stderr: "No resources found in kubectl-3740 namespace.\n" Dec 31 06:45:10.700: INFO: stdout: "" Dec 31 06:45:10.700: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1724193d-88d3-11ed-b47a-e2b55b2f9198/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3740 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Dec 31 06:45:11.025: INFO: stderr: "" Dec 31 06:45:11.025: INFO: stdout: "" [AfterEach] [sig-cli] Kubectl client test/e2e/framework/node/init/init.go:32 Dec 31 06:45:11.025: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-cli] Kubectl client test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-cli] Kubectl client dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m12/31/22 06:45:11.057�[0m �[1mSTEP:�[0m Collecting events from namespace "kubectl-3740". �[38;5;243m12/31/22 06:45:11.057�[0m �[1mSTEP:�[0m Found 11 events. �[38;5;243m12/31/22 06:45:11.088�[0m Dec 31 06:45:11.088: INFO: At 2022-12-31 06:40:09 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-3740/httpd to i-01238e73720e34636 Dec 31 06:45:11.089: INFO: At 2022-12-31 06:40:10 +0000 UTC - event for httpd: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c71f476527e416ee9a86964e43868bb8c1e6d348682253a739274a571ee6c3c4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:45:11.089: INFO: At 2022-12-31 06:40:23 +0000 UTC - event for httpd: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "44be0141e94050dcaf723143efec3efde0f8fe8d89b81f6a03cd95d61607ccd8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:45:11.089: INFO: At 2022-12-31 06:40:34 +0000 UTC - event for httpd: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "930249f637eee6b1ef1ecc830bd748294ec0706177ff2507d4aace322872bbe5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:45:11.089: INFO: At 2022-12-31 06:40:49 +0000 UTC - event for httpd: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "59f1fdbf944e7455f2b6e44061338d9b4cc4a11c037048da0132f85b16e3df28": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:45:11.089: INFO: At 2022-12-31 06:41:00 +0000 UTC - event for httpd: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bf3c8616468785e6e090e495692378605b1ef3fb226fa9a318f373d50ba9b8d7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:45:11.089: INFO: At 2022-12-31 06:41:15 +0000 UTC - event for httpd: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "44b9f0a587d45a889951fee265e0265a5a9dafed5f94d273d14e802347f3ad9f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:45:11.089: INFO: At 2022-12-31 06:41:28 +0000 UTC - event for httpd: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ba24ee744a113fa6f241822acf7152e3aed89e1eef503ed5dc5a3a5eba0b18b1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:45:11.089: INFO: At 2022-12-31 06:41:41 +0000 UTC - event for httpd: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ac24f00592dc0624cfa16e39e5bb387c469c150575041f67d30fc56eb84e6b0f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:45:11.089: INFO: At 2022-12-31 06:41:52 +0000 UTC - event for httpd: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "83e3df485896e03dd05a7b5550a0c4844034917815a94264d86ba9e4716270de": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:45:11.089: INFO: At 2022-12-31 06:42:05 +0000 UTC - event for httpd: {kubelet i-01238e73720e34636} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e7ab0c1eadf5a680c52db9841b89f15c845bf4c8afd41936db0f965c86a809be": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Dec 31 06:45:11.120: INFO: POD NODE PHASE GRACE CONDITIONS Dec 31 06:45:11.120: INFO: Dec 31 06:45:11.152: INFO: Logging node info for node i-01238e73720e34636 Dec 31 06:45:11.183: INFO: Node Info: &Node{ObjectMeta:{i-01238e73720e34636 6336cf01-1d9c-435d-8598-300dc5c8cd47 32820 0 2022-12-31 06:25:53 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01238e73720e34636 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01238e73720e34636 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.17 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01238e73720e34636"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:53 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:44:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01238e73720e34636,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:34 +0000 UTC,LastTransitionTime:2022-12-31 06:25:53 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:44:34 +0000 UTC,LastTransitionTime:2022-12-31 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.17,},NodeAddress{Type:ExternalIP,Address:3.96.140.88,},NodeAddress{Type:InternalDNS,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01238e73720e34636.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-140-88.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec25b18c944e5e0e896bb3ef13f5e91a,SystemUUID:ec25b18c-944e-5e0e-896b-b3ef13f5e91a,BootID:429656db-871c-45f8-90c8-d6173d395019,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 31 06:45:11.183: INFO: Logging kubelet events for node i-01238e73720e34636 Dec 31 06:45:11.217: INFO: Logging pods the kubelet thinks is on node i-01238e73720e34636 Dec 31 06:45:11.255: INFO: successful-jobs-history-limit-27874485-b8cn7 started at 2022-12-31 06:45:00 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container c ready: false, restart count 0 Dec 31 06:45:11.255: INFO: pfpod started at 2022-12-31 06:40:12 +0000 UTC (0+2 container statuses recorded) Dec 31 06:45:11.255: INFO: Container portforwardtester ready: false, restart count 0 Dec 31 06:45:11.255: INFO: Container readiness ready: false, restart count 0 Dec 31 06:45:11.255: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-tkxdw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.255: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-mb5bq started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.255: INFO: pod-configmaps-badfcfb9-559c-4caa-86d1-05cc6364b4c0 started at 2022-12-31 06:43:09 +0000 UTC (0+2 container statuses recorded) Dec 31 06:45:11.255: INFO: Container agnhost-container ready: true, restart count 0 Dec 31 06:45:11.255: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Dec 31 06:45:11.255: INFO: pod-projected-configmaps-3b9a60fb-628f-421f-a936-90869a15c4e5 started at 2022-12-31 06:44:14 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container agnhost-container ready: false, restart count 0 Dec 31 06:45:11.255: INFO: liveness-76925a35-eff7-4a2b-b7b3-43a02cc3460a started at 2022-12-31 06:45:10 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container agnhost-container ready: false, restart count 0 Dec 31 06:45:11.255: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-jp975 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.255: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-t9sfw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.255: INFO: ss2-1 started at 2022-12-31 06:39:14 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container webserver ready: true, restart count 0 Dec 31 06:45:11.255: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-dbm42 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.255: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xpfkc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.255: INFO: ebs-csi-node-5sskd started at 2022-12-31 06:25:54 +0000 UTC (0+3 container statuses recorded) Dec 31 06:45:11.255: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:45:11.255: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:45:11.255: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 31 06:45:11.255: INFO: pause-pod-8565ff866b-bzc82 started at 2022-12-31 06:40:17 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container agnhost-pause ready: false, restart count 0 Dec 31 06:45:11.255: INFO: sample-webhook-deployment-865554f4d9-6wlcq started at 2022-12-31 06:40:34 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container sample-webhook ready: false, restart count 0 Dec 31 06:45:11.255: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-t2p68 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.255: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-md99c started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.255: INFO: cilium-jtczt started at 2022-12-31 06:25:54 +0000 UTC (1+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 31 06:45:11.255: INFO: Container cilium-agent ready: true, restart count 0 Dec 31 06:45:11.255: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-57rjk started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.255: INFO: ss-0 started at 2022-12-31 06:39:14 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container webserver ready: false, restart count 0 Dec 31 06:45:11.255: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-fppmn started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.255: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.476: INFO: Latency metrics for node i-01238e73720e34636 Dec 31 06:45:11.476: INFO: Logging node info for node i-02803f86e9c119889 Dec 31 06:45:11.508: INFO: Node Info: &Node{ObjectMeta:{i-02803f86e9c119889 4f26fd9b-7bc7-4f71-8b66-a761d4c63f01 32793 0 2022-12-31 06:25:39 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02803f86e9c119889 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-02803f86e9c119889 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.83 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-5953":"i-02803f86e9c119889","ebs.csi.aws.com":"i-02803f86e9c119889"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2022-12-31 06:25:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:44:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-02803f86e9c119889,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:39 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:44:30 +0000 UTC,LastTransitionTime:2022-12-31 06:25:54 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.83,},NodeAddress{Type:ExternalIP,Address:3.96.199.254,},NodeAddress{Type:InternalDNS,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-02803f86e9c119889.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-199-254.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23319fa293bc90a121ffa207804bf8,SystemUUID:ec23319f-a293-bc90-a121-ffa207804bf8,BootID:443b01ac-cd9d-4547-9748-ec9c7edbc67a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-5953^93ecf6eb-88d6-11ed-aa52-6a9e5ddd1dab],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 31 06:45:11.509: INFO: Logging kubelet events for node i-02803f86e9c119889 Dec 31 06:45:11.542: INFO: Logging pods the kubelet thinks is on node i-02803f86e9c119889 Dec 31 06:45:11.582: INFO: ss2-0 started at 2022-12-31 06:39:28 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container webserver ready: false, restart count 0 Dec 31 06:45:11.582: INFO: coredns-autoscaler-7cb5c5b969-pt9s2 started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container autoscaler ready: true, restart count 0 Dec 31 06:45:11.582: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-hthc5 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.582: INFO: pod-subpath-test-inlinevolume-6nrg started at 2022-12-31 06:44:20 +0000 UTC (2+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Init container init-volume-inlinevolume-6nrg ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Init container test-init-volume-inlinevolume-6nrg ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container test-container-subpath-inlinevolume-6nrg ready: false, restart count 0 Dec 31 06:45:11.582: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-bhwsk started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.582: INFO: coredns-559769c974-r8xfg started at 2022-12-31 06:25:54 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container coredns ready: true, restart count 0 Dec 31 06:45:11.582: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-xjng7 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.582: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-dc2f2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.582: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9564 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.582: INFO: cilium-24dpj started at 2022-12-31 06:25:40 +0000 UTC (1+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 31 06:45:11.582: INFO: Container cilium-agent ready: true, restart count 0 Dec 31 06:45:11.582: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wd9vv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.582: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-sqdwl started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.582: INFO: pvc-volume-tester-m8r85 started at 2022-12-31 06:44:30 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container volume-tester ready: false, restart count 0 Dec 31 06:45:11.582: INFO: ebs-csi-node-8hn4r started at 2022-12-31 06:25:40 +0000 UTC (0+3 container statuses recorded) Dec 31 06:45:11.582: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:45:11.582: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:45:11.582: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 31 06:45:11.582: INFO: csi-mockplugin-0 started at 2022-12-31 06:38:47 +0000 UTC (0+3 container statuses recorded) Dec 31 06:45:11.582: INFO: Container csi-provisioner ready: true, restart count 0 Dec 31 06:45:11.582: INFO: Container driver-registrar ready: true, restart count 0 Dec 31 06:45:11.582: INFO: Container mock ready: true, restart count 0 Dec 31 06:45:11.582: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-j64b2 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.582: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-nv2qw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0 Dec 31 06:45:11.582: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:19 +0000 UTC (0+7 container statuses recorded) Dec 31 06:45:11.582: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container csi-provisioner ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container csi-resizer ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container csi-snapshotter ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container hostpath ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container liveness-probe ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container node-driver-registrar ready: false, restart count 0 Dec 31 06:45:11.582: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:38:48 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:45:11.582: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:55 +0000 UTC (0+7 container statuses recorded) Dec 31 06:45:11.582: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container csi-provisioner ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container csi-resizer ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container csi-snapshotter ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container hostpath ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container liveness-probe ready: false, restart count 0 Dec 31 06:45:11.582: INFO: Container node-driver-registrar ready: false, restart count 0 Dec 31 06:45:11.582: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-vrzch started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.582: INFO: inline-volume-tester-2zpb4 started at 2022-12-31 06:44:56 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.582: INFO: Container csi-volume-tester ready: false, restart count 0 Dec 31 06:45:11.813: INFO: Latency metrics for node i-02803f86e9c119889 Dec 31 06:45:11.813: INFO: Logging node info for node i-04ba2526d2f93fe75 Dec 31 06:45:11.845: INFO: Node Info: &Node{ObjectMeta:{i-04ba2526d2f93fe75 66716b11-28bf-41d8-82f8-881d9a36efb5 32815 0 2022-12-31 06:25:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04ba2526d2f93fe75 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04ba2526d2f93fe75 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.50.49 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-04ba2526d2f93fe75"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:44:28 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2022-12-31 06:44:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04ba2526d2f93fe75,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:33 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:33 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:33 +0000 UTC,LastTransitionTime:2022-12-31 06:25:52 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:44:33 +0000 UTC,LastTransitionTime:2022-12-31 06:26:09 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.50.49,},NodeAddress{Type:ExternalIP,Address:35.182.108.97,},NodeAddress{Type:InternalDNS,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04ba2526d2f93fe75.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-108-97.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2bacfd4cdc1a7d3a3ee77d377f7e34,SystemUUID:ec2bacfd-4cdc-1a7d-3a3e-e77d377f7e34,BootID:c6b8143b-5a4c-4cc7-b066-49b954ceaace,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2 kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06fba136ea1be66b2,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c1d242d5cd53a885,DevicePath:,},},Config:nil,},} Dec 31 06:45:11.845: INFO: Logging kubelet events for node i-04ba2526d2f93fe75 Dec 31 06:45:11.879: INFO: Logging pods the kubelet thinks is on node i-04ba2526d2f93fe75 Dec 31 06:45:11.918: INFO: inline-volume-tester-6zlk7 started at 2022-12-31 06:39:27 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container csi-volume-tester ready: false, restart count 0 Dec 31 06:45:11.918: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-swkmw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.918: INFO: ss2-2 started at 2022-12-31 06:39:10 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container webserver ready: true, restart count 0 Dec 31 06:45:11.918: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-j5hrc started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.918: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kxjl4 started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0 Dec 31 06:45:11.918: INFO: pod-subpath-test-preprovisionedpv-qpdg started at 2022-12-31 06:44:15 +0000 UTC (2+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Init container init-volume-preprovisionedpv-qpdg ready: false, restart count 0 Dec 31 06:45:11.918: INFO: Init container test-init-volume-preprovisionedpv-qpdg ready: false, restart count 0 Dec 31 06:45:11.918: INFO: Container test-container-subpath-preprovisionedpv-qpdg ready: false, restart count 0 Dec 31 06:45:11.918: INFO: csi-hostpathplugin-0 started at 2022-12-31 06:44:05 +0000 UTC (0+7 container statuses recorded) Dec 31 06:45:11.918: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:45:11.918: INFO: Container csi-provisioner ready: false, restart count 0 Dec 31 06:45:11.918: INFO: Container csi-resizer ready: false, restart count 0 Dec 31 06:45:11.918: INFO: Container csi-snapshotter ready: false, restart count 0 Dec 31 06:45:11.918: INFO: Container hostpath ready: false, restart count 0 Dec 31 06:45:11.918: INFO: Container liveness-probe ready: false, restart count 0 Dec 31 06:45:11.918: INFO: Container node-driver-registrar ready: false, restart count 0 Dec 31 06:45:11.918: INFO: sysctl-424a9654-f58d-4cbd-b17a-158e50d33d84 started at 2022-12-31 06:44:01 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container test-container ready: false, restart count 0 Dec 31 06:45:11.918: INFO: pod-init-93eb93f0-69fc-4167-985e-7ea4d5f2a587 started at 2022-12-31 06:45:09 +0000 UTC (2+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Init container init1 ready: false, restart count 0 Dec 31 06:45:11.918: INFO: Init container init2 ready: false, restart count 0 Dec 31 06:45:11.918: INFO: Container run1 ready: false, restart count 0 Dec 31 06:45:11.918: INFO: pause-pod-8565ff866b-d9r2q started at 2022-12-31 06:40:17 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container agnhost-pause ready: true, restart count 0 Dec 31 06:45:11.918: INFO: echo-sourceip started at 2022-12-31 06:39:47 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container agnhost-container ready: true, restart count 0 Dec 31 06:45:11.918: INFO: cilium-jswjf started at 2022-12-31 06:25:53 +0000 UTC (1+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 31 06:45:11.918: INFO: Container cilium-agent ready: true, restart count 0 Dec 31 06:45:11.918: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-24srg started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.918: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-nq9pj started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.918: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-kl6rx started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.918: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-wgmwt started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.918: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-rz4lh started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.918: INFO: inline-volume-tester-rg5s8 started at 2022-12-31 06:44:26 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container csi-volume-tester ready: false, restart count 0 Dec 31 06:45:11.918: INFO: security-context-2d0c56eb-9c68-406b-bb3f-1e1dc43836fe started at 2022-12-31 06:40:53 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container test-container ready: false, restart count 0 Dec 31 06:45:11.918: INFO: hostexec-i-04ba2526d2f93fe75-zmqh5 started at 2022-12-31 06:44:07 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container agnhost-container ready: true, restart count 0 Dec 31 06:45:11.918: INFO: ebs-csi-node-rq4r2 started at 2022-12-31 06:25:53 +0000 UTC (0+3 container statuses recorded) Dec 31 06:45:11.918: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:45:11.918: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:45:11.918: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 31 06:45:11.918: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-tr8ff started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:11.918: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-h9xgv started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:11.918: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:12.120: INFO: Latency metrics for node i-04ba2526d2f93fe75 Dec 31 06:45:12.120: INFO: Logging node info for node i-0623d19705b93fa12 Dec 31 06:45:12.151: INFO: Node Info: &Node{ObjectMeta:{i-0623d19705b93fa12 42adab5d-2a9f-490b-8d96-b2134aee6d35 31659 0 2022-12-31 06:23:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0623d19705b93fa12 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.51.244 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0623d19705b93fa12"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2022-12-31 06:23:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2022-12-31 06:24:23 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:24:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:24:43 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2022-12-31 06:41:47 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0623d19705b93fa12,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:41:47 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:41:47 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:41:47 +0000 UTC,LastTransitionTime:2022-12-31 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:41:47 +0000 UTC,LastTransitionTime:2022-12-31 06:24:42 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.51.244,},NodeAddress{Type:ExternalIP,Address:3.96.201.212,},NodeAddress{Type:InternalDNS,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0623d19705b93fa12.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-201-212.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27d827c769aef19bbb1df3025ce86a,SystemUUID:ec27d827-c769-aef1-9bbb-1df3025ce86a,BootID:e238e24c-8167-4573-a762-5c346ea34877,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451628,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805582,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967330,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 31 06:45:12.152: INFO: Logging kubelet events for node i-0623d19705b93fa12 Dec 31 06:45:12.185: INFO: Logging pods the kubelet thinks is on node i-0623d19705b93fa12 Dec 31 06:45:12.223: INFO: kube-controller-manager-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.223: INFO: Container kube-controller-manager ready: true, restart count 2 Dec 31 06:45:12.223: INFO: kube-scheduler-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.223: INFO: Container kube-scheduler ready: true, restart count 0 Dec 31 06:45:12.223: INFO: cilium-5qps9 started at 2022-12-31 06:24:30 +0000 UTC (1+1 container statuses recorded) Dec 31 06:45:12.223: INFO: Init container clean-cilium-state ready: true, restart count 0 Dec 31 06:45:12.223: INFO: Container cilium-agent ready: true, restart count 0 Dec 31 06:45:12.223: INFO: kops-controller-5j56z started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.223: INFO: Container kops-controller ready: true, restart count 0 Dec 31 06:45:12.223: INFO: ebs-csi-controller-89b649c94-wxqzv started at 2022-12-31 06:24:30 +0000 UTC (0+5 container statuses recorded) Dec 31 06:45:12.223: INFO: Container csi-attacher ready: true, restart count 0 Dec 31 06:45:12.223: INFO: Container csi-provisioner ready: true, restart count 0 Dec 31 06:45:12.223: INFO: Container csi-resizer ready: true, restart count 0 Dec 31 06:45:12.223: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:45:12.223: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:45:12.223: INFO: etcd-manager-events-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.223: INFO: Container etcd-manager ready: true, restart count 0 Dec 31 06:45:12.223: INFO: etcd-manager-main-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.223: INFO: Container etcd-manager ready: true, restart count 0 Dec 31 06:45:12.223: INFO: kube-apiserver-i-0623d19705b93fa12 started at 2022-12-31 06:23:21 +0000 UTC (0+2 container statuses recorded) Dec 31 06:45:12.223: INFO: Container healthcheck ready: true, restart count 0 Dec 31 06:45:12.223: INFO: Container kube-apiserver ready: true, restart count 1 Dec 31 06:45:12.223: INFO: ebs-csi-node-pnmdn started at 2022-12-31 06:24:30 +0000 UTC (0+3 container statuses recorded) Dec 31 06:45:12.223: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:45:12.223: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:45:12.223: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 31 06:45:12.223: INFO: aws-cloud-controller-manager-68vsl started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.223: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Dec 31 06:45:12.223: INFO: cilium-operator-5dd44dc49f-gwnh5 started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.223: INFO: Container cilium-operator ready: true, restart count 0 Dec 31 06:45:12.223: INFO: dns-controller-69987775c6-989tg started at 2022-12-31 06:24:30 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.223: INFO: Container dns-controller ready: true, restart count 0 Dec 31 06:45:12.384: INFO: Latency metrics for node i-0623d19705b93fa12 Dec 31 06:45:12.384: INFO: Logging node info for node i-07e0b1652877916dd Dec 31 06:45:12.415: INFO: Node Info: &Node{ObjectMeta:{i-07e0b1652877916dd 503d2e8d-789d-4154-983b-d84a9e1f26d3 33128 0 2022-12-31 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07e0b1652877916dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-07e0b1652877916dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.32 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2668":"i-07e0b1652877916dd","csi-mock-csi-mock-volumes-3959":"i-07e0b1652877916dd","ebs.csi.aws.com":"i-07e0b1652877916dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2022-12-31 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2022-12-31 06:38:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2022-12-31 06:45:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-07e0b1652877916dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:53 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:53 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2022-12-31 06:44:53 +0000 UTC,LastTransitionTime:2022-12-31 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2022-12-31 06:44:53 +0000 UTC,LastTransitionTime:2022-12-31 06:26:04 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.32,},NodeAddress{Type:ExternalIP,Address:3.96.208.158,},NodeAddress{Type:InternalDNS,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07e0b1652877916dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-96-208-158.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23f46c8ef59d08a0747ddba3b48b3e,SystemUUID:ec23f46c-8ef5-9d08-a074-7ddba3b48b3e,BootID:7f531ed6-40f4-44aa-95ac-677cf2d148cb,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-3959^a09d1446-88d6-11ed-9ca5-ce024c9251f3],VolumesAttached:[]AttachedVolume{},Config:nil,},} Dec 31 06:45:12.415: INFO: Logging kubelet events for node i-07e0b1652877916dd Dec 31 06:45:12.449: INFO: Logging pods the kubelet thinks is on node i-07e0b1652877916dd Dec 31 06:45:12.488: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-5d4zx started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.488: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: false, restart count 0 Dec 31 06:45:12.488: INFO: ebs-csi-node-sgtqp started at 2022-12-31 06:25:52 +0000 UTC (0+3 container statuses recorded) Dec 31 06:45:12.488: INFO: Container ebs-plugin ready: true, restart count 0 Dec 31 06:45:12.488: INFO: Container liveness-probe ready: true, restart count 0 Dec 31 06:45:12.488: INFO: Container node-driver-registrar ready: true, restart count 0 Dec 31 06:45:12.488: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-6plfw started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.488: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:12.488: INFO: pvc-volume-tester-9hhmr started at 2022-12-31 06:44:51 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.488: INFO: Container volume-tester ready: false, restart count 0 Dec 31 06:45:12.488: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-bzltr started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.488: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:12.488: INFO: csi-mockplugin-resizer-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.488: INFO: Container csi-resizer ready: false, restart count 0 Dec 31 06:45:12.488: INFO: csi-mockplugin-0 started at 2022-12-31 06:39:09 +0000 UTC (0+3 container statuses recorded) Dec 31 06:45:12.488: INFO: Container csi-provisioner ready: true, restart count 0 Dec 31 06:45:12.488: INFO: Container driver-registrar ready: true, restart count 0 Dec 31 06:45:12.488: INFO: Container mock ready: true, restart count 0 Dec 31 06:45:12.488: INFO: csi-mockplugin-0 started at 2022-12-31 06:44:25 +0000 UTC (0+3 container statuses recorded) Dec 31 06:45:12.488: INFO: Container csi-provisioner ready: true, restart count 0 Dec 31 06:45:12.488: INFO: Container driver-registrar ready: true, restart count 0 Dec 31 06:45:12.488: INFO: Container mock ready: true, restart count 0 Dec 31 06:45:12.488: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-7tbwm started at 2022-12-31 06:38:46 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.488: INFO: Container cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536 ready: true, restart count 0 Dec 31 06:45:12.488: INFO: coredns-559769c974-tz7zd started at 2022-12-31 06:26:19 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.488: INFO: Container coredns ready: true, restart count 0 Dec 31 06:45:12.488: INFO: csi-mockplugin-attacher-0 started at 2022-12-31 06:39:09 +0000 UTC (0+1 container statuses recorded) Dec 31 06:45:12.488: INFO: Container csi-attacher ready: false, restart count 0 Dec 31 06:45:12.488: INFO: cleanup40-dd3ca30b-6bb6-4ac6-91ab-7cb782589536-lcw6r started at 2022-