e2e-kops-grid-cilium-eni-u2004-k26 #1615957037118656512
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 41 failed / 847 succeeded |
| Started | |
| Elapsed | 49m57s |
| Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\(allowExpansion\)\]\svolume\-expand\sshould\sresize\svolume\swhen\sPVC\sis\sedited\swhile\spod\sis\susing\sit$'
test/e2e/storage/testsuites/volume_expand.go:270 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func5() test/e2e/storage/testsuites/volume_expand.go:270 +0x3b3from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 06:34:52.53�[0m Jan 19 06:34:52.530: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename volume-expand �[38;5;243m01/19/23 06:34:52.531�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 06:34:52.839�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 06:34:53.042�[0m [BeforeEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/framework/metrics/init/init.go:31 [It] should resize volume when PVC is edited while pod is using it test/e2e/storage/testsuites/volume_expand.go:248 Jan 19 06:34:53.246: INFO: Creating resource for dynamic PV Jan 19 06:34:53.246: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} �[1mSTEP:�[0m creating a StorageClass volume-expand-5682-e2e-scsk84v �[38;5;243m01/19/23 06:34:53.246�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m01/19/23 06:34:53.35�[0m �[1mSTEP:�[0m Creating a pod with dynamically provisioned volume �[38;5;243m01/19/23 06:34:53.557�[0m Jan 19 06:34:53.662: INFO: Waiting up to 5m0s for pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447" in namespace "volume-expand-5682" to be "running" Jan 19 06:34:53.764: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 102.199512ms Jan 19 06:34:55.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2.20534052s Jan 19 06:34:57.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4.205771465s Jan 19 06:34:59.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 6.206108236s Jan 19 06:35:01.870: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 8.208292299s Jan 19 06:35:03.869: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 10.206826279s Jan 19 06:35:05.870: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 12.208229033s Jan 19 06:35:07.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 14.205517714s Jan 19 06:35:09.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 16.204923252s Jan 19 06:35:11.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 18.205855549s Jan 19 06:35:13.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 20.205842356s Jan 19 06:35:15.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 22.205268041s Jan 19 06:35:17.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 24.205603044s Jan 19 06:35:19.869: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 26.206873499s Jan 19 06:35:21.870: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 28.208440846s Jan 19 06:35:23.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 30.205339635s Jan 19 06:35:25.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 32.205598563s Jan 19 06:35:27.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 34.205082986s Jan 19 06:35:29.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 36.205807595s Jan 19 06:35:31.871: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 38.209463111s Jan 19 06:35:33.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 40.205336292s Jan 19 06:35:35.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 42.20517093s Jan 19 06:35:37.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 44.205354836s Jan 19 06:35:39.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 46.205444433s Jan 19 06:35:41.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 48.205580594s Jan 19 06:35:43.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 50.205620986s Jan 19 06:35:45.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 52.205050313s Jan 19 06:35:47.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 54.205652406s Jan 19 06:35:49.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 56.205524598s Jan 19 06:35:51.866: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 58.204470852s Jan 19 06:35:53.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.205604489s Jan 19 06:35:55.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.205577516s Jan 19 06:35:57.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.205159097s Jan 19 06:35:59.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.205233513s Jan 19 06:36:01.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.205050042s Jan 19 06:36:03.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.205682271s Jan 19 06:36:05.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.205177678s Jan 19 06:36:07.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.205350979s Jan 19 06:36:09.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.205599742s Jan 19 06:36:11.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.205363987s Jan 19 06:36:13.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.205759548s Jan 19 06:36:15.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.20545747s Jan 19 06:36:17.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.205424863s Jan 19 06:36:19.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.205282322s Jan 19 06:36:21.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.205275235s Jan 19 06:36:23.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.204636827s Jan 19 06:36:25.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.205495684s Jan 19 06:36:27.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.205527659s Jan 19 06:36:29.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.205750231s Jan 19 06:36:31.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.205120647s Jan 19 06:36:33.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.204619273s Jan 19 06:36:35.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.205499447s Jan 19 06:36:37.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.20500962s Jan 19 06:36:39.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.205643389s Jan 19 06:36:41.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.205777845s Jan 19 06:36:43.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.205610217s Jan 19 06:36:45.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.205786936s Jan 19 06:36:47.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.205557965s Jan 19 06:36:49.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.205461246s Jan 19 06:36:51.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.205442617s Jan 19 06:36:53.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.205444136s Jan 19 06:36:55.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.205596643s Jan 19 06:36:57.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.205325208s Jan 19 06:36:59.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.205096738s Jan 19 06:37:01.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.205323103s Jan 19 06:37:03.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.205658845s Jan 19 06:37:05.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.205778555s Jan 19 06:37:07.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.205346222s Jan 19 06:37:09.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.205665448s Jan 19 06:37:11.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.205589382s Jan 19 06:37:13.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.205134075s Jan 19 06:37:15.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.204810314s Jan 19 06:37:17.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.205648007s Jan 19 06:37:19.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.205458793s Jan 19 06:37:21.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.205160588s Jan 19 06:37:23.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.205548042s Jan 19 06:37:25.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.20530756s Jan 19 06:37:27.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.205664116s Jan 19 06:37:29.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.205830233s Jan 19 06:37:31.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.20569664s Jan 19 06:37:33.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.2055929s Jan 19 06:37:35.869: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.206859162s Jan 19 06:37:37.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.205276692s Jan 19 06:37:39.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.206347563s Jan 19 06:37:41.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.20568502s Jan 19 06:37:43.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.205299682s Jan 19 06:37:45.869: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.206589165s Jan 19 06:37:47.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.205227295s Jan 19 06:37:49.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.205852431s Jan 19 06:37:51.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.205616813s Jan 19 06:37:53.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.205171962s Jan 19 06:37:55.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.20516833s Jan 19 06:37:57.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.205564898s Jan 19 06:37:59.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.205658128s Jan 19 06:38:01.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.205629021s Jan 19 06:38:03.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.205784847s Jan 19 06:38:05.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.205116002s Jan 19 06:38:07.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.205447287s Jan 19 06:38:09.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.205431573s Jan 19 06:38:11.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.205328786s Jan 19 06:38:13.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.204954865s Jan 19 06:38:15.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.205279389s Jan 19 06:38:17.878: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.215876859s Jan 19 06:38:19.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.205986032s Jan 19 06:38:21.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.205476633s Jan 19 06:38:23.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.205376895s Jan 19 06:38:25.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.204853791s Jan 19 06:38:27.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.205125119s Jan 19 06:38:29.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.205622886s Jan 19 06:38:31.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.205732127s Jan 19 06:38:33.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.205562592s Jan 19 06:38:35.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.205370544s Jan 19 06:38:37.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.205429296s Jan 19 06:38:39.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.205081265s Jan 19 06:38:41.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.205370022s Jan 19 06:38:43.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.20526307s Jan 19 06:38:45.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.205279981s Jan 19 06:38:47.866: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.204471164s Jan 19 06:38:49.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.205487001s Jan 19 06:38:51.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.20460872s Jan 19 06:38:53.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.20523742s Jan 19 06:38:55.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.205267725s Jan 19 06:38:57.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.204947695s Jan 19 06:38:59.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.20558119s Jan 19 06:39:01.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.205623042s Jan 19 06:39:03.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.205537322s Jan 19 06:39:05.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.205882939s Jan 19 06:39:07.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.205494633s Jan 19 06:39:09.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.205670178s Jan 19 06:39:11.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.205405995s Jan 19 06:39:13.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.205199762s Jan 19 06:39:15.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.204926201s Jan 19 06:39:17.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.205934502s Jan 19 06:39:19.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.205587763s Jan 19 06:39:21.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.204575836s Jan 19 06:39:23.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.204974379s Jan 19 06:39:25.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.205220655s Jan 19 06:39:27.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.205296626s Jan 19 06:39:29.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.205283332s Jan 19 06:39:31.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.205402566s Jan 19 06:39:33.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.205327956s Jan 19 06:39:35.867: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.205050767s Jan 19 06:39:37.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.205701645s Jan 19 06:39:39.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.206280227s Jan 19 06:39:41.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.206230447s Jan 19 06:39:43.869: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.207242802s Jan 19 06:39:45.869: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.206952888s Jan 19 06:39:47.869: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.206678642s Jan 19 06:39:49.869: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.206606394s Jan 19 06:39:51.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.206263375s Jan 19 06:39:53.868: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.205980013s Jan 19 06:39:53.971: INFO: Pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.309185988s Jan 19 06:39:53.971: INFO: Unexpected error: While creating pods for resizing: <*errors.errorString | 0xc0014d9140>: { s: "pod \"pod-71c3d3d3-6e13-46ed-9684-b3b3db138447\" is not Running: timed out while waiting for pod volume-expand-5682/pod-71c3d3d3-6e13-46ed-9684-b3b3db138447 to be running", } Jan 19 06:39:53.971: FAIL: While creating pods for resizing: pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447" is not Running: timed out while waiting for pod volume-expand-5682/pod-71c3d3d3-6e13-46ed-9684-b3b3db138447 to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func5() test/e2e/storage/testsuites/volume_expand.go:270 +0x3b3 Jan 19 06:39:53.971: INFO: Deleting pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447" in namespace "volume-expand-5682" Jan 19 06:39:54.077: INFO: Wait up to 5m0s for pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447" to be fully deleted �[1mSTEP:�[0m Deleting pod �[38;5;243m01/19/23 06:39:56.285�[0m Jan 19 06:39:56.285: INFO: Deleting pod "pod-71c3d3d3-6e13-46ed-9684-b3b3db138447" in namespace "volume-expand-5682" �[1mSTEP:�[0m Deleting pvc �[38;5;243m01/19/23 06:39:56.387�[0m Jan 19 06:39:56.593: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comhwhgq" Jan 19 06:39:56.698: INFO: Waiting up to 5m0s for PersistentVolume pvc-6cdfc3cf-2382-4f38-819f-c2e671f72d2d to get deleted Jan 19 06:39:56.801: INFO: PersistentVolume pvc-6cdfc3cf-2382-4f38-819f-c2e671f72d2d found and phase=Released (102.738425ms) Jan 19 06:40:01.905: INFO: PersistentVolume pvc-6cdfc3cf-2382-4f38-819f-c2e671f72d2d found and phase=Released (5.207296784s) Jan 19 06:40:07.009: INFO: PersistentVolume pvc-6cdfc3cf-2382-4f38-819f-c2e671f72d2d found and phase=Released (10.310718216s) Jan 19 06:40:12.112: INFO: PersistentVolume pvc-6cdfc3cf-2382-4f38-819f-c2e671f72d2d was removed �[1mSTEP:�[0m Deleting sc �[38;5;243m01/19/23 06:40:12.112�[0m [AfterEach] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/framework/node/init/init.go:32 Jan 19 06:40:12.217: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 06:40:12.321�[0m �[1mSTEP:�[0m Collecting events from namespace "volume-expand-5682". �[38;5;243m01/19/23 06:40:12.321�[0m �[1mSTEP:�[0m Found 18 events. �[38;5;243m01/19/23 06:40:12.431�[0m Jan 19 06:40:12.431: INFO: At 2023-01-19 06:34:53 +0000 UTC - event for ebs.csi.aws.comhwhgq: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 19 06:40:12.431: INFO: At 2023-01-19 06:34:53 +0000 UTC - event for ebs.csi.aws.comhwhgq: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Jan 19 06:40:12.431: INFO: At 2023-01-19 06:34:53 +0000 UTC - event for ebs.csi.aws.comhwhgq: {ebs.csi.aws.com_i-0adb67e64e3ebad1e_cac02643-ef8c-47c9-901a-4f0e56d2fe3d } Provisioning: External provisioner is provisioning volume for claim "volume-expand-5682/ebs.csi.aws.comhwhgq" Jan 19 06:40:12.431: INFO: At 2023-01-19 06:34:56 +0000 UTC - event for ebs.csi.aws.comhwhgq: {ebs.csi.aws.com_i-0adb67e64e3ebad1e_cac02643-ef8c-47c9-901a-4f0e56d2fe3d } ProvisioningSucceeded: Successfully provisioned volume pvc-6cdfc3cf-2382-4f38-819f-c2e671f72d2d Jan 19 06:40:12.431: INFO: At 2023-01-19 06:34:57 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {default-scheduler } Scheduled: Successfully assigned volume-expand-5682/pod-71c3d3d3-6e13-46ed-9684-b3b3db138447 to i-0fd7dedb902bd2b40 Jan 19 06:40:12.431: INFO: At 2023-01-19 06:35:01 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-6cdfc3cf-2382-4f38-819f-c2e671f72d2d" Jan 19 06:40:12.431: INFO: At 2023-01-19 06:35:05 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-6cdfc3cf-2382-4f38-819f-c2e671f72d2d" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-6cdfc3cf-2382-4f38-819f-c2e671f72d2d/dev" Jan 19 06:40:12.431: INFO: At 2023-01-19 06:35:05 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-6cdfc3cf-2382-4f38-819f-c2e671f72d2d" volumeMapPath "/var/lib/kubelet/pods/0facd88b-793e-4c19-8d5f-e8a3d5e0ca1c/volumeDevices/kubernetes.io~csi" Jan 19 06:40:12.431: INFO: At 2023-01-19 06:35:05 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "64a4551348e77d346abb9aa25212ed2fd396acdbb460bc5e51d6c850224384c7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:40:12.431: INFO: At 2023-01-19 06:35:20 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "04dffa51f56d3aa73842b9121e43f5e2b09876b3be8ed86c3bdfd0900e608599": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:40:12.431: INFO: At 2023-01-19 06:35:35 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4a34d4e757921099e130ac4b2eb0c53d7bec8bd9d00ed8cb3aa6dc3340e286d2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:40:12.431: INFO: At 2023-01-19 06:35:47 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c5c85ed8016e29a377f1234df675853b413b36cf54689184093e26fdb74324b8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:40:12.431: INFO: At 2023-01-19 06:36:00 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2560c1798cc0973a85ba8b3256d171d41102c111fb4c625449f1d2eb73f63ff2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:40:12.431: INFO: At 2023-01-19 06:36:11 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1598d0595f7abf87618de263e29307e203722bba18670c036339c59e544a480a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:40:12.431: INFO: At 2023-01-19 06:36:23 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ecd606f5a55072d727163430279e9cdc8df8bc97a7919db99ff503863055ae06": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:40:12.431: INFO: At 2023-01-19 06:36:38 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fa245387092b113c07e500486c139a72c4f61519a8116e8752857c0c351da186": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:40:12.431: INFO: At 2023-01-19 06:36:53 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9a756d7c8d2d610f240d8f4b74e2ada80e7b3e41a134cf6e9f3b2d2baa2752e2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:40:12.431: INFO: At 2023-01-19 06:37:08 +0000 UTC - event for pod-71c3d3d3-6e13-46ed-9684-b3b3db138447: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4224d7c9667e0fceb2cc1fc412d5d497e370e5f2c4b69df05c7093a2233f5ecf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:40:12.543: INFO: POD NODE PHASE GRACE CONDITIONS Jan 19 06:40:12.543: INFO: Jan 19 06:40:12.647: INFO: Logging node info for node i-01c8a84101e2eeddc Jan 19 06:40:12.750: INFO: Node Info: &Node{ObjectMeta:{i-01c8a84101e2eeddc de952a6e-ca42-4dc7-9079-e5f5df729733 18635 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01c8a84101e2eeddc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-01c8a84101e2eeddc topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.49 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01c8a84101e2eeddc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:39:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-01c8a84101e2eeddc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:35:53 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:35:53 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:35:53 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:35:53 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.49,},NodeAddress{Type:ExternalIP,Address:15.188.127.11,},NodeAddress{Type:InternalDNS,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-188-127-11.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d066c25678610b99acde89c731a76,SystemUUID:ec2d066c-2567-8610-b99a-cde89c731a76,BootID:3983005e-c9f1-4922-bf79-f80a745c9c94,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 06:40:12.750: INFO: Logging kubelet events for node i-01c8a84101e2eeddc Jan 19 06:40:12.855: INFO: Logging pods the kubelet thinks is on node i-01c8a84101e2eeddc Jan 19 06:40:13.068: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-87z7m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:40:13.068: INFO: ebs-csi-node-52j6r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded) Jan 19 06:40:13.068: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:40:13.068: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:40:13.068: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 06:40:13.068: INFO: pod-subpath-test-inlinevolume-zpb9 started at 2023-01-19 06:36:13 +0000 UTC (2+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Init container init-volume-inlinevolume-zpb9 ready: false, restart count 0 Jan 19 06:40:13.068: INFO: Init container test-init-volume-inlinevolume-zpb9 ready: false, restart count 0 Jan 19 06:40:13.068: INFO: Container test-container-subpath-inlinevolume-zpb9 ready: false, restart count 0 Jan 19 06:40:13.068: INFO: test-rs-d95wt started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container httpd ready: false, restart count 0 Jan 19 06:40:13.068: INFO: service-headless-toggled-5j5bd started at 2023-01-19 06:34:38 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container service-headless-toggled ready: false, restart count 0 Jan 19 06:40:13.068: INFO: service-headless-46spc started at 2023-01-19 06:34:19 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container service-headless ready: true, restart count 0 Jan 19 06:40:13.068: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-d82dm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:40:13.068: INFO: cilium-kt55x started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 06:40:13.068: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 06:40:13.068: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-5f725 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.068: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4nj84 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.068: INFO: coredns-559769c974-mjt6q started at 2023-01-19 06:26:14 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container coredns ready: true, restart count 0 Jan 19 06:40:13.068: INFO: csi-mockplugin-0 started at 2023-01-19 06:34:10 +0000 UTC (0+4 container statuses recorded) Jan 19 06:40:13.068: INFO: Container busybox ready: true, restart count 0 Jan 19 06:40:13.068: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 06:40:13.068: INFO: Container driver-registrar ready: true, restart count 0 Jan 19 06:40:13.068: INFO: Container mock ready: true, restart count 0 Jan 19 06:40:13.068: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jngrg started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.068: INFO: pod-handle-http-request started at 2023-01-19 06:39:46 +0000 UTC (0+2 container statuses recorded) Jan 19 06:40:13.068: INFO: Container container-handle-http-request ready: false, restart count 0 Jan 19 06:40:13.068: INFO: Container container-handle-https-request ready: false, restart count 0 Jan 19 06:40:13.068: INFO: netserver-0 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container webserver ready: true, restart count 0 Jan 19 06:40:13.068: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gzbxm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.068: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jlhlb started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.068: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-dnqqv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.068: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vrmzk started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.068: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-nkg9j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.068: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.473: INFO: Latency metrics for node i-01c8a84101e2eeddc Jan 19 06:40:13.473: INFO: Logging node info for node i-02873c346fcadbca8 Jan 19 06:40:13.576: INFO: Node Info: &Node{ObjectMeta:{i-02873c346fcadbca8 b6b38d81-4c4f-47c3-8a5d-ac5718bb26a8 18142 0 2023-01-19 06:25:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02873c346fcadbca8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-02873c346fcadbca8 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-02873c346fcadbca8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:37:55 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:38:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-02873c346fcadbca8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.215,},NodeAddress{Type:ExternalIP,Address:13.36.173.220,},NodeAddress{Type:InternalDNS,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-173-220.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21b61f75acfaf0e7a5fc97a7aea262,SystemUUID:ec21b61f-75ac-faf0-e7a5-fc97a7aea262,BootID:48642020-5fc8-4238-bbe3-8b854e5d773e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0193d14c5ce38dc18 kubernetes.io/csi/ebs.csi.aws.com^vol-05aeca504bceab9e0 kubernetes.io/csi/ebs.csi.aws.com^vol-0d1d97df9e92f7db0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d1d97df9e92f7db0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0193d14c5ce38dc18,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05aeca504bceab9e0,DevicePath:,},},Config:nil,},} Jan 19 06:40:13.576: INFO: Logging kubelet events for node i-02873c346fcadbca8 Jan 19 06:40:13.683: INFO: Logging pods the kubelet thinks is on node i-02873c346fcadbca8 Jan 19 06:40:13.797: INFO: netserver-1 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container webserver ready: false, restart count 0 Jan 19 06:40:13.797: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wchfw started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.797: INFO: cilium-4hjl8 started at 2023-01-19 06:25:37 +0000 UTC (1+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 06:40:13.797: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 06:40:13.797: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zgw5r started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.797: INFO: test-rs-rw2w8 started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container httpd ready: false, restart count 0 Jan 19 06:40:13.797: INFO: inline-volume-tester2-fmh9p started at 2023-01-19 06:34:27 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 06:40:13.797: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wjgz6 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.797: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jn8lv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.797: INFO: ss-0 started at 2023-01-19 06:37:53 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container webserver ready: false, restart count 0 Jan 19 06:40:13.797: INFO: service-headless-toggled-8n6fd started at 2023-01-19 06:34:38 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container service-headless-toggled ready: true, restart count 0 Jan 19 06:40:13.797: INFO: ebs-csi-node-xwsp8 started at 2023-01-19 06:25:37 +0000 UTC (0+3 container statuses recorded) Jan 19 06:40:13.797: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:40:13.797: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:40:13.797: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 06:40:13.797: INFO: service-headless-rr8q9 started at 2023-01-19 06:34:19 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container service-headless ready: true, restart count 0 Jan 19 06:40:13.797: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-s952s started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.797: INFO: ss-0 started at 2023-01-19 06:35:01 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container webserver ready: true, restart count 0 Jan 19 06:40:13.797: INFO: ss2-0 started at 2023-01-19 06:35:54 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container webserver ready: true, restart count 0 Jan 19 06:40:13.797: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cck5q started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.797: INFO: pfpod started at 2023-01-19 06:36:13 +0000 UTC (0+2 container statuses recorded) Jan 19 06:40:13.797: INFO: Container portforwardtester ready: false, restart count 0 Jan 19 06:40:13.797: INFO: Container readiness ready: false, restart count 0 Jan 19 06:40:13.797: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-bs995 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:40:13.797: INFO: sample-webhook-deployment-865554f4d9-gkwhc started at 2023-01-19 06:36:08 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container sample-webhook ready: false, restart count 0 Jan 19 06:40:13.797: INFO: test-pod-09b898ed-1e72-4b3d-b642-09c68ee1bf30 started at 2023-01-19 06:39:48 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container agnhost-container ready: false, restart count 0 Jan 19 06:40:13.797: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cfrb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:40:13.797: INFO: image-pull-test02c0aac0-7d46-4614-aed4-ccfac5eaff6b started at 2023-01-19 06:39:56 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container image-pull-test ready: false, restart count 0 Jan 19 06:40:13.797: INFO: ss2-0 started at 2023-01-19 06:36:00 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container webserver ready: false, restart count 0 Jan 19 06:40:13.797: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-r8467 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:13.797: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-f8gmr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:13.797: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:14.335: INFO: Latency metrics for node i-02873c346fcadbca8 Jan 19 06:40:14.335: INFO: Logging node info for node i-0adb67e64e3ebad1e Jan 19 06:40:14.439: INFO: Node Info: &Node{ObjectMeta:{i-0adb67e64e3ebad1e cf261699-b36b-4a3b-a17d-96421c0d524f 17770 0 2023-01-19 06:23:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0adb67e64e3ebad1e kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3a topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.62.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0adb67e64e3ebad1e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 06:23:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:24:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {protokube Update v1 2023-01-19 06:24:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 06:36:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0adb67e64e3ebad1e,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:24:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.172,},NodeAddress{Type:ExternalIP,Address:13.38.71.8,},NodeAddress{Type:InternalDNS,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-71-8.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2403e255bd6f24debe308a9c68029e,SystemUUID:ec2403e2-55bd-6f24-debe-308a9c68029e,BootID:7912dda1-10e2-4946-a373-bb76d21b3786,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43629447,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42792174,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965798,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 06:40:14.439: INFO: Logging kubelet events for node i-0adb67e64e3ebad1e Jan 19 06:40:14.544: INFO: Logging pods the kubelet thinks is on node i-0adb67e64e3ebad1e Jan 19 06:40:14.654: INFO: aws-cloud-controller-manager-8rq4f started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:14.654: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 19 06:40:14.654: INFO: etcd-manager-events-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:14.654: INFO: Container etcd-manager ready: true, restart count 0 Jan 19 06:40:14.654: INFO: etcd-manager-main-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:14.654: INFO: Container etcd-manager ready: true, restart count 0 Jan 19 06:40:14.654: INFO: kube-apiserver-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+2 container statuses recorded) Jan 19 06:40:14.654: INFO: Container healthcheck ready: true, restart count 0 Jan 19 06:40:14.654: INFO: Container kube-apiserver ready: true, restart count 1 Jan 19 06:40:14.654: INFO: cilium-29vk6 started at 2023-01-19 06:24:01 +0000 UTC (1+1 container statuses recorded) Jan 19 06:40:14.654: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 06:40:14.654: INFO: Container cilium-agent ready: true, restart count 1 Jan 19 06:40:14.654: INFO: ebs-csi-controller-5bd98b456f-bt645 started at 2023-01-19 06:24:13 +0000 UTC (0+5 container statuses recorded) Jan 19 06:40:14.654: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 06:40:14.654: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 06:40:14.654: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 06:40:14.654: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:40:14.654: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:40:14.654: INFO: dns-controller-69987775c6-q62qz started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:14.654: INFO: Container dns-controller ready: true, restart count 0 Jan 19 06:40:14.654: INFO: kube-controller-manager-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:14.654: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 19 06:40:14.654: INFO: kube-scheduler-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:14.654: INFO: Container kube-scheduler ready: true, restart count 0 Jan 19 06:40:14.654: INFO: ebs-csi-node-z9pw9 started at 2023-01-19 06:24:10 +0000 UTC (0+3 container statuses recorded) Jan 19 06:40:14.654: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:40:14.654: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:40:14.654: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 06:40:14.654: INFO: cilium-operator-5dd44dc49f-pc5mf started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:14.654: INFO: Container cilium-operator ready: true, restart count 1 Jan 19 06:40:14.654: INFO: kops-controller-gwm5z started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:14.654: INFO: Container kops-controller ready: true, restart count 0 Jan 19 06:40:15.033: INFO: Latency metrics for node i-0adb67e64e3ebad1e Jan 19 06:40:15.033: INFO: Logging node info for node i-0bc9010b80d8fb7a3 Jan 19 06:40:15.136: INFO: Node Info: &Node{ObjectMeta:{i-0bc9010b80d8fb7a3 a233aec6-3e3a-474b-9d9b-37e112ada5dd 18849 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bc9010b80d8fb7a3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0bc9010b80d8fb7a3 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.13 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bc9010b80d8fb7a3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:40:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0bc9010b80d8fb7a3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.13,},NodeAddress{Type:ExternalIP,Address:15.236.218.34,},NodeAddress{Type:InternalDNS,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-218-34.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ede8175f1d6ab673e885453491f40,SystemUUID:ec2ede81-75f1-d6ab-673e-885453491f40,BootID:d8c02e70-1290-450f-9b63-595e3f9877b7,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 06:40:15.136: INFO: Logging kubelet events for node i-0bc9010b80d8fb7a3 Jan 19 06:40:15.242: INFO: Logging pods the kubelet thinks is on node i-0bc9010b80d8fb7a3 Jan 19 06:40:15.351: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-rw8m5 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:15.351: INFO: coredns-559769c974-rfs6h started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container coredns ready: true, restart count 0 Jan 19 06:40:15.351: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-n5thx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:15.351: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zdvsc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:15.351: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4jfb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:15.351: INFO: pod-secrets-97b423cb-db9a-4eb1-a66a-95f0f3c3d055 started at 2023-01-19 06:40:08 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container secret-volume-test ready: false, restart count 0 Jan 19 06:40:15.351: INFO: fail-once-non-local-sp8qx started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container c ready: false, restart count 0 Jan 19 06:40:15.351: INFO: ebs-csi-node-p7m8r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded) Jan 19 06:40:15.351: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:40:15.351: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:40:15.351: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 06:40:15.351: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kvlh9 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:15.351: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vk25m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:15.351: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kwxms started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:40:15.351: INFO: cilium-4db85 started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 06:40:15.351: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 06:40:15.351: INFO: fail-once-non-local-j5lgj started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container c ready: false, restart count 0 Jan 19 06:40:15.351: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-w9vxz started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:15.351: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wc82j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:15.351: INFO: coredns-autoscaler-7cb5c5b969-l9mxh started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container autoscaler ready: true, restart count 0 Jan 19 06:40:15.351: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-lgvhj started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:15.351: INFO: netserver-2 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:15.351: INFO: Container webserver ready: false, restart count 0 Jan 19 06:40:15.778: INFO: Latency metrics for node i-0bc9010b80d8fb7a3 Jan 19 06:40:15.778: INFO: Logging node info for node i-0fd7dedb902bd2b40 Jan 19 06:40:15.886: INFO: Node Info: &Node{ObjectMeta:{i-0fd7dedb902bd2b40 dcd1c2b0-c939-4b06-86d9-faa66cbd5f62 18809 0 2023-01-19 06:25:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fd7dedb902bd2b40 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0fd7dedb902bd2b40 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.15 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd7dedb902bd2b40"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:40:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:40:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0fd7dedb902bd2b40,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:00 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:00 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:00 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:40:00 +0000 UTC,LastTransitionTime:2023-01-19 06:25:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.15,},NodeAddress{Type:ExternalIP,Address:13.36.168.174,},NodeAddress{Type:InternalDNS,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-168-174.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2507f02fe9694e6687a10a99b81476,SystemUUID:ec2507f0-2fe9-694e-6687-a10a99b81476,BootID:4e2ef5d6-9152-47a6-9581-43ae00972132,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0434bfb8d414b168a kubernetes.io/csi/ebs.csi.aws.com^vol-046138a1832bcff2c kubernetes.io/csi/ebs.csi.aws.com^vol-049dd3d103a06d67a kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0434bfb8d414b168a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-046138a1832bcff2c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-049dd3d103a06d67a,DevicePath:,},},Config:nil,},} Jan 19 06:40:15.886: INFO: Logging kubelet events for node i-0fd7dedb902bd2b40 Jan 19 06:40:15.998: INFO: Logging pods the kubelet thinks is on node i-0fd7dedb902bd2b40 Jan 19 06:40:16.115: INFO: busybox-e0f4ec78-8a17-4742-b780-27f4c738c15e started at 2023-01-19 06:38:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container busybox ready: false, restart count 0 Jan 19 06:40:16.115: INFO: service-headless-7nptd started at 2023-01-19 06:34:19 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container service-headless ready: true, restart count 0 Jan 19 06:40:16.115: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-ltgrx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:16.115: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-qz8nr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:40:16.115: INFO: cilium-2rqdw started at 2023-01-19 06:25:34 +0000 UTC (1+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 06:40:16.115: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 06:40:16.115: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gmz6h started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:16.115: INFO: pod-subpath-test-preprovisionedpv-99qs started at 2023-01-19 06:35:31 +0000 UTC (2+2 container statuses recorded) Jan 19 06:40:16.115: INFO: Init container init-volume-preprovisionedpv-99qs ready: false, restart count 0 Jan 19 06:40:16.115: INFO: Init container test-init-subpath-preprovisionedpv-99qs ready: false, restart count 0 Jan 19 06:40:16.115: INFO: Container test-container-subpath-preprovisionedpv-99qs ready: false, restart count 0 Jan 19 06:40:16.115: INFO: Container test-container-volume-preprovisionedpv-99qs ready: false, restart count 0 Jan 19 06:40:16.115: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-6294b started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:40:16.115: INFO: ebs-csi-node-x9tpg started at 2023-01-19 06:25:34 +0000 UTC (0+3 container statuses recorded) Jan 19 06:40:16.115: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:40:16.115: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:40:16.115: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 06:40:16.115: INFO: inline-volume-tester-gt9hf started at 2023-01-19 06:34:10 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container csi-volume-tester ready: true, restart count 0 Jan 19 06:40:16.115: INFO: test-rs-h6zjm started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container httpd ready: false, restart count 0 Jan 19 06:40:16.115: INFO: inline-volume-tester-mf6q7 started at 2023-01-19 06:34:58 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 06:40:16.115: INFO: netserver-3 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container webserver ready: true, restart count 0 Jan 19 06:40:16.115: INFO: hostexec-i-0fd7dedb902bd2b40-hxhxq started at 2023-01-19 06:35:22 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 06:40:16.115: INFO: ss-1 started at 2023-01-19 06:36:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container webserver ready: false, restart count 0 Jan 19 06:40:16.115: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-58rnf started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:16.115: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-fc8jt started at 2023-01-19 06:34:27 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:40:16.115: INFO: service-headless-toggled-kfphc started at 2023-01-19 06:34:38 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container service-headless-toggled ready: true, restart count 0 Jan 19 06:40:16.115: INFO: ss2-1 started at 2023-01-19 06:35:55 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container webserver ready: false, restart count 0 Jan 19 06:40:16.115: INFO: test-grpc-730c5dd9-aa89-476c-a8f1-4b9fa8fe749d started at 2023-01-19 06:39:53 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container etcd ready: false, restart count 0 Jan 19 06:40:16.115: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-hkwbn started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:16.115: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-45qq2 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:16.115: INFO: pod-80d67e58-24ea-4871-866e-0ef63ad77eab started at 2023-01-19 06:34:46 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container write-pod ready: true, restart count 0 Jan 19 06:40:16.115: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jk9pc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:16.115: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-q5n4f started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:40:16.115: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:40:16.529: INFO: Latency metrics for node i-0fd7dedb902bd2b40 [DeferCleanup (Each)] [Testpattern: Dynamic PV (block volmode)(allowExpansion)] volume-expand tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "volume-expand-5682" for this suite. �[38;5;243m01/19/23 06:40:16.529�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\(allowExpansion\)\]\svolume\-expand\sVerify\sif\soffline\sPVC\sexpansion\sworks$'
test/e2e/storage/testsuites/volume_expand.go:194 k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func4() test/e2e/storage/testsuites/volume_expand.go:194 +0x3bafrom junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 06:40:17.75�[0m Jan 19 06:40:17.750: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename volume-expand �[38;5;243m01/19/23 06:40:17.751�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 06:40:18.065�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 06:40:18.273�[0m [BeforeEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/framework/metrics/init/init.go:31 [It] Verify if offline PVC expansion works test/e2e/storage/testsuites/volume_expand.go:172 Jan 19 06:40:18.480: INFO: Creating resource for dynamic PV Jan 19 06:40:18.480: INFO: Using claimSize:1Gi, test suite supported size:{ 1Gi}, driver(ebs.csi.aws.com) supported size:{ 1Gi} �[1mSTEP:�[0m creating a StorageClass volume-expand-5183-e2e-scq42z4 �[38;5;243m01/19/23 06:40:18.481�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m01/19/23 06:40:18.586�[0m Jan 19 06:40:18.586: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP:�[0m Creating a pod with dynamically provisioned volume �[38;5;243m01/19/23 06:40:18.796�[0m Jan 19 06:40:18.903: INFO: Waiting up to 5m0s for pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6" in namespace "volume-expand-5183" to be "running" Jan 19 06:40:19.008: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 104.850444ms Jan 19 06:40:21.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209837446s Jan 19 06:40:23.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.209233445s Jan 19 06:40:25.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 6.210388372s Jan 19 06:40:27.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 8.210409629s Jan 19 06:40:29.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 10.210354024s Jan 19 06:40:31.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 12.20918657s Jan 19 06:40:33.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 14.209921877s Jan 19 06:40:35.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 16.209376696s Jan 19 06:40:37.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 18.21036689s Jan 19 06:40:39.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 20.210189492s Jan 19 06:40:41.114: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 22.21050523s Jan 19 06:40:43.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 24.209813622s Jan 19 06:40:45.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 26.209442821s Jan 19 06:40:47.114: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 28.210828506s Jan 19 06:40:49.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 30.20923095s Jan 19 06:40:51.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 32.210331863s Jan 19 06:40:53.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 34.210455291s Jan 19 06:40:55.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 36.209191172s Jan 19 06:40:57.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 38.210246068s Jan 19 06:40:59.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 40.210344419s Jan 19 06:41:01.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 42.210338632s Jan 19 06:41:03.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 44.209586264s Jan 19 06:41:05.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 46.209950167s Jan 19 06:41:07.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 48.209459671s Jan 19 06:41:09.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 50.209665493s Jan 19 06:41:11.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 52.208767304s Jan 19 06:41:13.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 54.209538483s Jan 19 06:41:15.120: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 56.216844212s Jan 19 06:41:17.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 58.209649456s Jan 19 06:41:19.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.208944103s Jan 19 06:41:21.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.209605s Jan 19 06:41:23.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.20986091s Jan 19 06:41:25.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.209552228s Jan 19 06:41:27.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.209225904s Jan 19 06:41:29.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.210203714s Jan 19 06:41:31.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.210180635s Jan 19 06:41:33.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.209832949s Jan 19 06:41:35.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.209707357s Jan 19 06:41:37.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.210269735s Jan 19 06:41:39.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.210169122s Jan 19 06:41:41.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.209994332s Jan 19 06:41:43.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.210052001s Jan 19 06:41:45.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.209507786s Jan 19 06:41:47.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.209768622s Jan 19 06:41:49.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.210167948s Jan 19 06:41:51.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.210029369s Jan 19 06:41:53.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.210186822s Jan 19 06:41:55.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.209415149s Jan 19 06:41:57.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.209829184s Jan 19 06:41:59.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.210046854s Jan 19 06:42:01.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.20924659s Jan 19 06:42:03.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.210205931s Jan 19 06:42:05.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.210293804s Jan 19 06:42:07.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.209220264s Jan 19 06:42:09.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.210424692s Jan 19 06:42:11.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.209209689s Jan 19 06:42:13.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.210323986s Jan 19 06:42:15.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.208958038s Jan 19 06:42:17.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.209940188s Jan 19 06:42:19.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.210190771s Jan 19 06:42:21.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.210206856s Jan 19 06:42:23.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.209710488s Jan 19 06:42:25.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.209906077s Jan 19 06:42:27.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.209682985s Jan 19 06:42:29.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.209012594s Jan 19 06:42:31.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.210197204s Jan 19 06:42:33.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.209785422s Jan 19 06:42:35.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.210350218s Jan 19 06:42:37.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.210445617s Jan 19 06:42:39.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.208916878s Jan 19 06:42:41.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.210212513s Jan 19 06:42:43.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.209626291s Jan 19 06:42:45.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.210237879s Jan 19 06:42:47.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.210217678s Jan 19 06:42:49.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.210033663s Jan 19 06:42:51.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.209837339s Jan 19 06:42:53.114: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.210738313s Jan 19 06:42:55.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.209209362s Jan 19 06:42:57.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.210144371s Jan 19 06:42:59.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.210206694s Jan 19 06:43:01.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.209391514s Jan 19 06:43:03.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.210173847s Jan 19 06:43:05.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.209219953s Jan 19 06:43:07.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.209569221s Jan 19 06:43:09.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.209950146s Jan 19 06:43:11.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.209800165s Jan 19 06:43:13.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.210189916s Jan 19 06:43:15.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.210282607s Jan 19 06:43:17.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.210202512s Jan 19 06:43:19.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.209712189s Jan 19 06:43:21.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.208948325s Jan 19 06:43:23.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.210122938s Jan 19 06:43:25.114: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.210634801s Jan 19 06:43:27.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.210336889s Jan 19 06:43:29.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.21020917s Jan 19 06:43:31.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.210371161s Jan 19 06:43:33.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.210119062s Jan 19 06:43:35.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.21017434s Jan 19 06:43:37.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.210067015s Jan 19 06:43:39.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.209867371s Jan 19 06:43:41.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.209914443s Jan 19 06:43:43.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.210198989s Jan 19 06:43:45.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.210225669s Jan 19 06:43:47.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.210181583s Jan 19 06:43:49.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.209698247s Jan 19 06:43:51.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.209740503s Jan 19 06:43:53.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.210249681s Jan 19 06:43:55.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.210042143s Jan 19 06:43:57.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.210136437s Jan 19 06:43:59.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.209814842s Jan 19 06:44:01.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.209271524s Jan 19 06:44:03.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.210303244s Jan 19 06:44:05.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.210355886s Jan 19 06:44:07.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.210244065s Jan 19 06:44:09.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.209797022s Jan 19 06:44:11.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.209508414s Jan 19 06:44:13.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.209242261s Jan 19 06:44:15.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.210130895s Jan 19 06:44:17.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.209451086s Jan 19 06:44:19.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.210280187s Jan 19 06:44:21.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.209984157s Jan 19 06:44:23.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.209340882s Jan 19 06:44:25.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.210091444s Jan 19 06:44:27.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.210288574s Jan 19 06:44:29.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.210454763s Jan 19 06:44:31.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.209297922s Jan 19 06:44:33.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.209705996s Jan 19 06:44:35.114: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.211082339s Jan 19 06:44:37.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.209457867s Jan 19 06:44:39.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.210031758s Jan 19 06:44:41.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.210308146s Jan 19 06:44:43.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.210011869s Jan 19 06:44:45.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.209649906s Jan 19 06:44:47.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.209892628s Jan 19 06:44:49.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.210283246s Jan 19 06:44:51.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.210458014s Jan 19 06:44:53.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.210400824s Jan 19 06:44:55.114: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.210570246s Jan 19 06:44:57.112: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.209293154s Jan 19 06:44:59.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.21020985s Jan 19 06:45:01.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.209645554s Jan 19 06:45:03.114: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.210576884s Jan 19 06:45:05.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.210423223s Jan 19 06:45:07.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.209619878s Jan 19 06:45:09.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.210098151s Jan 19 06:45:11.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.210352807s Jan 19 06:45:13.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.209946737s Jan 19 06:45:15.113: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.210172589s Jan 19 06:45:17.114: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.210665005s Jan 19 06:45:19.114: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.210522917s Jan 19 06:45:19.218: INFO: Pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.315120788s Jan 19 06:45:19.218: INFO: Unexpected error: While creating pods for resizing: <*errors.errorString | 0xc002b02b80>: { s: "pod \"pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6\" is not Running: timed out while waiting for pod volume-expand-5183/pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6 to be running", } Jan 19 06:45:19.218: FAIL: While creating pods for resizing: pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6" is not Running: timed out while waiting for pod volume-expand-5183/pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6 to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumeExpandTestSuite).DefineTests.func4() test/e2e/storage/testsuites/volume_expand.go:194 +0x3ba Jan 19 06:45:19.218: INFO: Deleting pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6" in namespace "volume-expand-5183" Jan 19 06:45:19.325: INFO: Wait up to 5m0s for pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6" to be fully deleted �[1mSTEP:�[0m Deleting pod �[38;5;243m01/19/23 06:45:21.535�[0m Jan 19 06:45:21.535: INFO: Deleting pod "pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6" in namespace "volume-expand-5183" �[1mSTEP:�[0m Deleting pvc �[38;5;243m01/19/23 06:45:21.639�[0m Jan 19 06:45:21.847: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com2zjbp" Jan 19 06:45:21.953: INFO: Waiting up to 5m0s for PersistentVolume pvc-8d116542-aa9d-47f7-994f-82489a9bff6f to get deleted Jan 19 06:45:22.057: INFO: PersistentVolume pvc-8d116542-aa9d-47f7-994f-82489a9bff6f found and phase=Released (104.055633ms) Jan 19 06:45:27.162: INFO: PersistentVolume pvc-8d116542-aa9d-47f7-994f-82489a9bff6f found and phase=Released (5.208628724s) Jan 19 06:45:32.267: INFO: PersistentVolume pvc-8d116542-aa9d-47f7-994f-82489a9bff6f found and phase=Released (10.313682897s) Jan 19 06:45:37.372: INFO: PersistentVolume pvc-8d116542-aa9d-47f7-994f-82489a9bff6f was removed �[1mSTEP:�[0m Deleting sc �[38;5;243m01/19/23 06:45:37.372�[0m [AfterEach] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/framework/node/init/init.go:32 Jan 19 06:45:37.478: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 06:45:37.584�[0m �[1mSTEP:�[0m Collecting events from namespace "volume-expand-5183". �[38;5;243m01/19/23 06:45:37.584�[0m �[1mSTEP:�[0m Found 16 events. �[38;5;243m01/19/23 06:45:37.688�[0m Jan 19 06:45:37.688: INFO: At 2023-01-19 06:40:18 +0000 UTC - event for ebs.csi.aws.com2zjbp: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 19 06:45:37.688: INFO: At 2023-01-19 06:40:18 +0000 UTC - event for ebs.csi.aws.com2zjbp: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Jan 19 06:45:37.688: INFO: At 2023-01-19 06:40:18 +0000 UTC - event for ebs.csi.aws.com2zjbp: {ebs.csi.aws.com_i-0adb67e64e3ebad1e_cac02643-ef8c-47c9-901a-4f0e56d2fe3d } Provisioning: External provisioner is provisioning volume for claim "volume-expand-5183/ebs.csi.aws.com2zjbp" Jan 19 06:45:37.688: INFO: At 2023-01-19 06:40:22 +0000 UTC - event for ebs.csi.aws.com2zjbp: {ebs.csi.aws.com_i-0adb67e64e3ebad1e_cac02643-ef8c-47c9-901a-4f0e56d2fe3d } ProvisioningSucceeded: Successfully provisioned volume pvc-8d116542-aa9d-47f7-994f-82489a9bff6f Jan 19 06:45:37.688: INFO: At 2023-01-19 06:40:22 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {default-scheduler } Scheduled: Successfully assigned volume-expand-5183/pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6 to i-0fd7dedb902bd2b40 Jan 19 06:45:37.688: INFO: At 2023-01-19 06:40:25 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-8d116542-aa9d-47f7-994f-82489a9bff6f" Jan 19 06:45:37.688: INFO: At 2023-01-19 06:40:32 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b87d7d98fdf5d2503f2955c7da6fe327756890a844ca6df10cb29a3ca792ed60": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:45:37.688: INFO: At 2023-01-19 06:40:43 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e237fb4e744ac0f68f48f4e70b75b12afe77ba96fe307ec6b70594bdaadc2e68": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:45:37.688: INFO: At 2023-01-19 06:40:54 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "50c3d105dff68ae992510248043cddaff8434bf3658ed7c89527371046bb6a28": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:45:37.688: INFO: At 2023-01-19 06:41:08 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "04503d4a1807df58399f814828b091e3d6c05a8f61867ca02707f984e481a81c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:45:37.688: INFO: At 2023-01-19 06:41:22 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f4b5be6ab85cac7f8e2631a95f4356652124d17378d77995097c82b38fc3e588": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:45:37.688: INFO: At 2023-01-19 06:41:37 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "855a88a5340c0ed5bf32819eb51e84a1edbffebaaf1c703763e9ec5a6ceb811a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:45:37.688: INFO: At 2023-01-19 06:41:51 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "31bdbbb5327ece256483dcaec7ee1500978a5b7c932a6069ae8e5037a4603aee": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:45:37.688: INFO: At 2023-01-19 06:42:04 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3daf03b0bc864d7edd035d4ec677b9b911bdcc12b8bfa8ac1d2b44ae2f8564ae": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:45:37.688: INFO: At 2023-01-19 06:42:15 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "03b4af6ecd74490dd03d25f886230282697ec1d007f824a47d27281b0a339bec": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:45:37.688: INFO: At 2023-01-19 06:42:27 +0000 UTC - event for pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9e88f7e96940ee03d3e01190fae5faf46f5bb4334b01cb398e47674b79cb30d5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:45:37.792: INFO: POD NODE PHASE GRACE CONDITIONS Jan 19 06:45:37.792: INFO: Jan 19 06:45:37.897: INFO: Logging node info for node i-01c8a84101e2eeddc Jan 19 06:45:38.002: INFO: Node Info: &Node{ObjectMeta:{i-01c8a84101e2eeddc de952a6e-ca42-4dc7-9079-e5f5df729733 19350 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01c8a84101e2eeddc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-01c8a84101e2eeddc topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.49 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01c8a84101e2eeddc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:40:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-01c8a84101e2eeddc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.49,},NodeAddress{Type:ExternalIP,Address:15.188.127.11,},NodeAddress{Type:InternalDNS,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-188-127-11.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d066c25678610b99acde89c731a76,SystemUUID:ec2d066c-2567-8610-b99a-cde89c731a76,BootID:3983005e-c9f1-4922-bf79-f80a745c9c94,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 06:45:38.002: INFO: Logging kubelet events for node i-01c8a84101e2eeddc Jan 19 06:45:38.108: INFO: Logging pods the kubelet thinks is on node i-01c8a84101e2eeddc Jan 19 06:45:38.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-d82dm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:45:38.218: INFO: cilium-kt55x started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 06:45:38.218: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 06:45:38.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-5f725 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.218: INFO: csi-hostpathplugin-0 started at 2023-01-19 06:40:21 +0000 UTC (0+7 container statuses recorded) Jan 19 06:45:38.218: INFO: Container csi-attacher ready: false, restart count 0 Jan 19 06:45:38.218: INFO: Container csi-provisioner ready: false, restart count 0 Jan 19 06:45:38.218: INFO: Container csi-resizer ready: false, restart count 0 Jan 19 06:45:38.218: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 19 06:45:38.218: INFO: Container hostpath ready: false, restart count 0 Jan 19 06:45:38.218: INFO: Container liveness-probe ready: false, restart count 0 Jan 19 06:45:38.218: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 19 06:45:38.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4nj84 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.218: INFO: coredns-559769c974-mjt6q started at 2023-01-19 06:26:14 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container coredns ready: true, restart count 0 Jan 19 06:45:38.218: INFO: netserver-0 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container webserver ready: true, restart count 0 Jan 19 06:45:38.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jngrg started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.218: INFO: netserver-0 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container webserver ready: true, restart count 0 Jan 19 06:45:38.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gzbxm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jlhlb started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-dnqqv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vrmzk started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-nkg9j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-87z7m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.218: INFO: ebs-csi-node-52j6r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded) Jan 19 06:45:38.218: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:45:38.218: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:45:38.218: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 06:45:38.218: INFO: netserver-0 started at 2023-01-19 06:44:52 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.218: INFO: Container webserver ready: false, restart count 0 Jan 19 06:45:38.620: INFO: Latency metrics for node i-01c8a84101e2eeddc Jan 19 06:45:38.620: INFO: Logging node info for node i-02873c346fcadbca8 Jan 19 06:45:38.724: INFO: Node Info: &Node{ObjectMeta:{i-02873c346fcadbca8 b6b38d81-4c4f-47c3-8a5d-ac5718bb26a8 20751 0 2023-01-19 06:25:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02873c346fcadbca8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-02873c346fcadbca8 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-02873c346fcadbca8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:45:15 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:45:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-02873c346fcadbca8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:45:22 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:45:22 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:45:22 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:45:22 +0000 UTC,LastTransitionTime:2023-01-19 06:25:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.215,},NodeAddress{Type:ExternalIP,Address:13.36.173.220,},NodeAddress{Type:InternalDNS,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-173-220.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21b61f75acfaf0e7a5fc97a7aea262,SystemUUID:ec21b61f-75ac-faf0-e7a5-fc97a7aea262,BootID:48642020-5fc8-4238-bbe3-8b854e5d773e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0193d14c5ce38dc18 kubernetes.io/csi/ebs.csi.aws.com^vol-053f4a816ab9c1a3a kubernetes.io/csi/ebs.csi.aws.com^vol-05aeca504bceab9e0 kubernetes.io/csi/ebs.csi.aws.com^vol-073136eb24d038f22 kubernetes.io/csi/ebs.csi.aws.com^vol-0d1d97df9e92f7db0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d1d97df9e92f7db0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0193d14c5ce38dc18,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-073136eb24d038f22,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05aeca504bceab9e0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-053f4a816ab9c1a3a,DevicePath:,},},Config:nil,},} Jan 19 06:45:38.724: INFO: Logging kubelet events for node i-02873c346fcadbca8 Jan 19 06:45:38.830: INFO: Logging pods the kubelet thinks is on node i-02873c346fcadbca8 Jan 19 06:45:38.943: INFO: inline-volume-tester-4kbtk started at 2023-01-19 06:41:27 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 06:45:38.943: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-bs995 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:45:38.943: INFO: hostexec-i-02873c346fcadbca8-sl26v started at 2023-01-19 06:44:54 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 06:45:38.943: INFO: netserver-1 started at 2023-01-19 06:44:52 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container webserver ready: false, restart count 0 Jan 19 06:45:38.943: INFO: image-pull-test406f8554-ac13-4789-a574-df1cdec5969e started at 2023-01-19 06:44:56 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container image-pull-test ready: false, restart count 0 Jan 19 06:45:38.943: INFO: pod-44947394-4b5f-4296-8724-6752c8d9203b started at 2023-01-19 06:45:02 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container write-pod ready: false, restart count 0 Jan 19 06:45:38.943: INFO: ss2-0 started at 2023-01-19 06:36:00 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container webserver ready: false, restart count 0 Jan 19 06:45:38.943: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-r8467 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.943: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-f8gmr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.943: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cfrb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:45:38.943: INFO: pod-subpath-test-inlinevolume-vw47 started at 2023-01-19 06:45:16 +0000 UTC (1+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Init container init-volume-inlinevolume-vw47 ready: false, restart count 0 Jan 19 06:45:38.943: INFO: Container test-container-subpath-inlinevolume-vw47 ready: false, restart count 0 Jan 19 06:45:38.943: INFO: exec-volume-test-preprovisionedpv-wnmt started at 2023-01-19 06:45:17 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container exec-container-preprovisionedpv-wnmt ready: false, restart count 0 Jan 19 06:45:38.943: INFO: cilium-4hjl8 started at 2023-01-19 06:25:37 +0000 UTC (1+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 06:45:38.943: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 06:45:38.943: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zgw5r started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.943: INFO: netserver-1 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container webserver ready: true, restart count 0 Jan 19 06:45:38.943: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wchfw started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.943: INFO: test-container-pod started at 2023-01-19 06:40:31 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container webserver ready: false, restart count 0 Jan 19 06:45:38.943: INFO: inline-volume-tester2-r7fcc started at 2023-01-19 06:45:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 06:45:38.943: INFO: suspend-true-to-false-hfhzr started at 2023-01-19 06:45:20 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container c ready: false, restart count 0 Jan 19 06:45:38.943: INFO: hostexec-i-02873c346fcadbca8-mtngf started at 2023-01-19 06:45:03 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 06:45:38.943: INFO: inline-volume-tester2-fmh9p started at 2023-01-19 06:34:27 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 06:45:38.943: INFO: netserver-1 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container webserver ready: true, restart count 0 Jan 19 06:45:38.943: INFO: ebs-csi-node-xwsp8 started at 2023-01-19 06:25:37 +0000 UTC (0+3 container statuses recorded) Jan 19 06:45:38.943: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:45:38.943: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:45:38.943: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 06:45:38.943: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-s952s started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.943: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wjgz6 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.943: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jn8lv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.943: INFO: ss-0 started at 2023-01-19 06:37:53 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container webserver ready: false, restart count 0 Jan 19 06:45:38.943: INFO: ss2-0 started at 2023-01-19 06:35:54 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container webserver ready: true, restart count 0 Jan 19 06:45:38.943: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cck5q started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:38.943: INFO: dns-test-fadfdcc5-9b43-4b60-9746-a0f540f8d334 started at 2023-01-19 06:41:23 +0000 UTC (0+3 container statuses recorded) Jan 19 06:45:38.943: INFO: Container jessie-querier ready: false, restart count 0 Jan 19 06:45:38.943: INFO: Container querier ready: false, restart count 0 Jan 19 06:45:38.943: INFO: Container webserver ready: false, restart count 0 Jan 19 06:45:38.943: INFO: ss-0 started at 2023-01-19 06:35:01 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:38.943: INFO: Container webserver ready: true, restart count 0 Jan 19 06:45:39.379: INFO: Latency metrics for node i-02873c346fcadbca8 Jan 19 06:45:39.379: INFO: Logging node info for node i-0adb67e64e3ebad1e Jan 19 06:45:39.483: INFO: Node Info: &Node{ObjectMeta:{i-0adb67e64e3ebad1e cf261699-b36b-4a3b-a17d-96421c0d524f 19649 0 2023-01-19 06:23:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0adb67e64e3ebad1e kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3a topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.62.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0adb67e64e3ebad1e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 06:23:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:24:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {protokube Update v1 2023-01-19 06:24:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 06:41:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0adb67e64e3ebad1e,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:24:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.172,},NodeAddress{Type:ExternalIP,Address:13.38.71.8,},NodeAddress{Type:InternalDNS,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-71-8.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2403e255bd6f24debe308a9c68029e,SystemUUID:ec2403e2-55bd-6f24-debe-308a9c68029e,BootID:7912dda1-10e2-4946-a373-bb76d21b3786,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43629447,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42792174,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965798,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 06:45:39.483: INFO: Logging kubelet events for node i-0adb67e64e3ebad1e Jan 19 06:45:39.590: INFO: Logging pods the kubelet thinks is on node i-0adb67e64e3ebad1e Jan 19 06:45:39.701: INFO: kube-controller-manager-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:39.701: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 19 06:45:39.701: INFO: kube-scheduler-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:39.701: INFO: Container kube-scheduler ready: true, restart count 0 Jan 19 06:45:39.701: INFO: ebs-csi-node-z9pw9 started at 2023-01-19 06:24:10 +0000 UTC (0+3 container statuses recorded) Jan 19 06:45:39.701: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:45:39.701: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:45:39.701: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 06:45:39.701: INFO: cilium-operator-5dd44dc49f-pc5mf started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:39.701: INFO: Container cilium-operator ready: true, restart count 1 Jan 19 06:45:39.701: INFO: kops-controller-gwm5z started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:39.701: INFO: Container kops-controller ready: true, restart count 0 Jan 19 06:45:39.701: INFO: dns-controller-69987775c6-q62qz started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:39.701: INFO: Container dns-controller ready: true, restart count 0 Jan 19 06:45:39.701: INFO: aws-cloud-controller-manager-8rq4f started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:39.701: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 19 06:45:39.701: INFO: etcd-manager-events-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:39.701: INFO: Container etcd-manager ready: true, restart count 0 Jan 19 06:45:39.701: INFO: etcd-manager-main-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:39.701: INFO: Container etcd-manager ready: true, restart count 0 Jan 19 06:45:39.701: INFO: kube-apiserver-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+2 container statuses recorded) Jan 19 06:45:39.701: INFO: Container healthcheck ready: true, restart count 0 Jan 19 06:45:39.701: INFO: Container kube-apiserver ready: true, restart count 1 Jan 19 06:45:39.701: INFO: cilium-29vk6 started at 2023-01-19 06:24:01 +0000 UTC (1+1 container statuses recorded) Jan 19 06:45:39.701: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 06:45:39.701: INFO: Container cilium-agent ready: true, restart count 1 Jan 19 06:45:39.701: INFO: ebs-csi-controller-5bd98b456f-bt645 started at 2023-01-19 06:24:13 +0000 UTC (0+5 container statuses recorded) Jan 19 06:45:39.701: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 06:45:39.701: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 06:45:39.701: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 06:45:39.701: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:45:39.701: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:45:40.078: INFO: Latency metrics for node i-0adb67e64e3ebad1e Jan 19 06:45:40.078: INFO: Logging node info for node i-0bc9010b80d8fb7a3 Jan 19 06:45:40.182: INFO: Node Info: &Node{ObjectMeta:{i-0bc9010b80d8fb7a3 a233aec6-3e3a-474b-9d9b-37e112ada5dd 20592 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bc9010b80d8fb7a3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0bc9010b80d8fb7a3 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.13 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bc9010b80d8fb7a3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:45:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0bc9010b80d8fb7a3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:45:06 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:45:06 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:45:06 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:45:06 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.13,},NodeAddress{Type:ExternalIP,Address:15.236.218.34,},NodeAddress{Type:InternalDNS,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-218-34.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ede8175f1d6ab673e885453491f40,SystemUUID:ec2ede81-75f1-d6ab-673e-885453491f40,BootID:d8c02e70-1290-450f-9b63-595e3f9877b7,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 06:45:40.183: INFO: Logging kubelet events for node i-0bc9010b80d8fb7a3 Jan 19 06:45:40.289: INFO: Logging pods the kubelet thinks is on node i-0bc9010b80d8fb7a3 Jan 19 06:45:40.400: INFO: netserver-2 started at 2023-01-19 06:44:52 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container webserver ready: false, restart count 0 Jan 19 06:45:40.400: INFO: ebs-csi-node-p7m8r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded) Jan 19 06:45:40.400: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:45:40.400: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:45:40.400: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 06:45:40.400: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kvlh9 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:40.400: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kwxms started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:45:40.400: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vk25m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:40.400: INFO: csi-mockplugin-0 started at 2023-01-19 06:41:22 +0000 UTC (0+4 container statuses recorded) Jan 19 06:45:40.400: INFO: Container busybox ready: false, restart count 0 Jan 19 06:45:40.400: INFO: Container csi-provisioner ready: false, restart count 0 Jan 19 06:45:40.400: INFO: Container driver-registrar ready: false, restart count 0 Jan 19 06:45:40.400: INFO: Container mock ready: false, restart count 0 Jan 19 06:45:40.400: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-w9vxz started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:40.400: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wc82j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:40.400: INFO: cilium-4db85 started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 06:45:40.400: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 06:45:40.400: INFO: fail-once-non-local-j5lgj started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container c ready: false, restart count 0 Jan 19 06:45:40.400: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-lgvhj started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:40.400: INFO: netserver-2 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container webserver ready: true, restart count 0 Jan 19 06:45:40.400: INFO: coredns-autoscaler-7cb5c5b969-l9mxh started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container autoscaler ready: true, restart count 0 Jan 19 06:45:40.400: INFO: hostpath-symlink-prep-provisioning-5034 started at 2023-01-19 06:44:48 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container init-volume-provisioning-5034 ready: false, restart count 0 Jan 19 06:45:40.400: INFO: netserver-2 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container webserver ready: false, restart count 0 Jan 19 06:45:40.400: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-rw8m5 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:40.400: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zdvsc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:40.400: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4jfb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:40.400: INFO: coredns-559769c974-rfs6h started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container coredns ready: true, restart count 0 Jan 19 06:45:40.400: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-n5thx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:40.400: INFO: fail-once-non-local-sp8qx started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:40.400: INFO: Container c ready: false, restart count 0 Jan 19 06:45:40.791: INFO: Latency metrics for node i-0bc9010b80d8fb7a3 Jan 19 06:45:40.791: INFO: Logging node info for node i-0fd7dedb902bd2b40 Jan 19 06:45:40.895: INFO: Node Info: &Node{ObjectMeta:{i-0fd7dedb902bd2b40 dcd1c2b0-c939-4b06-86d9-faa66cbd5f62 20771 0 2023-01-19 06:25:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fd7dedb902bd2b40 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0fd7dedb902bd2b40 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.15 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd7dedb902bd2b40"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:45:27 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:45:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0fd7dedb902bd2b40,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:45:27 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:45:27 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:45:27 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:45:27 +0000 UTC,LastTransitionTime:2023-01-19 06:25:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.15,},NodeAddress{Type:ExternalIP,Address:13.36.168.174,},NodeAddress{Type:InternalDNS,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-168-174.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2507f02fe9694e6687a10a99b81476,SystemUUID:ec2507f0-2fe9-694e-6687-a10a99b81476,BootID:4e2ef5d6-9152-47a6-9581-43ae00972132,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-046138a1832bcff2c kubernetes.io/csi/ebs.csi.aws.com^vol-049dd3d103a06d67a kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-046138a1832bcff2c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-049dd3d103a06d67a,DevicePath:,},},Config:nil,},} Jan 19 06:45:40.895: INFO: Logging kubelet events for node i-0fd7dedb902bd2b40 Jan 19 06:45:41.009: INFO: Logging pods the kubelet thinks is on node i-0fd7dedb902bd2b40 Jan 19 06:45:41.121: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-hkwbn started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:41.121: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-45qq2 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:41.121: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jk9pc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:41.121: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-q5n4f started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:41.121: INFO: local-injector started at 2023-01-19 06:43:33 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container local-injector ready: false, restart count 0 Jan 19 06:45:41.121: INFO: svc-latency-rc-ntcm2 started at 2023-01-19 06:45:12 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container svc-latency-rc ready: false, restart count 0 Jan 19 06:45:41.121: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-ltgrx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:41.121: INFO: cilium-2rqdw started at 2023-01-19 06:25:34 +0000 UTC (1+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 06:45:41.121: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 06:45:41.121: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gmz6h started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:41.121: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-qz8nr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:45:41.121: INFO: ebs-csi-node-x9tpg started at 2023-01-19 06:25:34 +0000 UTC (0+3 container statuses recorded) Jan 19 06:45:41.121: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:45:41.121: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:45:41.121: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 06:45:41.121: INFO: inline-volume-tester-gt9hf started at 2023-01-19 06:34:10 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container csi-volume-tester ready: true, restart count 0 Jan 19 06:45:41.121: INFO: suspend-true-to-false-28mnz started at 2023-01-19 06:45:20 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container c ready: false, restart count 0 Jan 19 06:45:41.121: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-6294b started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:45:41.121: INFO: ss-1 started at 2023-01-19 06:36:13 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container webserver ready: false, restart count 0 Jan 19 06:45:41.121: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-58rnf started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:41.121: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-fc8jt started at 2023-01-19 06:34:27 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:45:41.121: INFO: inline-volume-tester-mf6q7 started at 2023-01-19 06:34:58 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container csi-volume-tester ready: true, restart count 0 Jan 19 06:45:41.121: INFO: netserver-3 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container webserver ready: true, restart count 0 Jan 19 06:45:41.121: INFO: netserver-3 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container webserver ready: true, restart count 0 Jan 19 06:45:41.121: INFO: hostexec-i-0fd7dedb902bd2b40-dt4lf started at 2023-01-19 06:43:18 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 06:45:41.121: INFO: netserver-3 started at 2023-01-19 06:44:52 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container webserver ready: false, restart count 0 Jan 19 06:45:41.121: INFO: ss2-1 started at 2023-01-19 06:35:55 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container webserver ready: false, restart count 0 Jan 19 06:45:41.121: INFO: host-test-container-pod started at 2023-01-19 06:40:31 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 06:45:41.121: INFO: pod-configmaps-fb00828b-4125-4ac8-bc2d-5e68cec882a3 started at 2023-01-19 06:41:19 +0000 UTC (0+1 container statuses recorded) Jan 19 06:45:41.121: INFO: Container agnhost-container ready: false, restart count 0 Jan 19 06:45:41.543: INFO: Latency metrics for node i-0fd7dedb902bd2b40 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "volume-expand-5183" for this suite. �[38;5;243m01/19/23 06:45:41.543�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(Always\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\snew\spod\sfsgroup\sapplied\sto\svolume\scontents$'
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0019f6f00, 0xc001187e10, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 06:34:41.108�[0m
Jan 19 06:34:41.109: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename fsgroupchangepolicy �[38;5;243m01/19/23 06:34:41.11�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 06:34:41.424�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 06:34:41.631�[0m
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/metrics/init/init.go:31
[It] (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
test/e2e/storage/testsuites/fsgroupchangepolicy.go:210
Jan 19 06:34:41.840: INFO: Creating resource for dynamic PV
Jan 19 06:34:41.840: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass fsgroupchangepolicy-3423-e2e-sc2j42g �[38;5;243m01/19/23 06:34:41.841�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/19/23 06:34:41.946�[0m
Jan 19 06:34:41.946: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-3423 with fsgroup 1000 �[38;5;243m01/19/23 06:34:42.158�[0m
Jan 19 06:34:42.265: INFO: Waiting up to 5m0s for pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab" in namespace "fsgroupchangepolicy-3423" to be "running"
Jan 19 06:34:42.369: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 104.201816ms
Jan 19 06:34:44.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209126881s
Jan 19 06:34:46.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4.208602735s
Jan 19 06:34:48.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 6.208981491s
Jan 19 06:34:50.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 8.208645247s
Jan 19 06:34:52.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 10.209547099s
Jan 19 06:34:54.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 12.209008823s
Jan 19 06:34:56.476: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 14.211092065s
Jan 19 06:34:58.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 16.209993894s
Jan 19 06:35:00.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 18.209166738s
Jan 19 06:35:02.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 20.209579707s
Jan 19 06:35:04.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 22.20963744s
Jan 19 06:35:06.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 24.209457138s
Jan 19 06:35:08.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 26.209760171s
Jan 19 06:35:10.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 28.209473544s
Jan 19 06:35:12.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 30.209380839s
Jan 19 06:35:14.477: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 32.211637019s
Jan 19 06:35:16.476: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 34.210641032s
Jan 19 06:35:18.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 36.208887301s
Jan 19 06:35:20.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 38.209855586s
Jan 19 06:35:22.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 40.21000095s
Jan 19 06:35:24.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 42.209468053s
Jan 19 06:35:26.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 44.209701666s
Jan 19 06:35:28.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 46.209731861s
Jan 19 06:35:30.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 48.209719558s
Jan 19 06:35:32.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 50.209095122s
Jan 19 06:35:34.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 52.20877388s
Jan 19 06:35:36.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 54.209290382s
Jan 19 06:35:38.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 56.209241985s
Jan 19 06:35:40.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 58.209538562s
Jan 19 06:35:42.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.209425159s
Jan 19 06:35:44.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.20888178s
Jan 19 06:35:46.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.209019432s
Jan 19 06:35:48.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.209048338s
Jan 19 06:35:50.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.209216693s
Jan 19 06:35:52.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.209147756s
Jan 19 06:35:54.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.208978919s
Jan 19 06:35:56.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.209011929s
Jan 19 06:35:58.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.208922667s
Jan 19 06:36:00.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.209454209s
Jan 19 06:36:02.477: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.211786807s
Jan 19 06:36:04.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.209676157s
Jan 19 06:36:06.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.20980789s
Jan 19 06:36:08.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.210028651s
Jan 19 06:36:10.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.209744895s
Jan 19 06:36:12.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.209170346s
Jan 19 06:36:14.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.20891881s
Jan 19 06:36:16.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.209095426s
Jan 19 06:36:18.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.209482714s
Jan 19 06:36:20.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.209832663s
Jan 19 06:36:22.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.209142764s
Jan 19 06:36:24.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.20920959s
Jan 19 06:36:26.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.209027896s
Jan 19 06:36:28.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.20904956s
Jan 19 06:36:30.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.209400796s
Jan 19 06:36:32.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.209581278s
Jan 19 06:36:34.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.20898297s
Jan 19 06:36:36.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.209447993s
Jan 19 06:36:38.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.208897567s
Jan 19 06:36:40.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.208984098s
Jan 19 06:36:42.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.210132645s
Jan 19 06:36:44.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.208932653s
Jan 19 06:36:46.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.209069234s
Jan 19 06:36:48.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.209104344s
Jan 19 06:36:50.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.208980964s
Jan 19 06:36:52.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.209014587s
Jan 19 06:36:54.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.209119898s
Jan 19 06:36:56.479: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.213778132s
Jan 19 06:36:58.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.208819126s
Jan 19 06:37:00.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.209921926s
Jan 19 06:37:02.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.209162644s
Jan 19 06:37:04.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.208985121s
Jan 19 06:37:06.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.209145894s
Jan 19 06:37:08.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.209488065s
Jan 19 06:37:10.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.209495229s
Jan 19 06:37:12.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.209050084s
Jan 19 06:37:14.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.208578588s
Jan 19 06:37:16.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.208971201s
Jan 19 06:37:18.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.208909955s
Jan 19 06:37:20.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.209145649s
Jan 19 06:37:22.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.208988826s
Jan 19 06:37:24.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.208847534s
Jan 19 06:37:26.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.208956731s
Jan 19 06:37:28.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.208692584s
Jan 19 06:37:30.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.209730199s
Jan 19 06:37:32.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.209126089s
Jan 19 06:37:34.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.209128646s
Jan 19 06:37:36.477: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.2122097s
Jan 19 06:37:38.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.208625693s
Jan 19 06:37:40.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.209721302s
Jan 19 06:37:42.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.209028856s
Jan 19 06:37:44.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.209654103s
Jan 19 06:37:46.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.208793138s
Jan 19 06:37:48.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.209109941s
Jan 19 06:37:50.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.209100894s
Jan 19 06:37:52.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.208995637s
Jan 19 06:37:54.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.208837508s
Jan 19 06:37:56.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.208960893s
Jan 19 06:37:58.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.208884394s
Jan 19 06:38:00.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.209408641s
Jan 19 06:38:02.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.209326811s
Jan 19 06:38:04.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.209255867s
Jan 19 06:38:06.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.209006139s
Jan 19 06:38:08.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.209869669s
Jan 19 06:38:10.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.209255634s
Jan 19 06:38:12.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.209276431s
Jan 19 06:38:14.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.209747228s
Jan 19 06:38:16.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.209010227s
Jan 19 06:38:18.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.208681794s
Jan 19 06:38:20.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.209395823s
Jan 19 06:38:22.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.208779063s
Jan 19 06:38:24.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.209251079s
Jan 19 06:38:26.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.208789958s
Jan 19 06:38:28.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.209042418s
Jan 19 06:38:30.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.208964378s
Jan 19 06:38:32.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.209457999s
Jan 19 06:38:34.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.208808641s
Jan 19 06:38:36.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.208848206s
Jan 19 06:38:38.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.20877635s
Jan 19 06:38:40.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.209459515s
Jan 19 06:38:42.478: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.213216579s
Jan 19 06:38:44.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.208658845s
Jan 19 06:38:46.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.208491985s
Jan 19 06:38:48.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.208491244s
Jan 19 06:38:50.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.208480531s
Jan 19 06:38:52.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.209711801s
Jan 19 06:38:54.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.20863987s
Jan 19 06:38:56.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.208410493s
Jan 19 06:38:58.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.208825852s
Jan 19 06:39:00.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.208930979s
Jan 19 06:39:02.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.20918877s
Jan 19 06:39:04.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.209778401s
Jan 19 06:39:06.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.209236076s
Jan 19 06:39:08.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.208491444s
Jan 19 06:39:10.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.208835302s
Jan 19 06:39:12.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.208341115s
Jan 19 06:39:14.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.20838271s
Jan 19 06:39:16.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.208900672s
Jan 19 06:39:18.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.208540481s
Jan 19 06:39:20.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.20902506s
Jan 19 06:39:22.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.209497567s
Jan 19 06:39:24.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.208399677s
Jan 19 06:39:26.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.209070889s
Jan 19 06:39:28.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.20892045s
Jan 19 06:39:30.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.208975522s
Jan 19 06:39:32.475: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.209344717s
Jan 19 06:39:34.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.209041513s
Jan 19 06:39:36.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.208788516s
Jan 19 06:39:38.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.208352031s
Jan 19 06:39:40.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.208787875s
Jan 19 06:39:42.474: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.208530733s
Jan 19 06:39:42.578: INFO: Pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.312388067s
Jan 19 06:39:42.578: INFO: Unexpected error:
<*errors.errorString | 0xc0018fd600>: {
s: "pod \"pod-80d67e58-24ea-4871-866e-0ef63ad77eab\" is not Running: timed out while waiting for pod fsgroupchangepolicy-3423/pod-80d67e58-24ea-4871-866e-0ef63ad77eab to be running",
}
Jan 19 06:39:42.578: FAIL: pod "pod-80d67e58-24ea-4871-866e-0ef63ad77eab" is not Running: timed out while waiting for pod fsgroupchangepolicy-3423/pod-80d67e58-24ea-4871-866e-0ef63ad77eab to be running
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0019f6f00, 0xc001187e10, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/19/23 06:39:42.578�[0m
Jan 19 06:39:42.785: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comnctl2"
Jan 19 06:39:42.890: INFO: Waiting up to 5m0s for PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 to get deleted
Jan 19 06:39:42.994: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (103.787173ms)
Jan 19 06:39:48.098: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (5.20816252s)
Jan 19 06:39:53.203: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (10.313149087s)
Jan 19 06:39:58.308: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (15.417932823s)
Jan 19 06:40:03.413: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (20.523316525s)
Jan 19 06:40:08.518: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (25.627620288s)
Jan 19 06:40:13.622: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (30.731639791s)
Jan 19 06:40:18.726: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (35.835756078s)
Jan 19 06:40:23.830: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (40.94001873s)
Jan 19 06:40:28.935: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (46.044901508s)
Jan 19 06:40:34.040: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (51.149985726s)
Jan 19 06:40:39.145: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (56.255323958s)
Jan 19 06:40:44.251: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m1.361243241s)
Jan 19 06:40:49.358: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m6.467501276s)
Jan 19 06:40:54.463: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m11.573063518s)
Jan 19 06:40:59.569: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m16.678774013s)
Jan 19 06:41:04.674: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m21.783849459s)
Jan 19 06:41:09.780: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m26.889908067s)
Jan 19 06:41:14.885: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m31.995207771s)
Jan 19 06:41:19.991: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m37.10062154s)
Jan 19 06:41:25.096: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m42.206379687s)
Jan 19 06:41:30.202: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m47.312275713s)
Jan 19 06:41:35.309: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m52.41855334s)
Jan 19 06:41:40.414: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (1m57.523997594s)
Jan 19 06:41:45.519: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m2.629093939s)
Jan 19 06:41:50.625: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m7.73483234s)
Jan 19 06:41:55.730: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m12.840384999s)
Jan 19 06:42:00.837: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m17.946560556s)
Jan 19 06:42:05.943: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m23.052734436s)
Jan 19 06:42:11.049: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m28.158877812s)
Jan 19 06:42:16.155: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m33.26450355s)
Jan 19 06:42:21.260: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m38.369578961s)
Jan 19 06:42:26.365: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m43.474574441s)
Jan 19 06:42:31.470: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m48.580080313s)
Jan 19 06:42:36.575: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m53.685425267s)
Jan 19 06:42:41.681: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (2m58.791239262s)
Jan 19 06:42:46.786: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (3m3.896234628s)
Jan 19 06:42:51.891: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (3m9.001360943s)
Jan 19 06:42:56.998: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (3m14.107689052s)
Jan 19 06:43:02.103: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (3m19.213173092s)
Jan 19 06:43:07.209: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (3m24.319337091s)
Jan 19 06:43:12.315: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (3m29.425172698s)
Jan 19 06:43:17.420: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (3m34.530240539s)
Jan 19 06:43:22.526: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (3m39.635854097s)
Jan 19 06:43:27.632: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (3m44.741622953s)
Jan 19 06:43:32.737: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (3m49.846751336s)
Jan 19 06:43:37.842: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (3m54.952266242s)
Jan 19 06:43:42.948: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m0.057973065s)
Jan 19 06:43:48.054: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m5.163751205s)
Jan 19 06:43:53.160: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m10.269866785s)
Jan 19 06:43:58.266: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m15.37600165s)
Jan 19 06:44:03.372: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m20.482217086s)
Jan 19 06:44:08.486: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m25.596199257s)
Jan 19 06:44:13.592: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m30.702000856s)
Jan 19 06:44:18.698: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m35.808255128s)
Jan 19 06:44:23.804: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m40.913945065s)
Jan 19 06:44:28.910: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m46.019856794s)
Jan 19 06:44:34.015: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m51.12519919s)
Jan 19 06:44:39.121: INFO: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 found and phase=Bound (4m56.230814378s)
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/19/23 06:44:44.121�[0m
Jan 19 06:44:44.228: INFO: Unexpected error: while cleanup resource:
<errors.aggregate | len:1, cap:1>: [
<errors.aggregate | len:1, cap:1>[
<*fmt.wrapError | 0xc000e3c0a0>{
msg: "persistent Volume pvc-52caaa2b-257d-420e-a34b-6c454f814091 not deleted by dynamic provisioner: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 still exists within 5m0s",
err: <*errors.errorString | 0xc0019101d0>{
s: "PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 still exists within 5m0s",
},
},
],
]
Jan 19 06:44:44.228: FAIL: while cleanup resource: persistent Volume pvc-52caaa2b-257d-420e-a34b-6c454f814091 not deleted by dynamic provisioner: PersistentVolume pvc-52caaa2b-257d-420e-a34b-6c454f814091 still exists within 5m0s
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:128 +0x14e
panic({0x70efe60, 0xc00041db90})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/test/e2e/framework.Fail({0xc00018a4d0, 0xae}, {0xc001c4dc30?, 0xc00018a4d0?, 0xc001c4dc58?})
test/e2e/framework/log.go:61 +0x145
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7fa8f20, 0xc0018fd600}, {0x0?, 0x2?, 0x7f41b8377f18?})
test/e2e/framework/expect.go:76 +0x267
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
test/e2e/framework/expect.go:43
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0019f6f00, 0xc001187e10, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/node/init/init.go:32
Jan 19 06:44:44.228: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 06:44:44.334�[0m
�[1mSTEP:�[0m Collecting events from namespace "fsgroupchangepolicy-3423". �[38;5;243m01/19/23 06:44:44.334�[0m
�[1mSTEP:�[0m Found 19 events. �[38;5;243m01/19/23 06:44:44.44�[0m
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:34:41 +0000 UTC - event for ebs.csi.aws.comnctl2: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:34:42 +0000 UTC - event for ebs.csi.aws.comnctl2: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:34:42 +0000 UTC - event for ebs.csi.aws.comnctl2: {ebs.csi.aws.com_i-0adb67e64e3ebad1e_cac02643-ef8c-47c9-901a-4f0e56d2fe3d } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-3423/ebs.csi.aws.comnctl2"
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:34:45 +0000 UTC - event for ebs.csi.aws.comnctl2: {ebs.csi.aws.com_i-0adb67e64e3ebad1e_cac02643-ef8c-47c9-901a-4f0e56d2fe3d } ProvisioningSucceeded: Successfully provisioned volume pvc-52caaa2b-257d-420e-a34b-6c454f814091
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:34:46 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {default-scheduler } Scheduled: Successfully assigned fsgroupchangepolicy-3423/pod-80d67e58-24ea-4871-866e-0ef63ad77eab to i-0fd7dedb902bd2b40
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:34:48 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-52caaa2b-257d-420e-a34b-6c454f814091"
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:34:55 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d7cd3d1cf50111299337bceccc468ca420bfc72e17a75d486d843cab45169a48": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:35:09 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ef441ff050b2979c1cf2696a115fb99d95f31f13312a94e446cbd2a285a4a6ea": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:35:24 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d5d1f4435ccfdb1da6cce5f3a8087be6e40f4c2a6ac16ae793ddd19c0f20ad1e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:35:37 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f0d02d6df7aae52826e2ac5cc0bee70b30009e32069adeaa64c6b216973a1d27": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:35:51 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a98506cb111c16f7a03b363efdf17b65027f9b03f26bf2b4186ce4c44e450da2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:36:06 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c1ac7e71b2f2010106f28a60b65d3a7df8950ffd97dcb0b7c351c2e7cdfb149a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:36:19 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "02bfddc93c5fb95305bd8bdf63ae0c053e6211ecd5e004f8db0706747e4e6cbd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:36:30 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cf2cc55f36031e410f05b344e7661ba045aa361e03b89e83941d371789418cfe": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:36:42 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a82355e41816e4d425f459db7aadc0806df2f7f3689a989ec184a3c8b4d3ed2c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:36:57 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "41795bedd3ee888ed2ec69c69b73c47add00dde8e5e5a2a3ee421244e0d11c7c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:40:08 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:40:08 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} Created: Created container write-pod
Jan 19 06:44:44.440: INFO: At 2023-01-19 06:40:08 +0000 UTC - event for pod-80d67e58-24ea-4871-866e-0ef63ad77eab: {kubelet i-0fd7dedb902bd2b40} Started: Started container write-pod
Jan 19 06:44:44.545: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 19 06:44:44.545: INFO: pod-80d67e58-24ea-4871-866e-0ef63ad77eab i-0fd7dedb902bd2b40 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:34:46 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:40:08 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:40:08 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:34:46 +0000 UTC }]
Jan 19 06:44:44.545: INFO:
Jan 19 06:44:44.758: INFO:
Logging node info for node i-01c8a84101e2eeddc
Jan 19 06:44:44.863: INFO: Node Info: &Node{ObjectMeta:{i-01c8a84101e2eeddc de952a6e-ca42-4dc7-9079-e5f5df729733 19350 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01c8a84101e2eeddc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-01c8a84101e2eeddc topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.49 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01c8a84101e2eeddc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:40:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-01c8a84101e2eeddc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.49,},NodeAddress{Type:ExternalIP,Address:15.188.127.11,},NodeAddress{Type:InternalDNS,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-188-127-11.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d066c25678610b99acde89c731a76,SystemUUID:ec2d066c-2567-8610-b99a-cde89c731a76,BootID:3983005e-c9f1-4922-bf79-f80a745c9c94,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:44:44.863: INFO:
Logging kubelet events for node i-01c8a84101e2eeddc
Jan 19 06:44:44.970: INFO:
Logging pods the kubelet thinks is on node i-01c8a84101e2eeddc
Jan 19 06:44:45.082: INFO: csi-hostpathplugin-0 started at 2023-01-19 06:40:21 +0000 UTC (0+7 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 06:44:45.082: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 06:44:45.082: INFO: Container csi-resizer ready: false, restart count 0
Jan 19 06:44:45.082: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 19 06:44:45.082: INFO: Container hostpath ready: false, restart count 0
Jan 19 06:44:45.082: INFO: Container liveness-probe ready: false, restart count 0
Jan 19 06:44:45.082: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 19 06:44:45.082: INFO: cilium-kt55x started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:44:45.082: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:44:45.082: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-5f725 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.082: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jngrg started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.082: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4nj84 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.082: INFO: coredns-559769c974-mjt6q started at 2023-01-19 06:26:14 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container coredns ready: true, restart count 0
Jan 19 06:44:45.082: INFO: netserver-0 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container webserver ready: true, restart count 0
Jan 19 06:44:45.082: INFO: pod-handle-http-request started at 2023-01-19 06:39:46 +0000 UTC (0+2 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container container-handle-http-request ready: false, restart count 0
Jan 19 06:44:45.082: INFO: Container container-handle-https-request ready: false, restart count 0
Jan 19 06:44:45.082: INFO: netserver-0 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container webserver ready: true, restart count 0
Jan 19 06:44:45.082: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-dnqqv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.082: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gzbxm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.082: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jlhlb started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.082: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vrmzk started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.082: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-nkg9j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.082: INFO: test-rs-d95wt started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container httpd ready: false, restart count 0
Jan 19 06:44:45.082: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-87z7m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.082: INFO: ebs-csi-node-52j6r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:44:45.082: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:44:45.082: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:44:45.082: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-d82dm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.082: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:44:45.520: INFO:
Latency metrics for node i-01c8a84101e2eeddc
Jan 19 06:44:45.520: INFO:
Logging node info for node i-02873c346fcadbca8
Jan 19 06:44:45.625: INFO: Node Info: &Node{ObjectMeta:{i-02873c346fcadbca8 b6b38d81-4c4f-47c3-8a5d-ac5718bb26a8 19646 0 2023-01-19 06:25:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02873c346fcadbca8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-02873c346fcadbca8 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-02873c346fcadbca8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:41:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:41:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-02873c346fcadbca8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:25:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.215,},NodeAddress{Type:ExternalIP,Address:13.36.173.220,},NodeAddress{Type:InternalDNS,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-173-220.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21b61f75acfaf0e7a5fc97a7aea262,SystemUUID:ec21b61f-75ac-faf0-e7a5-fc97a7aea262,BootID:48642020-5fc8-4238-bbe3-8b854e5d773e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0193d14c5ce38dc18 kubernetes.io/csi/ebs.csi.aws.com^vol-05aeca504bceab9e0 kubernetes.io/csi/ebs.csi.aws.com^vol-073136eb24d038f22 kubernetes.io/csi/ebs.csi.aws.com^vol-0d1d97df9e92f7db0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d1d97df9e92f7db0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0193d14c5ce38dc18,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-073136eb24d038f22,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05aeca504bceab9e0,DevicePath:,},},Config:nil,},}
Jan 19 06:44:45.626: INFO:
Logging kubelet events for node i-02873c346fcadbca8
Jan 19 06:44:45.739: INFO:
Logging pods the kubelet thinks is on node i-02873c346fcadbca8
Jan 19 06:44:45.856: INFO: test-pod-09b898ed-1e72-4b3d-b642-09c68ee1bf30 started at 2023-01-19 06:39:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container agnhost-container ready: false, restart count 0
Jan 19 06:44:45.856: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-f8gmr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.856: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cfrb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:44:45.856: INFO: image-pull-test02c0aac0-7d46-4614-aed4-ccfac5eaff6b started at 2023-01-19 06:39:56 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container image-pull-test ready: false, restart count 0
Jan 19 06:44:45.856: INFO: ss2-0 started at 2023-01-19 06:36:00 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container webserver ready: false, restart count 0
Jan 19 06:44:45.856: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-r8467 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.856: INFO: netserver-1 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container webserver ready: true, restart count 0
Jan 19 06:44:45.856: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wchfw started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.856: INFO: cilium-4hjl8 started at 2023-01-19 06:25:37 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:44:45.856: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:44:45.856: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zgw5r started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.856: INFO: test-container-pod started at 2023-01-19 06:40:31 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container webserver ready: false, restart count 0
Jan 19 06:44:45.856: INFO: netserver-1 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container webserver ready: true, restart count 0
Jan 19 06:44:45.856: INFO: test-rs-rw2w8 started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container httpd ready: false, restart count 0
Jan 19 06:44:45.856: INFO: inline-volume-tester2-fmh9p started at 2023-01-19 06:34:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 06:44:45.856: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-s952s started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.856: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wjgz6 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.856: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jn8lv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.856: INFO: ss-0 started at 2023-01-19 06:37:53 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container webserver ready: false, restart count 0
Jan 19 06:44:45.856: INFO: ebs-csi-node-xwsp8 started at 2023-01-19 06:25:37 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:44:45.856: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:44:45.856: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:44:45.856: INFO: dns-test-fadfdcc5-9b43-4b60-9746-a0f540f8d334 started at 2023-01-19 06:41:23 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container jessie-querier ready: false, restart count 0
Jan 19 06:44:45.856: INFO: Container querier ready: false, restart count 0
Jan 19 06:44:45.856: INFO: Container webserver ready: false, restart count 0
Jan 19 06:44:45.856: INFO: ss-0 started at 2023-01-19 06:35:01 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container webserver ready: true, restart count 0
Jan 19 06:44:45.856: INFO: ss2-0 started at 2023-01-19 06:35:54 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container webserver ready: true, restart count 0
Jan 19 06:44:45.856: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cck5q started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:45.856: INFO: inline-volume-tester-4kbtk started at 2023-01-19 06:41:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 06:44:45.856: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-bs995 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:45.856: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:44:46.274: INFO:
Latency metrics for node i-02873c346fcadbca8
Jan 19 06:44:46.274: INFO:
Logging node info for node i-0adb67e64e3ebad1e
Jan 19 06:44:46.379: INFO: Node Info: &Node{ObjectMeta:{i-0adb67e64e3ebad1e cf261699-b36b-4a3b-a17d-96421c0d524f 19649 0 2023-01-19 06:23:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0adb67e64e3ebad1e kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3a topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.62.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0adb67e64e3ebad1e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 06:23:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:24:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {protokube Update v1 2023-01-19 06:24:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 06:41:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0adb67e64e3ebad1e,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:41:37 +0000 UTC,LastTransitionTime:2023-01-19 06:24:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.172,},NodeAddress{Type:ExternalIP,Address:13.38.71.8,},NodeAddress{Type:InternalDNS,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-71-8.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2403e255bd6f24debe308a9c68029e,SystemUUID:ec2403e2-55bd-6f24-debe-308a9c68029e,BootID:7912dda1-10e2-4946-a373-bb76d21b3786,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43629447,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42792174,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965798,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:44:46.379: INFO:
Logging kubelet events for node i-0adb67e64e3ebad1e
Jan 19 06:44:46.486: INFO:
Logging pods the kubelet thinks is on node i-0adb67e64e3ebad1e
Jan 19 06:44:46.597: INFO: ebs-csi-controller-5bd98b456f-bt645 started at 2023-01-19 06:24:13 +0000 UTC (0+5 container statuses recorded)
Jan 19 06:44:46.597: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:44:46.597: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 06:44:46.597: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 06:44:46.597: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:44:46.597: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:44:46.597: INFO: dns-controller-69987775c6-q62qz started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:46.597: INFO: Container dns-controller ready: true, restart count 0
Jan 19 06:44:46.597: INFO: aws-cloud-controller-manager-8rq4f started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:46.597: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 19 06:44:46.597: INFO: etcd-manager-events-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:46.597: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 06:44:46.597: INFO: etcd-manager-main-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:46.597: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 06:44:46.597: INFO: kube-apiserver-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+2 container statuses recorded)
Jan 19 06:44:46.597: INFO: Container healthcheck ready: true, restart count 0
Jan 19 06:44:46.597: INFO: Container kube-apiserver ready: true, restart count 1
Jan 19 06:44:46.597: INFO: cilium-29vk6 started at 2023-01-19 06:24:01 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:44:46.597: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:44:46.597: INFO: Container cilium-agent ready: true, restart count 1
Jan 19 06:44:46.597: INFO: kops-controller-gwm5z started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:46.597: INFO: Container kops-controller ready: true, restart count 0
Jan 19 06:44:46.597: INFO: kube-controller-manager-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:46.597: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 19 06:44:46.597: INFO: kube-scheduler-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:46.597: INFO: Container kube-scheduler ready: true, restart count 0
Jan 19 06:44:46.597: INFO: ebs-csi-node-z9pw9 started at 2023-01-19 06:24:10 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:44:46.597: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:44:46.597: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:44:46.597: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:44:46.597: INFO: cilium-operator-5dd44dc49f-pc5mf started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:46.597: INFO: Container cilium-operator ready: true, restart count 1
Jan 19 06:44:46.973: INFO:
Latency metrics for node i-0adb67e64e3ebad1e
Jan 19 06:44:46.973: INFO:
Logging node info for node i-0bc9010b80d8fb7a3
Jan 19 06:44:47.078: INFO: Node Info: &Node{ObjectMeta:{i-0bc9010b80d8fb7a3 a233aec6-3e3a-474b-9d9b-37e112ada5dd 18849 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bc9010b80d8fb7a3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0bc9010b80d8fb7a3 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.13 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bc9010b80d8fb7a3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:40:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0bc9010b80d8fb7a3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.13,},NodeAddress{Type:ExternalIP,Address:15.236.218.34,},NodeAddress{Type:InternalDNS,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-218-34.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ede8175f1d6ab673e885453491f40,SystemUUID:ec2ede81-75f1-d6ab-673e-885453491f40,BootID:d8c02e70-1290-450f-9b63-595e3f9877b7,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:44:47.078: INFO:
Logging kubelet events for node i-0bc9010b80d8fb7a3
Jan 19 06:44:47.186: INFO:
Logging pods the kubelet thinks is on node i-0bc9010b80d8fb7a3
Jan 19 06:44:47.297: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vk25m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:47.297: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kwxms started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:44:47.297: INFO: cilium-4db85 started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:44:47.297: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:44:47.297: INFO: fail-once-non-local-j5lgj started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container c ready: false, restart count 0
Jan 19 06:44:47.297: INFO: csi-mockplugin-0 started at 2023-01-19 06:41:22 +0000 UTC (0+4 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container busybox ready: false, restart count 0
Jan 19 06:44:47.297: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 06:44:47.297: INFO: Container driver-registrar ready: false, restart count 0
Jan 19 06:44:47.297: INFO: Container mock ready: false, restart count 0
Jan 19 06:44:47.297: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-w9vxz started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:47.297: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wc82j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:47.297: INFO: coredns-autoscaler-7cb5c5b969-l9mxh started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container autoscaler ready: true, restart count 0
Jan 19 06:44:47.297: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-lgvhj started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:47.297: INFO: netserver-2 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container webserver ready: true, restart count 0
Jan 19 06:44:47.297: INFO: netserver-2 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container webserver ready: false, restart count 0
Jan 19 06:44:47.297: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-rw8m5 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:47.297: INFO: coredns-559769c974-rfs6h started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container coredns ready: true, restart count 0
Jan 19 06:44:47.297: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-n5thx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:47.297: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zdvsc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:47.297: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4jfb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:47.297: INFO: pod-secrets-97b423cb-db9a-4eb1-a66a-95f0f3c3d055 started at 2023-01-19 06:40:08 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container secret-volume-test ready: false, restart count 0
Jan 19 06:44:47.297: INFO: fail-once-non-local-sp8qx started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container c ready: false, restart count 0
Jan 19 06:44:47.297: INFO: ebs-csi-node-p7m8r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:44:47.297: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:44:47.297: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:44:47.297: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kvlh9 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:47.297: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:47.776: INFO:
Latency metrics for node i-0bc9010b80d8fb7a3
Jan 19 06:44:47.776: INFO:
Logging node info for node i-0fd7dedb902bd2b40
Jan 19 06:44:47.882: INFO: Node Info: &Node{ObjectMeta:{i-0fd7dedb902bd2b40 dcd1c2b0-c939-4b06-86d9-faa66cbd5f62 19268 0 2023-01-19 06:25:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fd7dedb902bd2b40 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0fd7dedb902bd2b40 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.15 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd7dedb902bd2b40"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:40:25 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:40:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0fd7dedb902bd2b40,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.15,},NodeAddress{Type:ExternalIP,Address:13.36.168.174,},NodeAddress{Type:InternalDNS,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-168-174.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2507f02fe9694e6687a10a99b81476,SystemUUID:ec2507f0-2fe9-694e-6687-a10a99b81476,BootID:4e2ef5d6-9152-47a6-9581-43ae00972132,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0434bfb8d414b168a kubernetes.io/csi/ebs.csi.aws.com^vol-046138a1832bcff2c kubernetes.io/csi/ebs.csi.aws.com^vol-049dd3d103a06d67a kubernetes.io/csi/ebs.csi.aws.com^vol-06c6dac4c8bb96bd4 kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-046138a1832bcff2c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06c6dac4c8bb96bd4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-049dd3d103a06d67a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0434bfb8d414b168a,DevicePath:,},},Config:nil,},}
Jan 19 06:44:47.882: INFO:
Logging kubelet events for node i-0fd7dedb902bd2b40
Jan 19 06:44:47.989: INFO:
Logging pods the kubelet thinks is on node i-0fd7dedb902bd2b40
Jan 19 06:44:48.102: INFO: pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6 started at 2023-01-19 06:40:22 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container write-pod ready: false, restart count 0
Jan 19 06:44:48.102: INFO: host-test-container-pod started at 2023-01-19 06:40:31 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:44:48.102: INFO: pod-configmaps-fb00828b-4125-4ac8-bc2d-5e68cec882a3 started at 2023-01-19 06:41:19 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container agnhost-container ready: false, restart count 0
Jan 19 06:44:48.102: INFO: ss2-1 started at 2023-01-19 06:35:55 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container webserver ready: false, restart count 0
Jan 19 06:44:48.102: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-45qq2 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:48.102: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-hkwbn started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:48.102: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-q5n4f started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:48.102: INFO: local-injector started at 2023-01-19 06:43:33 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container local-injector ready: false, restart count 0
Jan 19 06:44:48.102: INFO: pod-80d67e58-24ea-4871-866e-0ef63ad77eab started at 2023-01-19 06:34:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container write-pod ready: true, restart count 0
Jan 19 06:44:48.102: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jk9pc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:48.102: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-ltgrx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:48.102: INFO: pod-3425cf74-675f-4345-8eb8-e79b1612a826 started at 2023-01-19 06:40:49 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container write-pod ready: false, restart count 0
Jan 19 06:44:48.102: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gmz6h started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:48.102: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-qz8nr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:44:48.102: INFO: hostexec-i-0fd7dedb902bd2b40-jbp89 started at 2023-01-19 06:40:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:44:48.102: INFO: cilium-2rqdw started at 2023-01-19 06:25:34 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:44:48.102: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:44:48.102: INFO: inline-volume-tester-gt9hf started at 2023-01-19 06:34:10 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 19 06:44:48.102: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-6294b started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:44:48.102: INFO: ebs-csi-node-x9tpg started at 2023-01-19 06:25:34 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:44:48.102: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:44:48.102: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:44:48.102: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-fc8jt started at 2023-01-19 06:34:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:44:48.102: INFO: test-rs-h6zjm started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container httpd ready: true, restart count 0
Jan 19 06:44:48.102: INFO: inline-volume-tester-mf6q7 started at 2023-01-19 06:34:58 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 06:44:48.102: INFO: netserver-3 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container webserver ready: true, restart count 0
Jan 19 06:44:48.102: INFO: pod-5fe5d883-aba6-47a1-b382-4b599d48def7 started at 2023-01-19 06:44:36 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container test-container ready: false, restart count 0
Jan 19 06:44:48.102: INFO: ss-1 started at 2023-01-19 06:36:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container webserver ready: false, restart count 0
Jan 19 06:44:48.102: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-58rnf started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:44:48.102: INFO: hostexec-i-0fd7dedb902bd2b40-dt4lf started at 2023-01-19 06:43:18 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:44:48.102: INFO: netserver-3 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:44:48.102: INFO: Container webserver ready: true, restart count 0
Jan 19 06:44:48.701: INFO:
Latency metrics for node i-0fd7dedb902bd2b40
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "fsgroupchangepolicy-3423" for this suite. �[38;5;243m01/19/23 06:44:48.701�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(OnRootMismatch\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\snew\spod\sfsgroup\sapplied\sto\svolume\scontents$'
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc000c50f00, 0xc004361e10, 0x0, {0xc0055a53f8, 0x4}, {0xc0055a53fc, 0x4})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:247 +0x556
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 06:45:41.656�[0m
Jan 19 06:45:41.656: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename fsgroupchangepolicy �[38;5;243m01/19/23 06:45:41.657�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 06:45:41.975�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 06:45:42.185�[0m
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/metrics/init/init.go:31
[It] (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
test/e2e/storage/testsuites/fsgroupchangepolicy.go:210
Jan 19 06:45:42.393: INFO: Creating resource for dynamic PV
Jan 19 06:45:42.393: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass fsgroupchangepolicy-35-e2e-sc5cs89 �[38;5;243m01/19/23 06:45:42.394�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/19/23 06:45:42.504�[0m
Jan 19 06:45:42.505: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-35 with fsgroup 1000 �[38;5;243m01/19/23 06:45:42.715�[0m
Jan 19 06:45:42.823: INFO: Waiting up to 5m0s for pod "pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a" in namespace "fsgroupchangepolicy-35" to be "running"
Jan 19 06:45:42.930: INFO: Pod "pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a": Phase="Pending", Reason="", readiness=false. Elapsed: 106.365031ms
Jan 19 06:45:45.034: INFO: Pod "pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.211299029s
Jan 19 06:45:47.034: INFO: Pod "pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.211293441s
Jan 19 06:45:49.036: INFO: Pod "pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a": Phase="Pending", Reason="", readiness=false. Elapsed: 6.212446656s
Jan 19 06:45:51.034: INFO: Pod "pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a": Phase="Running", Reason="", readiness=true. Elapsed: 8.21105549s
Jan 19 06:45:51.034: INFO: Pod "pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a" satisfied condition "running"
Jan 19 06:45:51.138: INFO: Pod fsgroupchangepolicy-35/pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a started successfully
�[1mSTEP:�[0m Creating a sub-directory and file, and verifying their ownership is 1000 �[38;5;243m01/19/23 06:45:51.138�[0m
Jan 19 06:45:51.139: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/file1] Namespace:fsgroupchangepolicy-35 PodName:pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 19 06:45:51.139: INFO: >>> kubeConfig: /root/.kube/config
Jan 19 06:45:51.139: INFO: ExecWithOptions: Clientset creation
Jan 19 06:45:51.139: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-35/pods/pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a/exec?command=%2Fbin%2Fsh&command=-c&command=touch+%2Fmnt%2Fvolume1%2Ffile1&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 19 06:45:51.842: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/file1] Namespace:fsgroupchangepolicy-35 PodName:pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 19 06:45:51.842: INFO: >>> kubeConfig: /root/.kube/config
Jan 19 06:45:51.843: INFO: ExecWithOptions: Clientset creation
Jan 19 06:45:51.843: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-35/pods/pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a/exec?command=%2Fbin%2Fsh&command=-c&command=ls+-l+%2Fmnt%2Fvolume1%2Ffile1&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 19 06:45:52.544: INFO: pod fsgroupchangepolicy-35/pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a exec for cmd ls -l /mnt/volume1/file1, stdout: -rw-r--r-- 1 root 1000 0 Jan 19 06:45 /mnt/volume1/file1, stderr:
Jan 19 06:45:52.544: INFO: stdout split: [-rw-r--r-- 1 root 1000 0 Jan 19 06:45 /mnt/volume1/file1], expected gid: 1000
Jan 19 06:45:52.544: INFO: ExecWithOptions {Command:[/bin/sh -c mkdir /mnt/volume1/subdir] Namespace:fsgroupchangepolicy-35 PodName:pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 19 06:45:52.544: INFO: >>> kubeConfig: /root/.kube/config
Jan 19 06:45:52.545: INFO: ExecWithOptions: Clientset creation
Jan 19 06:45:52.545: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-35/pods/pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a/exec?command=%2Fbin%2Fsh&command=-c&command=mkdir+%2Fmnt%2Fvolume1%2Fsubdir&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 19 06:45:53.293: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-35 PodName:pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 19 06:45:53.293: INFO: >>> kubeConfig: /root/.kube/config
Jan 19 06:45:53.294: INFO: ExecWithOptions: Clientset creation
Jan 19 06:45:53.294: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-35/pods/pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a/exec?command=%2Fbin%2Fsh&command=-c&command=touch+%2Fmnt%2Fvolume1%2Fsubdir%2Ffile2&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 19 06:45:54.040: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-35 PodName:pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan 19 06:45:54.040: INFO: >>> kubeConfig: /root/.kube/config
Jan 19 06:45:54.041: INFO: ExecWithOptions: Clientset creation
Jan 19 06:45:54.041: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io/api/v1/namespaces/fsgroupchangepolicy-35/pods/pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a/exec?command=%2Fbin%2Fsh&command=-c&command=ls+-l+%2Fmnt%2Fvolume1%2Fsubdir%2Ffile2&container=write-pod&container=write-pod&stderr=true&stdout=true)
Jan 19 06:45:54.730: INFO: pod fsgroupchangepolicy-35/pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r-- 1 root 1000 0 Jan 19 06:45 /mnt/volume1/subdir/file2, stderr:
Jan 19 06:45:54.730: INFO: stdout split: [-rw-r--r-- 1 root 1000 0 Jan 19 06:45 /mnt/volume1/subdir/file2], expected gid: 1000
�[1mSTEP:�[0m Deleting Pod fsgroupchangepolicy-35/pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a �[38;5;243m01/19/23 06:45:54.73�[0m
Jan 19 06:45:54.730: INFO: Deleting pod "pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a" in namespace "fsgroupchangepolicy-35"
Jan 19 06:45:54.838: INFO: Wait up to 5m0s for pod "pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a" to be fully deleted
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-35 with fsgroup 2000 �[38;5;243m01/19/23 06:45:57.047�[0m
Jan 19 06:45:57.155: INFO: Waiting up to 5m0s for pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069" in namespace "fsgroupchangepolicy-35" to be "running"
Jan 19 06:45:57.259: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 104.349366ms
Jan 19 06:45:59.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2.209496149s
Jan 19 06:46:01.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4.209476591s
Jan 19 06:46:03.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 6.210228522s
Jan 19 06:46:05.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 8.208815876s
Jan 19 06:46:07.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 10.208890371s
Jan 19 06:46:09.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 12.209012957s
Jan 19 06:46:11.372: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 14.217189496s
Jan 19 06:46:13.370: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 16.215204552s
Jan 19 06:46:15.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 18.210022527s
Jan 19 06:46:17.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 20.210436801s
Jan 19 06:46:19.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 22.209335183s
Jan 19 06:46:21.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 24.209321261s
Jan 19 06:46:23.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 26.210035505s
Jan 19 06:46:25.367: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 28.211991122s
Jan 19 06:46:27.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 30.209752077s
Jan 19 06:46:29.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 32.209288873s
Jan 19 06:46:31.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 34.208711653s
Jan 19 06:46:33.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 36.209148275s
Jan 19 06:46:35.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 38.209370271s
Jan 19 06:46:37.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 40.209695278s
Jan 19 06:46:39.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 42.209280712s
Jan 19 06:46:41.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 44.209112408s
Jan 19 06:46:43.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 46.209997324s
Jan 19 06:46:45.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 48.209333454s
Jan 19 06:46:47.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 50.209619215s
Jan 19 06:46:49.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 52.20954326s
Jan 19 06:46:51.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 54.209819038s
Jan 19 06:46:53.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 56.209112374s
Jan 19 06:46:55.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 58.209294047s
Jan 19 06:46:57.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.209166897s
Jan 19 06:46:59.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.209314383s
Jan 19 06:47:01.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.209873089s
Jan 19 06:47:03.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.209124212s
Jan 19 06:47:05.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.209519194s
Jan 19 06:47:07.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.209711939s
Jan 19 06:47:09.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.209193441s
Jan 19 06:47:11.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.209810443s
Jan 19 06:47:13.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.208682178s
Jan 19 06:47:15.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.209441406s
Jan 19 06:47:17.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.209208288s
Jan 19 06:47:19.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.209144242s
Jan 19 06:47:21.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.209168262s
Jan 19 06:47:23.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.209152922s
Jan 19 06:47:25.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.209582247s
Jan 19 06:47:27.366: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.210665292s
Jan 19 06:47:29.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.209342043s
Jan 19 06:47:31.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.210470332s
Jan 19 06:47:33.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.209077018s
Jan 19 06:47:35.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.20906681s
Jan 19 06:47:37.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.209715413s
Jan 19 06:47:39.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.209372836s
Jan 19 06:47:41.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.20909307s
Jan 19 06:47:43.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.209133903s
Jan 19 06:47:45.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.209163904s
Jan 19 06:47:47.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.208676821s
Jan 19 06:47:49.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.208787062s
Jan 19 06:47:51.366: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.211403814s
Jan 19 06:47:53.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.209163527s
Jan 19 06:47:55.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.209247745s
Jan 19 06:47:57.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.209016744s
Jan 19 06:47:59.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.20906364s
Jan 19 06:48:01.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.209401166s
Jan 19 06:48:03.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.209329667s
Jan 19 06:48:05.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.209617521s
Jan 19 06:48:07.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.209331548s
Jan 19 06:48:09.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.209444452s
Jan 19 06:48:11.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.209969172s
Jan 19 06:48:13.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.209096358s
Jan 19 06:48:15.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.209040541s
Jan 19 06:48:17.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.209376014s
Jan 19 06:48:19.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.209202436s
Jan 19 06:48:21.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.209489785s
Jan 19 06:48:23.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.20923544s
Jan 19 06:48:25.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.209565253s
Jan 19 06:48:27.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.20935634s
Jan 19 06:48:29.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.209368323s
Jan 19 06:48:31.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.20926425s
Jan 19 06:48:33.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.209195871s
Jan 19 06:48:35.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.209630357s
Jan 19 06:48:37.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.209070057s
Jan 19 06:48:39.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.209981488s
Jan 19 06:48:41.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.209182739s
Jan 19 06:48:43.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.209253264s
Jan 19 06:48:45.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.209530166s
Jan 19 06:48:47.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.20957742s
Jan 19 06:48:49.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.209173338s
Jan 19 06:48:51.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.209002006s
Jan 19 06:48:53.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.208797573s
Jan 19 06:48:55.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.20950431s
Jan 19 06:48:57.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.2091805s
Jan 19 06:48:59.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.208993757s
Jan 19 06:49:01.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.20953592s
Jan 19 06:49:03.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.209947242s
Jan 19 06:49:05.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.209202647s
Jan 19 06:49:07.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.209221357s
Jan 19 06:49:09.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.209549318s
Jan 19 06:49:11.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.209342632s
Jan 19 06:49:13.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.209327261s
Jan 19 06:49:15.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.209354763s
Jan 19 06:49:17.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.208867351s
Jan 19 06:49:19.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.209399219s
Jan 19 06:49:21.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.208876915s
Jan 19 06:49:23.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.209655806s
Jan 19 06:49:25.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.209366386s
Jan 19 06:49:27.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.208868615s
Jan 19 06:49:29.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.20904825s
Jan 19 06:49:31.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.208947435s
Jan 19 06:49:33.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.208803059s
Jan 19 06:49:35.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.209449962s
Jan 19 06:49:37.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.209044497s
Jan 19 06:49:39.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.208978586s
Jan 19 06:49:41.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.20896347s
Jan 19 06:49:43.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.209158195s
Jan 19 06:49:45.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.209288611s
Jan 19 06:49:47.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.208922588s
Jan 19 06:49:49.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.20905052s
Jan 19 06:49:51.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.208868732s
Jan 19 06:49:53.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.208925778s
Jan 19 06:49:55.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.209621915s
Jan 19 06:49:57.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.209550121s
Jan 19 06:49:59.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.20926577s
Jan 19 06:50:01.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.209445465s
Jan 19 06:50:03.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.209144465s
Jan 19 06:50:05.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.209633539s
Jan 19 06:50:07.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.209333147s
Jan 19 06:50:09.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.209380293s
Jan 19 06:50:11.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.209661878s
Jan 19 06:50:13.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.209252495s
Jan 19 06:50:15.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.209718135s
Jan 19 06:50:17.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.208966097s
Jan 19 06:50:19.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.209075011s
Jan 19 06:50:21.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.208950368s
Jan 19 06:50:23.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.209086968s
Jan 19 06:50:25.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.209154937s
Jan 19 06:50:27.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.209104587s
Jan 19 06:50:29.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.208986636s
Jan 19 06:50:31.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.209207037s
Jan 19 06:50:33.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.208888597s
Jan 19 06:50:35.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.209192089s
Jan 19 06:50:37.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.209136632s
Jan 19 06:50:39.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.208881348s
Jan 19 06:50:41.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.209101884s
Jan 19 06:50:43.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.21003453s
Jan 19 06:50:45.365: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.209692721s
Jan 19 06:50:47.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.209090704s
Jan 19 06:50:49.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.209040344s
Jan 19 06:50:51.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.209349974s
Jan 19 06:50:53.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.209230311s
Jan 19 06:50:55.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.209495757s
Jan 19 06:50:57.364: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.208993332s
Jan 19 06:50:57.468: INFO: Pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.313331968s
Jan 19 06:50:57.468: INFO: Unexpected error:
<*errors.errorString | 0xc005355080>: {
s: "pod \"pod-fe11af87-5594-40e5-b727-c48ca12fa069\" is not Running: timed out while waiting for pod fsgroupchangepolicy-35/pod-fe11af87-5594-40e5-b727-c48ca12fa069 to be running",
}
Jan 19 06:50:57.468: FAIL: pod "pod-fe11af87-5594-40e5-b727-c48ca12fa069" is not Running: timed out while waiting for pod fsgroupchangepolicy-35/pod-fe11af87-5594-40e5-b727-c48ca12fa069 to be running
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc000c50f00, 0xc004361e10, 0x0, {0xc0055a53f8, 0x4}, {0xc0055a53fc, 0x4})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:247 +0x556
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/19/23 06:50:57.469�[0m
Jan 19 06:50:57.677: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comwfkxn"
Jan 19 06:50:57.785: INFO: Waiting up to 5m0s for PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 to get deleted
Jan 19 06:50:57.889: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (104.282092ms)
Jan 19 06:51:02.994: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (5.209377862s)
Jan 19 06:51:08.099: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (10.314194257s)
Jan 19 06:51:13.203: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (15.418443057s)
Jan 19 06:51:18.308: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (20.522965446s)
Jan 19 06:51:23.413: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (25.628156431s)
Jan 19 06:51:28.518: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (30.732950373s)
Jan 19 06:51:33.622: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (35.837451426s)
Jan 19 06:51:38.727: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (40.942130485s)
Jan 19 06:51:43.832: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (46.046915941s)
Jan 19 06:51:48.940: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (51.155001623s)
Jan 19 06:51:54.045: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (56.259735516s)
Jan 19 06:51:59.149: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m1.364165726s)
Jan 19 06:52:04.254: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m6.469098124s)
Jan 19 06:52:09.359: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m11.574058749s)
Jan 19 06:52:14.465: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m16.679729832s)
Jan 19 06:52:19.571: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m21.786566961s)
Jan 19 06:52:24.676: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m26.891348272s)
Jan 19 06:52:29.780: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m31.995544102s)
Jan 19 06:52:34.886: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m37.100810345s)
Jan 19 06:52:39.991: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m42.205847232s)
Jan 19 06:52:45.097: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m47.311940617s)
Jan 19 06:52:50.202: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m52.41729411s)
Jan 19 06:52:55.310: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (1m57.525021529s)
Jan 19 06:53:00.415: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m2.630294319s)
Jan 19 06:53:05.519: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m7.734562624s)
Jan 19 06:53:10.624: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m12.839187074s)
Jan 19 06:53:15.729: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m17.943862132s)
Jan 19 06:53:20.835: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m23.050522006s)
Jan 19 06:53:25.940: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m28.155301051s)
Jan 19 06:53:31.045: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m33.260100172s)
Jan 19 06:53:36.149: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m38.36452728s)
Jan 19 06:53:41.255: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m43.470360753s)
Jan 19 06:53:46.361: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m48.57613579s)
Jan 19 06:53:51.466: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m53.680818742s)
Jan 19 06:53:56.572: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (2m58.786857652s)
Jan 19 06:54:01.679: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (3m3.894252276s)
Jan 19 06:54:06.784: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (3m8.998612616s)
Jan 19 06:54:11.894: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (3m14.108579432s)
Jan 19 06:54:16.998: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (3m19.212949649s)
Jan 19 06:54:22.102: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (3m24.317417304s)
Jan 19 06:54:27.207: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (3m29.421996236s)
Jan 19 06:54:32.312: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (3m34.52704252s)
Jan 19 06:54:37.417: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (3m39.631658552s)
Jan 19 06:54:42.521: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (3m44.736422587s)
Jan 19 06:54:47.625: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (3m49.840523189s)
Jan 19 06:54:52.731: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (3m54.946352288s)
Jan 19 06:54:57.836: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m0.050831866s)
Jan 19 06:55:02.941: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m5.155845849s)
Jan 19 06:55:08.045: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m10.260382376s)
Jan 19 06:55:13.150: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m15.364878921s)
Jan 19 06:55:18.255: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m20.469601795s)
Jan 19 06:55:23.360: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m25.574985493s)
Jan 19 06:55:28.465: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m30.680481427s)
Jan 19 06:55:33.571: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m35.786434832s)
Jan 19 06:55:38.676: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m40.891185431s)
Jan 19 06:55:43.781: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m45.995807781s)
Jan 19 06:55:48.885: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m51.100275925s)
Jan 19 06:55:53.990: INFO: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 found and phase=Bound (4m56.205039045s)
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/19/23 06:55:58.991�[0m
Jan 19 06:55:59.097: INFO: Unexpected error: while cleanup resource:
<errors.aggregate | len:1, cap:1>: [
<errors.aggregate | len:1, cap:1>[
<*fmt.wrapError | 0xc003472060>{
msg: "persistent Volume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 not deleted by dynamic provisioner: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 still exists within 5m0s",
err: <*errors.errorString | 0xc005354090>{
s: "PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 still exists within 5m0s",
},
},
],
]
Jan 19 06:55:59.097: FAIL: while cleanup resource: persistent Volume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 not deleted by dynamic provisioner: PersistentVolume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8 still exists within 5m0s
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:128 +0x14e
panic({0x70efe60, 0xc00085ad90})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/test/e2e/framework.Fail({0xc00382c000, 0xac}, {0xc004409c30?, 0xc00382c000?, 0xc004409c58?})
test/e2e/framework/log.go:61 +0x145
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7fa8f20, 0xc005355080}, {0x0?, 0x2?, 0x0?})
test/e2e/framework/expect.go:76 +0x267
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
test/e2e/framework/expect.go:43
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc000c50f00, 0xc004361e10, 0x0, {0xc0055a53f8, 0x4}, {0xc0055a53fc, 0x4})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:247 +0x556
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/node/init/init.go:32
Jan 19 06:55:59.098: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 06:55:59.207�[0m
�[1mSTEP:�[0m Collecting events from namespace "fsgroupchangepolicy-35". �[38;5;243m01/19/23 06:55:59.207�[0m
�[1mSTEP:�[0m Found 23 events. �[38;5;243m01/19/23 06:55:59.311�[0m
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:42 +0000 UTC - event for ebs.csi.aws.comwfkxn: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:42 +0000 UTC - event for ebs.csi.aws.comwfkxn: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:42 +0000 UTC - event for ebs.csi.aws.comwfkxn: {ebs.csi.aws.com_i-0adb67e64e3ebad1e_cac02643-ef8c-47c9-901a-4f0e56d2fe3d } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-35/ebs.csi.aws.comwfkxn"
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:46 +0000 UTC - event for ebs.csi.aws.comwfkxn: {ebs.csi.aws.com_i-0adb67e64e3ebad1e_cac02643-ef8c-47c9-901a-4f0e56d2fe3d } ProvisioningSucceeded: Successfully provisioned volume pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:46 +0000 UTC - event for pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a: {default-scheduler } Scheduled: Successfully assigned fsgroupchangepolicy-35/pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a to i-0fd7dedb902bd2b40
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:49 +0000 UTC - event for pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8"
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:49 +0000 UTC - event for pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a: {kubelet i-0fd7dedb902bd2b40} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:49 +0000 UTC - event for pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a: {kubelet i-0fd7dedb902bd2b40} Created: Created container write-pod
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:50 +0000 UTC - event for pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a: {kubelet i-0fd7dedb902bd2b40} Started: Started container write-pod
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:54 +0000 UTC - event for pod-bd91b026-1e5b-4e34-a799-0d991fb36e0a: {kubelet i-0fd7dedb902bd2b40} Killing: Stopping container write-pod
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:57 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {default-scheduler } Scheduled: Successfully assigned fsgroupchangepolicy-35/pod-fe11af87-5594-40e5-b727-c48ca12fa069 to i-01c8a84101e2eeddc
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:45:57 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8" Volume is already exclusively attached to one node and can't be attached to another
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:46:03 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-f30274bc-b371-48fa-b860-ae80e5ed20e8"
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:46:04 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2b60d1a780b36b5a3332c18f1799a17a1c76679dc5d88a3b75da22c638ac4656": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:46:15 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a228d4612650cca6c58ce54ab4467739da2a853f4cccd31c6767e57dc1fa8c76": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:46:30 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e216f677c5c1e87180a3527a300b5c98a4f624a63ab5076dc302656911861d81": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:46:42 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "01100adb0bb6e8d4d59beadb1d2755186dbc96fefb942e6d6fd3ea13c4116e38": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:46:55 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b468083617f89569ee21d0303075cab134a731895af6a3b5da3e34c845aedd9e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:47:08 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ec65b711e56df086bb0cdfdcc8e9cc781ec9b70d1b5743716e22a9b1ea36b213": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:47:23 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ceb94b734d66e2ffff7bde23a6f36cfdfd85db6e0f0ff368c96d1c6ab12bbd81": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:47:35 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "56cda1234caa3505b23ca4b7af8bee610dda519b95e0d47ec83a045650529c4c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:47:48 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fd4da66131909a705a1ecda99d64337396f8f452402e57c4cb9606f29d82910a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:55:59.311: INFO: At 2023-01-19 06:48:04 +0000 UTC - event for pod-fe11af87-5594-40e5-b727-c48ca12fa069: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "302a8d619d4ef51b0d43c440b499261bd5e38486c2fe624de08f15dd06474260": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:55:59.415: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 19 06:55:59.415: INFO: pod-fe11af87-5594-40e5-b727-c48ca12fa069 i-01c8a84101e2eeddc Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:45:57 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:51:57 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:51:57 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:45:57 +0000 UTC }]
Jan 19 06:55:59.415: INFO:
Jan 19 06:55:59.626: INFO:
Logging node info for node i-01c8a84101e2eeddc
Jan 19 06:55:59.730: INFO: Node Info: &Node{ObjectMeta:{i-01c8a84101e2eeddc de952a6e-ca42-4dc7-9079-e5f5df729733 35568 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01c8a84101e2eeddc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-01c8a84101e2eeddc topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.49 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6107":"i-01c8a84101e2eeddc","ebs.csi.aws.com":"i-01c8a84101e2eeddc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:55:56 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:55:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-01c8a84101e2eeddc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:55:55 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:55:55 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:55:55 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:55:55 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.49,},NodeAddress{Type:ExternalIP,Address:15.188.127.11,},NodeAddress{Type:InternalDNS,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-188-127-11.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d066c25678610b99acde89c731a76,SystemUUID:ec2d066c-2567-8610-b99a-cde89c731a76,BootID:3983005e-c9f1-4922-bf79-f80a745c9c94,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6107^2ef58dc6-97c6-11ed-9099-1ac1930ad2e0 kubernetes.io/csi/ebs.csi.aws.com^vol-02b101d177cc49753],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-02b101d177cc49753,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6107^2ef58dc6-97c6-11ed-9099-1ac1930ad2e0,DevicePath:,},},Config:nil,},}
Jan 19 06:55:59.731: INFO:
Logging kubelet events for node i-01c8a84101e2eeddc
Jan 19 06:55:59.837: INFO:
Logging pods the kubelet thinks is on node i-01c8a84101e2eeddc
Jan 19 06:55:59.950: INFO: csi-mockplugin-attacher-0 started at 2023-01-19 06:53:25 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:55:59.950: INFO: csi-hostpathplugin-0 started at 2023-01-19 06:54:54 +0000 UTC (0+7 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:55:59.950: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 06:55:59.950: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 06:55:59.950: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 19 06:55:59.950: INFO: Container hostpath ready: true, restart count 0
Jan 19 06:55:59.950: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:55:59.950: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:55:59.950: INFO: rs-45k6b started at 2023-01-19 06:55:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container donothing ready: false, restart count 0
Jan 19 06:55:59.950: INFO: hostexec-i-01c8a84101e2eeddc-dgnhr started at 2023-01-19 06:55:54 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:55:59.950: INFO: cilium-kt55x started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:55:59.950: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:55:59.950: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:55:59.950: INFO: coredns-559769c974-mjt6q started at 2023-01-19 06:26:14 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container coredns ready: true, restart count 0
Jan 19 06:55:59.950: INFO: pod-fe11af87-5594-40e5-b727-c48ca12fa069 started at 2023-01-19 06:45:57 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container write-pod ready: true, restart count 0
Jan 19 06:55:59.950: INFO: inline-volume-tester-xnlj8 started at 2023-01-19 06:54:56 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 19 06:55:59.950: INFO: hostexec-i-01c8a84101e2eeddc-mjjzf started at 2023-01-19 06:55:50 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:55:59.950: INFO: ebs-csi-node-52j6r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:55:59.950: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:55:59.950: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:55:59.950: INFO: csi-mockplugin-0 started at 2023-01-19 06:53:25 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 06:55:59.950: INFO: Container driver-registrar ready: true, restart count 0
Jan 19 06:55:59.950: INFO: Container mock ready: true, restart count 0
Jan 19 06:55:59.950: INFO: pod-6ed60afe-8dd2-4625-a4b9-b6f52b9449ba started at 2023-01-19 06:55:55 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container write-pod ready: true, restart count 0
Jan 19 06:55:59.950: INFO: affinity-nodeport-transition-jkrs5 started at 2023-01-19 06:55:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:55:59.950: INFO: Container affinity-nodeport-transition ready: false, restart count 0
Jan 19 06:56:00.740: INFO:
Latency metrics for node i-01c8a84101e2eeddc
Jan 19 06:56:00.740: INFO:
Logging node info for node i-02873c346fcadbca8
Jan 19 06:56:00.844: INFO: Node Info: &Node{ObjectMeta:{i-02873c346fcadbca8 b6b38d81-4c4f-47c3-8a5d-ac5718bb26a8 34175 0 2023-01-19 06:25:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02873c346fcadbca8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-02873c346fcadbca8 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.215 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-8633":"i-02873c346fcadbca8","ebs.csi.aws.com":"i-02873c346fcadbca8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:55:16 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:55:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-02873c346fcadbca8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:55:25 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:55:25 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:55:25 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:55:25 +0000 UTC,LastTransitionTime:2023-01-19 06:25:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.215,},NodeAddress{Type:ExternalIP,Address:13.36.173.220,},NodeAddress{Type:InternalDNS,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-173-220.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21b61f75acfaf0e7a5fc97a7aea262,SystemUUID:ec21b61f-75ac-faf0-e7a5-fc97a7aea262,BootID:48642020-5fc8-4238-bbe3-8b854e5d773e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-8633^3906efcc-97c6-11ed-8e0e-624c1b64da79],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-8633^3906efcc-97c6-11ed-8e0e-624c1b64da79,DevicePath:,},},Config:nil,},}
Jan 19 06:56:00.845: INFO:
Logging kubelet events for node i-02873c346fcadbca8
Jan 19 06:56:00.951: INFO:
Logging pods the kubelet thinks is on node i-02873c346fcadbca8
Jan 19 06:56:01.062: INFO: pod-ephm-test-configmap-lksv started at 2023-01-19 06:54:53 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container test-container-subpath-configmap-lksv ready: false, restart count 0
Jan 19 06:56:01.062: INFO: csi-mockplugin-attacher-0 started at 2023-01-19 06:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 06:56:01.062: INFO: deployment-shared-unset-7cf876c5d4-hn9nx started at 2023-01-19 06:55:11 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container nginx ready: false, restart count 0
Jan 19 06:56:01.062: INFO: rs-cdj5q started at 2023-01-19 06:55:35 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container donothing ready: true, restart count 0
Jan 19 06:56:01.062: INFO: csi-mockplugin-resizer-0 started at 2023-01-19 06:55:58 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container csi-resizer ready: false, restart count 0
Jan 19 06:56:01.062: INFO: inline-volume-tester-rklhw started at 2023-01-19 06:55:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 19 06:56:01.062: INFO: cilium-4hjl8 started at 2023-01-19 06:25:37 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:56:01.062: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:56:01.062: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:56:01.062: INFO: all-succeed-8kbr4 started at 2023-01-19 06:55:56 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container c ready: false, restart count 0
Jan 19 06:56:01.062: INFO: csi-hostpathplugin-0 started at 2023-01-19 06:55:07 +0000 UTC (0+7 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:56:01.062: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 06:56:01.062: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 06:56:01.062: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 19 06:56:01.062: INFO: Container hostpath ready: true, restart count 0
Jan 19 06:56:01.062: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:56:01.062: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:56:01.062: INFO: csi-mockplugin-0 started at 2023-01-19 06:55:58 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 06:56:01.062: INFO: Container driver-registrar ready: false, restart count 0
Jan 19 06:56:01.062: INFO: Container mock ready: false, restart count 0
Jan 19 06:56:01.062: INFO: pod-qos-class-27d6bac3-28ae-48b6-b688-9c011288b545 started at 2023-01-19 06:54:49 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container agnhost ready: false, restart count 0
Jan 19 06:56:01.062: INFO: affinity-nodeport-transition-d77r7 started at <nil> (0+0 container statuses recorded)
Jan 19 06:56:01.062: INFO: ebs-csi-node-xwsp8 started at 2023-01-19 06:25:37 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:56:01.062: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:56:01.062: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:56:01.062: INFO: concurrent-27901855-jkcmm started at 2023-01-19 06:55:00 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:01.062: INFO: Container c ready: false, restart count 0
Jan 19 06:56:02.120: INFO:
Latency metrics for node i-02873c346fcadbca8
Jan 19 06:56:02.120: INFO:
Logging node info for node i-0adb67e64e3ebad1e
Jan 19 06:56:02.226: INFO: Node Info: &Node{ObjectMeta:{i-0adb67e64e3ebad1e cf261699-b36b-4a3b-a17d-96421c0d524f 25696 0 2023-01-19 06:23:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0adb67e64e3ebad1e kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3a topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.62.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0adb67e64e3ebad1e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 06:23:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:24:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {protokube Update v1 2023-01-19 06:24:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 06:51:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0adb67e64e3ebad1e,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:51:49 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:51:49 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:51:49 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:51:49 +0000 UTC,LastTransitionTime:2023-01-19 06:24:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.172,},NodeAddress{Type:ExternalIP,Address:13.38.71.8,},NodeAddress{Type:InternalDNS,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-71-8.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2403e255bd6f24debe308a9c68029e,SystemUUID:ec2403e2-55bd-6f24-debe-308a9c68029e,BootID:7912dda1-10e2-4946-a373-bb76d21b3786,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43629447,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42792174,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965798,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:56:02.226: INFO:
Logging kubelet events for node i-0adb67e64e3ebad1e
Jan 19 06:56:02.333: INFO:
Logging pods the kubelet thinks is on node i-0adb67e64e3ebad1e
Jan 19 06:56:02.448: INFO: aws-cloud-controller-manager-8rq4f started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:02.448: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 19 06:56:02.448: INFO: etcd-manager-events-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:02.448: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 06:56:02.448: INFO: etcd-manager-main-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:02.448: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 06:56:02.448: INFO: kube-apiserver-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+2 container statuses recorded)
Jan 19 06:56:02.448: INFO: Container healthcheck ready: true, restart count 0
Jan 19 06:56:02.448: INFO: Container kube-apiserver ready: true, restart count 1
Jan 19 06:56:02.448: INFO: cilium-29vk6 started at 2023-01-19 06:24:01 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:56:02.448: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:56:02.448: INFO: Container cilium-agent ready: true, restart count 1
Jan 19 06:56:02.448: INFO: ebs-csi-controller-5bd98b456f-bt645 started at 2023-01-19 06:24:13 +0000 UTC (0+5 container statuses recorded)
Jan 19 06:56:02.448: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:56:02.448: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 06:56:02.448: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 06:56:02.448: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:56:02.448: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:56:02.448: INFO: dns-controller-69987775c6-q62qz started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:02.448: INFO: Container dns-controller ready: true, restart count 0
Jan 19 06:56:02.448: INFO: kube-controller-manager-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:02.448: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 19 06:56:02.448: INFO: kube-scheduler-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:02.448: INFO: Container kube-scheduler ready: true, restart count 0
Jan 19 06:56:02.448: INFO: ebs-csi-node-z9pw9 started at 2023-01-19 06:24:10 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:56:02.448: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:56:02.448: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:56:02.448: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:56:02.448: INFO: cilium-operator-5dd44dc49f-pc5mf started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:02.448: INFO: Container cilium-operator ready: true, restart count 1
Jan 19 06:56:02.448: INFO: kops-controller-gwm5z started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:02.448: INFO: Container kops-controller ready: true, restart count 0
Jan 19 06:56:02.892: INFO:
Latency metrics for node i-0adb67e64e3ebad1e
Jan 19 06:56:02.892: INFO:
Logging node info for node i-0bc9010b80d8fb7a3
Jan 19 06:56:02.997: INFO: Node Info: &Node{ObjectMeta:{i-0bc9010b80d8fb7a3 a233aec6-3e3a-474b-9d9b-37e112ada5dd 35291 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bc9010b80d8fb7a3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0bc9010b80d8fb7a3 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.13 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-9943":"i-0bc9010b80d8fb7a3","ebs.csi.aws.com":"i-0bc9010b80d8fb7a3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-19 06:55:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-19 06:55:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0bc9010b80d8fb7a3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:55:51 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:55:51 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:55:51 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:55:51 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.13,},NodeAddress{Type:ExternalIP,Address:15.236.218.34,},NodeAddress{Type:InternalDNS,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-218-34.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ede8175f1d6ab673e885453491f40,SystemUUID:ec2ede81-75f1-d6ab-673e-885453491f40,BootID:d8c02e70-1290-450f-9b63-595e3f9877b7,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-05f1d286e4be60b1b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05f1d286e4be60b1b,DevicePath:,},},Config:nil,},}
Jan 19 06:56:02.998: INFO:
Logging kubelet events for node i-0bc9010b80d8fb7a3
Jan 19 06:56:03.105: INFO:
Logging pods the kubelet thinks is on node i-0bc9010b80d8fb7a3
Jan 19 06:56:03.218: INFO: csi-mockplugin-0 started at 2023-01-19 06:55:24 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 06:56:03.218: INFO: Container driver-registrar ready: true, restart count 0
Jan 19 06:56:03.218: INFO: Container mock ready: true, restart count 0
Jan 19 06:56:03.218: INFO: concurrent-27901856-5dwh7 started at <nil> (0+0 container statuses recorded)
Jan 19 06:56:03.218: INFO: hostexec-i-0bc9010b80d8fb7a3-xqw84 started at <nil> (0+0 container statuses recorded)
Jan 19 06:56:03.218: INFO: hostexec-i-0bc9010b80d8fb7a3-dnsmf started at 2023-01-19 06:55:49 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:56:03.218: INFO: test-webserver-131af100-9928-4231-a76c-08b01ec50413 started at 2023-01-19 06:55:54 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container test-webserver ready: false, restart count 0
Jan 19 06:56:03.218: INFO: csi-mockplugin-attacher-0 started at 2023-01-19 06:55:24 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:56:03.218: INFO: cilium-4db85 started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:56:03.218: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:56:03.218: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:56:03.218: INFO: busybox-readonly-fs06fd4773-a235-40dc-889e-2a4280338ec8 started at 2023-01-19 06:55:53 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container busybox-readonly-fs06fd4773-a235-40dc-889e-2a4280338ec8 ready: true, restart count 0
Jan 19 06:56:03.218: INFO: pod-subpath-test-preprovisionedpv-vvqf started at <nil> (0+0 container statuses recorded)
Jan 19 06:56:03.218: INFO: deployment-shared-unset-7cf876c5d4-tvlvz started at 2023-01-19 06:55:11 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container nginx ready: false, restart count 0
Jan 19 06:56:03.218: INFO: coredns-autoscaler-7cb5c5b969-l9mxh started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container autoscaler ready: true, restart count 0
Jan 19 06:56:03.218: INFO: all-succeed-gtmkr started at 2023-01-19 06:55:56 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container c ready: false, restart count 0
Jan 19 06:56:03.218: INFO: coredns-559769c974-rfs6h started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container coredns ready: true, restart count 0
Jan 19 06:56:03.218: INFO: inline-volume-tester-4zkz9 started at 2023-01-19 06:55:24 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 19 06:56:03.218: INFO: all-succeed-hmfhf started at <nil> (0+0 container statuses recorded)
Jan 19 06:56:03.218: INFO: hostexec-i-0bc9010b80d8fb7a3-54qcl started at 2023-01-19 06:55:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:56:03.218: INFO: ebs-csi-node-p7m8r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:56:03.218: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:56:03.218: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:56:03.218: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:56:04.226: INFO:
Latency metrics for node i-0bc9010b80d8fb7a3
Jan 19 06:56:04.226: INFO:
Logging node info for node i-0fd7dedb902bd2b40
Jan 19 06:56:04.331: INFO: Node Info: &Node{ObjectMeta:{i-0fd7dedb902bd2b40 dcd1c2b0-c939-4b06-86d9-faa66cbd5f62 35613 0 2023-01-19 06:25:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fd7dedb902bd2b40 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0fd7dedb902bd2b40 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.15 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1163":"i-0fd7dedb902bd2b40","ebs.csi.aws.com":"i-0fd7dedb902bd2b40"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:56:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:56:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0fd7dedb902bd2b40,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:56:00 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:56:00 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:56:00 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:56:00 +0000 UTC,LastTransitionTime:2023-01-19 06:25:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.15,},NodeAddress{Type:ExternalIP,Address:13.36.168.174,},NodeAddress{Type:InternalDNS,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-168-174.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2507f02fe9694e6687a10a99b81476,SystemUUID:ec2507f0-2fe9-694e-6687-a10a99b81476,BootID:4e2ef5d6-9152-47a6-9581-43ae00972132,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1163^42df9ac4-97c6-11ed-855f-c242a747b52a kubernetes.io/csi/ebs.csi.aws.com^vol-0d47933ec456ea25b],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1163^42df9ac4-97c6-11ed-855f-c242a747b52a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d47933ec456ea25b,DevicePath:,},},Config:nil,},}
Jan 19 06:56:04.331: INFO:
Logging kubelet events for node i-0fd7dedb902bd2b40
Jan 19 06:56:04.438: INFO:
Logging pods the kubelet thinks is on node i-0fd7dedb902bd2b40
Jan 19 06:56:04.550: INFO: csi-hostpathplugin-0 started at 2023-01-19 06:55:24 +0000 UTC (0+7 container statuses recorded)
Jan 19 06:56:04.550: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:56:04.550: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 06:56:04.550: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 06:56:04.550: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 19 06:56:04.550: INFO: Container hostpath ready: true, restart count 0
Jan 19 06:56:04.550: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:56:04.550: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:56:04.550: INFO: busybox-fdeb482b-923f-46a7-92da-6cd55b48b5eb started at 2023-01-19 06:55:25 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.550: INFO: Container busybox ready: true, restart count 0
Jan 19 06:56:04.550: INFO: affinity-nodeport-transition-7zv5f started at <nil> (0+0 container statuses recorded)
Jan 19 06:56:04.550: INFO: cilium-2rqdw started at 2023-01-19 06:25:34 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:56:04.550: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:56:04.550: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:56:04.550: INFO: pod-2 started at 2023-01-19 06:55:57 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.550: INFO: Container donothing ready: false, restart count 0
Jan 19 06:56:04.550: INFO: inline-volume-tester-9ml5l started at 2023-01-19 06:55:29 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.550: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 06:56:04.550: INFO: sample-webhook-deployment-865554f4d9-7dvhw started at 2023-01-19 06:55:57 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.550: INFO: Container sample-webhook ready: false, restart count 0
Jan 19 06:56:04.550: INFO: ebs-csi-node-x9tpg started at 2023-01-19 06:25:34 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:56:04.550: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:56:04.550: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:56:04.550: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:56:04.550: INFO: pod-0 started at 2023-01-19 06:55:57 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.550: INFO: Container donothing ready: false, restart count 0
Jan 19 06:56:04.550: INFO: pod-subpath-test-configmap-lbmm started at <nil> (0+0 container statuses recorded)
Jan 19 06:56:04.550: INFO: hostexec-i-0fd7dedb902bd2b40-xlfnw started at <nil> (0+0 container statuses recorded)
Jan 19 06:56:04.551: INFO: rs-ztq8n started at 2023-01-19 06:55:35 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.551: INFO: Container donothing ready: true, restart count 0
Jan 19 06:56:04.551: INFO: deployment-shared-unset-7cf876c5d4-79fvp started at 2023-01-19 06:55:11 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.551: INFO: Container nginx ready: false, restart count 0
Jan 19 06:56:04.551: INFO: inline-volume-tester-qbd9g started at 2023-01-19 06:55:30 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.551: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 19 06:56:04.551: INFO: pod-1 started at 2023-01-19 06:55:57 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.551: INFO: Container donothing ready: false, restart count 0
Jan 19 06:56:04.551: INFO: rs-h4q48 started at 2023-01-19 06:55:35 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.551: INFO: Container donothing ready: true, restart count 0
Jan 19 06:56:04.551: INFO: all-succeed-vxr2f started at <nil> (0+0 container statuses recorded)
Jan 19 06:56:04.551: INFO: rs-kpjcg started at 2023-01-19 06:55:35 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.551: INFO: Container donothing ready: true, restart count 0
Jan 19 06:56:04.551: INFO: run-test-3 started at 2023-01-19 06:55:11 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:56:04.551: INFO: Container run-test-3 ready: true, restart count 0
Jan 19 06:56:05.394: INFO:
Latency metrics for node i-0fd7dedb902bd2b40
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "fsgroupchangepolicy-35" for this suite. �[38;5;243m01/19/23 06:56:05.394�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\svolumes\sshould\sallow\sexec\sof\sfiles\son\sthe\svolume$'
test/e2e/framework/pod/output/output.go:237
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc000c0a270?, {0x75eb81c?, 0x0?}, 0xc003d46900, 0x0, {0xc001b99eb8, 0x1, 0x1}, 0x0?)
test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/storage/testsuites.testScriptInPod(0xc0015b7860, {0x75c9b48?, 0x1?}, 0xc001b4a1e0, 0xc0020898c0)
test/e2e/storage/testsuites/volumes.go:254 +0x6aa
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func4()
test/e2e/storage/testsuites/volumes.go:200 +0xb1
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 06:46:04.187�[0m
Jan 19 06:46:04.188: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename volume �[38;5;243m01/19/23 06:46:04.189�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 06:46:04.501�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 06:46:04.706�[0m
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
test/e2e/framework/metrics/init/init.go:31
[It] should allow exec of files on the volume
test/e2e/storage/testsuites/volumes.go:195
Jan 19 06:46:04.912: INFO: Creating resource for dynamic PV
Jan 19 06:46:04.912: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass volume-6718-e2e-scc2t4b �[38;5;243m01/19/23 06:46:04.913�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/19/23 06:46:05.018�[0m
Jan 19 06:46:05.018: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating pod exec-volume-test-dynamicpv-qnv2 �[38;5;243m01/19/23 06:46:05.227�[0m
�[1mSTEP:�[0m Creating a pod to test exec-volume-test �[38;5;243m01/19/23 06:46:05.227�[0m
Jan 19 06:46:05.335: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-qnv2" in namespace "volume-6718" to be "Succeeded or Failed"
Jan 19 06:46:05.439: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 103.660167ms
Jan 19 06:46:07.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.207915097s
Jan 19 06:46:09.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.207294777s
Jan 19 06:46:11.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.207273205s
Jan 19 06:46:13.544: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.209254491s
Jan 19 06:46:15.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.20731253s
Jan 19 06:46:17.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 12.208333032s
Jan 19 06:46:19.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 14.207735551s
Jan 19 06:46:21.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 16.207498917s
Jan 19 06:46:23.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 18.207859886s
Jan 19 06:46:25.544: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 20.209039479s
Jan 19 06:46:27.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 22.208037158s
Jan 19 06:46:29.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 24.207596692s
Jan 19 06:46:31.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 26.207213851s
Jan 19 06:46:33.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 28.207983704s
Jan 19 06:46:35.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 30.207309337s
Jan 19 06:46:37.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 32.20744801s
Jan 19 06:46:39.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 34.207069818s
Jan 19 06:46:41.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 36.207718287s
Jan 19 06:46:43.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 38.208158763s
Jan 19 06:46:45.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 40.207499732s
Jan 19 06:46:47.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 42.207564717s
Jan 19 06:46:49.546: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 44.21117903s
Jan 19 06:46:51.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 46.207482654s
Jan 19 06:46:53.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 48.208028508s
Jan 19 06:46:55.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 50.20686727s
Jan 19 06:46:57.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 52.208080783s
Jan 19 06:46:59.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 54.208146047s
Jan 19 06:47:01.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 56.207703621s
Jan 19 06:47:03.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 58.207572181s
Jan 19 06:47:05.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.207278837s
Jan 19 06:47:07.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.207391615s
Jan 19 06:47:09.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.207129339s
Jan 19 06:47:11.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.207359649s
Jan 19 06:47:13.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.207252662s
Jan 19 06:47:15.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.207583016s
Jan 19 06:47:17.545: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.210039639s
Jan 19 06:47:19.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.20834562s
Jan 19 06:47:21.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.208328205s
Jan 19 06:47:23.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.207544133s
Jan 19 06:47:25.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.207477153s
Jan 19 06:47:27.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.207344362s
Jan 19 06:47:29.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.208039275s
Jan 19 06:47:31.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.208264409s
Jan 19 06:47:33.544: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.209061162s
Jan 19 06:47:35.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.20769666s
Jan 19 06:47:37.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.207340282s
Jan 19 06:47:39.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.207089216s
Jan 19 06:47:41.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.207072757s
Jan 19 06:47:43.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.207896549s
Jan 19 06:47:45.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.207477952s
Jan 19 06:47:47.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.207692401s
Jan 19 06:47:49.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.20756673s
Jan 19 06:47:51.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.208140171s
Jan 19 06:47:53.544: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.208422909s
Jan 19 06:47:55.544: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.208397318s
Jan 19 06:47:57.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.207487358s
Jan 19 06:47:59.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.207504127s
Jan 19 06:48:01.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.208236238s
Jan 19 06:48:03.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.207731644s
Jan 19 06:48:05.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.20781213s
Jan 19 06:48:07.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.207545227s
Jan 19 06:48:09.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.208126313s
Jan 19 06:48:11.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.207266226s
Jan 19 06:48:13.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.207299361s
Jan 19 06:48:15.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.207617339s
Jan 19 06:48:17.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.207224975s
Jan 19 06:48:19.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.207376124s
Jan 19 06:48:21.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.207553919s
Jan 19 06:48:23.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.207533771s
Jan 19 06:48:25.544: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.208466277s
Jan 19 06:48:27.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.207849887s
Jan 19 06:48:29.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.207650363s
Jan 19 06:48:31.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.207324945s
Jan 19 06:48:33.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.207573945s
Jan 19 06:48:35.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.208307064s
Jan 19 06:48:37.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.207461274s
Jan 19 06:48:39.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.207558845s
Jan 19 06:48:41.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.207534032s
Jan 19 06:48:43.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.207713093s
Jan 19 06:48:45.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.208312355s
Jan 19 06:48:47.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.207455164s
Jan 19 06:48:49.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.207336125s
Jan 19 06:48:51.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.207915071s
Jan 19 06:48:53.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.207353271s
Jan 19 06:48:55.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.208337411s
Jan 19 06:48:57.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.207285971s
Jan 19 06:48:59.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.207461984s
Jan 19 06:49:01.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.207410473s
Jan 19 06:49:03.545: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.209573468s
Jan 19 06:49:05.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.207850224s
Jan 19 06:49:07.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.20812148s
Jan 19 06:49:09.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.208044531s
Jan 19 06:49:11.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.207605231s
Jan 19 06:49:13.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.207564342s
Jan 19 06:49:15.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.208198292s
Jan 19 06:49:17.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.208011572s
Jan 19 06:49:19.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.207534805s
Jan 19 06:49:21.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.207964027s
Jan 19 06:49:23.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.208367068s
Jan 19 06:49:25.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.208251151s
Jan 19 06:49:27.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.207642504s
Jan 19 06:49:29.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.207746596s
Jan 19 06:49:31.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.207755181s
Jan 19 06:49:33.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.208038373s
Jan 19 06:49:35.544: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.208493396s
Jan 19 06:49:37.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.207546631s
Jan 19 06:49:39.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.20784935s
Jan 19 06:49:41.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.207526881s
Jan 19 06:49:43.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.207722256s
Jan 19 06:49:45.544: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.208569509s
Jan 19 06:49:47.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.207352648s
Jan 19 06:49:49.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.207039081s
Jan 19 06:49:51.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.207522119s
Jan 19 06:49:53.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.207296604s
Jan 19 06:49:55.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.208056454s
Jan 19 06:49:57.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.208309148s
Jan 19 06:49:59.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.207702548s
Jan 19 06:50:01.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.207992969s
Jan 19 06:50:03.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.207967511s
Jan 19 06:50:05.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.207637162s
Jan 19 06:50:07.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.208083954s
Jan 19 06:50:09.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.207689931s
Jan 19 06:50:11.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.20806484s
Jan 19 06:50:13.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.207312798s
Jan 19 06:50:15.544: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.209227519s
Jan 19 06:50:17.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.207553877s
Jan 19 06:50:19.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.207981624s
Jan 19 06:50:21.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.207879952s
Jan 19 06:50:23.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.208170669s
Jan 19 06:50:25.542: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.207256911s
Jan 19 06:50:27.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.207586576s
Jan 19 06:50:29.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.207563647s
Jan 19 06:50:31.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.208227723s
Jan 19 06:50:33.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.20768759s
Jan 19 06:50:35.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.20787567s
Jan 19 06:50:37.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.208233006s
Jan 19 06:50:39.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.207570824s
Jan 19 06:50:41.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.207821701s
Jan 19 06:50:43.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.208081948s
Jan 19 06:50:45.544: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.208514887s
Jan 19 06:50:47.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.208247441s
Jan 19 06:50:49.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.207473492s
Jan 19 06:50:51.544: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.208425624s
Jan 19 06:50:53.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.208197069s
Jan 19 06:50:55.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.208081764s
Jan 19 06:50:57.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.207848735s
Jan 19 06:50:59.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.207626105s
Jan 19 06:51:01.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.207783735s
Jan 19 06:51:03.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.207477228s
Jan 19 06:51:05.543: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.20800537s
Jan 19 06:51:05.646: INFO: Pod "exec-volume-test-dynamicpv-qnv2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.311236003s
Jan 19 06:51:05.855: INFO: Failed to get logs from node "i-02873c346fcadbca8" pod "exec-volume-test-dynamicpv-qnv2" container "exec-container-dynamicpv-qnv2": the server rejected our request for an unknown reason (get pods exec-volume-test-dynamicpv-qnv2)
�[1mSTEP:�[0m delete the pod �[38;5;243m01/19/23 06:51:05.855�[0m
Jan 19 06:51:05.961: INFO: Waiting for pod exec-volume-test-dynamicpv-qnv2 to disappear
Jan 19 06:51:06.065: INFO: Pod exec-volume-test-dynamicpv-qnv2 still exists
Jan 19 06:51:08.066: INFO: Waiting for pod exec-volume-test-dynamicpv-qnv2 to disappear
Jan 19 06:51:08.169: INFO: Pod exec-volume-test-dynamicpv-qnv2 no longer exists
Jan 19 06:51:08.170: INFO: Unexpected error:
<*errors.errorString | 0xc004ced7a0>: {
s: "expected pod \"exec-volume-test-dynamicpv-qnv2\" success: timed out while waiting for pod volume-6718/exec-volume-test-dynamicpv-qnv2 to be Succeeded or Failed",
}
Jan 19 06:51:08.170: FAIL: expected pod "exec-volume-test-dynamicpv-qnv2" success: timed out while waiting for pod volume-6718/exec-volume-test-dynamicpv-qnv2 to be Succeeded or Failed
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc000c0a270?, {0x75eb81c?, 0x0?}, 0xc003d46900, 0x0, {0xc001b99eb8, 0x1, 0x1}, 0x0?)
test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/storage/testsuites.testScriptInPod(0xc0015b7860, {0x75c9b48?, 0x1?}, 0xc001b4a1e0, 0xc0020898c0)
test/e2e/storage/testsuites/volumes.go:254 +0x6aa
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func4()
test/e2e/storage/testsuites/volumes.go:200 +0xb1
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/19/23 06:51:08.17�[0m
Jan 19 06:51:08.377: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comtkwqx"
Jan 19 06:51:08.483: INFO: Waiting up to 5m0s for PersistentVolume pvc-ed0ef7d1-e476-4686-9b50-5ebe4364f2ce to get deleted
Jan 19 06:51:08.586: INFO: PersistentVolume pvc-ed0ef7d1-e476-4686-9b50-5ebe4364f2ce found and phase=Released (103.572996ms)
Jan 19 06:51:13.691: INFO: PersistentVolume pvc-ed0ef7d1-e476-4686-9b50-5ebe4364f2ce found and phase=Released (5.207695433s)
Jan 19 06:51:18.795: INFO: PersistentVolume pvc-ed0ef7d1-e476-4686-9b50-5ebe4364f2ce found and phase=Released (10.312058115s)
Jan 19 06:51:23.899: INFO: PersistentVolume pvc-ed0ef7d1-e476-4686-9b50-5ebe4364f2ce was removed
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/19/23 06:51:23.899�[0m
[AfterEach] [Testpattern: Dynamic PV (default fs)] volumes
test/e2e/framework/node/init/init.go:32
Jan 19 06:51:24.004: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 06:51:24.109�[0m
�[1mSTEP:�[0m Collecting events from namespace "volume-6718". �[38;5;243m01/19/23 06:51:24.109�[0m
�[1mSTEP:�[0m Found 16 events. �[38;5;243m01/19/23 06:51:24.214�[0m
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:46:05 +0000 UTC - event for ebs.csi.aws.comtkwqx: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:46:05 +0000 UTC - event for ebs.csi.aws.comtkwqx: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:46:05 +0000 UTC - event for ebs.csi.aws.comtkwqx: {ebs.csi.aws.com_i-0adb67e64e3ebad1e_cac02643-ef8c-47c9-901a-4f0e56d2fe3d } Provisioning: External provisioner is provisioning volume for claim "volume-6718/ebs.csi.aws.comtkwqx"
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:46:08 +0000 UTC - event for ebs.csi.aws.comtkwqx: {ebs.csi.aws.com_i-0adb67e64e3ebad1e_cac02643-ef8c-47c9-901a-4f0e56d2fe3d } ProvisioningSucceeded: Successfully provisioned volume pvc-ed0ef7d1-e476-4686-9b50-5ebe4364f2ce
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:46:09 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {default-scheduler } Scheduled: Successfully assigned volume-6718/exec-volume-test-dynamicpv-qnv2 to i-02873c346fcadbca8
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:46:11 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-ed0ef7d1-e476-4686-9b50-5ebe4364f2ce"
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:46:14 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a9f6ac33ab43bfd46e6148961bd3faf05254c8d83fe0d98b4acd7a22c54768e0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:46:27 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "02910a6df4f2047bb1d7b35cd4b495bbd59dcd12c57d84545a9ddcc12b09f947": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:46:41 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bc1ecc65d4a23d0cf808e86d407a58e145ae2c8898555b016d4a978904ccccef": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:46:53 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bfc602ada5dafd824dc0e2e5d9b1bea8cb930fcd0253767be8c3ef66194d5345": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:47:07 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c7efc2819d472e5eefd778ef865bc781e1cda1701dc3a9bd868ed79d6d222076": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:47:18 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "478757b88e7e3d11d4ad80a23fe1d597dd0473b459e32acbc33ff942926da956": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:47:32 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1bfc5a07b4a3e48c3680b5b3413eefc6bf7349f66aea18d67386296e36e27d3b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:47:45 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1de2f42f7bd9f3522d725f6b0f92d2372b0a6331a387cc55632c9a4240d1a6fc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:47:58 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b9d5c9a526ec96f37418cb580bf6dde472f41ba8b1a26f60fe054f7c66d0b320": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:51:24.214: INFO: At 2023-01-19 06:48:10 +0000 UTC - event for exec-volume-test-dynamicpv-qnv2: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "073f8755af2f6c2c6f7e70fe655ac435dc982830e2005656ecd519e173bb491f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:51:24.317: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 19 06:51:24.317: INFO:
Jan 19 06:51:24.421: INFO:
Logging node info for node i-01c8a84101e2eeddc
Jan 19 06:51:24.525: INFO: Node Info: &Node{ObjectMeta:{i-01c8a84101e2eeddc de952a6e-ca42-4dc7-9079-e5f5df729733 25104 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01c8a84101e2eeddc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-01c8a84101e2eeddc topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.49 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01c8a84101e2eeddc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:46:03 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:51:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-01c8a84101e2eeddc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:51:09 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:51:09 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:51:09 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:51:09 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.49,},NodeAddress{Type:ExternalIP,Address:15.188.127.11,},NodeAddress{Type:InternalDNS,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-188-127-11.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d066c25678610b99acde89c731a76,SystemUUID:ec2d066c-2567-8610-b99a-cde89c731a76,BootID:3983005e-c9f1-4922-bf79-f80a745c9c94,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-02b101d177cc49753],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-02b101d177cc49753,DevicePath:,},},Config:nil,},}
Jan 19 06:51:24.525: INFO:
Logging kubelet events for node i-01c8a84101e2eeddc
Jan 19 06:51:24.631: INFO:
Logging pods the kubelet thinks is on node i-01c8a84101e2eeddc
Jan 19 06:51:24.741: INFO: hostexec-i-01c8a84101e2eeddc-kclbt started at 2023-01-19 06:51:18 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:51:24.741: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gzbxm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:24.741: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jlhlb started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:24.741: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-dnqqv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:24.741: INFO: hostexec-i-01c8a84101e2eeddc-xmsgk started at 2023-01-19 06:50:22 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:51:24.741: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vrmzk started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:24.741: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-nkg9j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:24.741: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-87z7m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:24.741: INFO: hostexec-i-01c8a84101e2eeddc-pkhpt started at 2023-01-19 06:48:02 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:51:24.741: INFO: ebs-csi-node-52j6r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:51:24.741: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:51:24.741: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:51:24.741: INFO: csi-hostpathplugin-0 started at 2023-01-19 06:46:53 +0000 UTC (0+7 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 06:51:24.741: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 06:51:24.741: INFO: Container csi-resizer ready: false, restart count 0
Jan 19 06:51:24.741: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 19 06:51:24.741: INFO: Container hostpath ready: false, restart count 0
Jan 19 06:51:24.741: INFO: Container liveness-probe ready: false, restart count 0
Jan 19 06:51:24.741: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 19 06:51:24.741: INFO: pod-68c82fb2-c52b-4371-923b-2a35fdc66519 started at 2023-01-19 06:48:05 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container write-pod ready: false, restart count 0
Jan 19 06:51:24.741: INFO: pod-977000d3-20fd-4ace-89b6-1fefa62065bf started at 2023-01-19 06:50:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container write-pod ready: false, restart count 0
Jan 19 06:51:24.741: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-d82dm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:24.741: INFO: cilium-kt55x started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:51:24.741: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:51:24.741: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-5f725 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:24.741: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4nj84 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:24.741: INFO: coredns-559769c974-mjt6q started at 2023-01-19 06:26:14 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container coredns ready: true, restart count 0
Jan 19 06:51:24.741: INFO: pod-fe11af87-5594-40e5-b727-c48ca12fa069 started at 2023-01-19 06:45:57 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container write-pod ready: false, restart count 0
Jan 19 06:51:24.741: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jngrg started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:24.741: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:25.142: INFO:
Latency metrics for node i-01c8a84101e2eeddc
Jan 19 06:51:25.142: INFO:
Logging node info for node i-02873c346fcadbca8
Jan 19 06:51:25.246: INFO: Node Info: &Node{ObjectMeta:{i-02873c346fcadbca8 b6b38d81-4c4f-47c3-8a5d-ac5718bb26a8 25099 0 2023-01-19 06:25:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02873c346fcadbca8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-02873c346fcadbca8 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.215 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-3069":"i-02873c346fcadbca8","ebs.csi.aws.com":"i-02873c346fcadbca8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:51:08 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:51:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-02873c346fcadbca8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:51:09 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:51:09 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:51:09 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:51:09 +0000 UTC,LastTransitionTime:2023-01-19 06:25:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.215,},NodeAddress{Type:ExternalIP,Address:13.36.173.220,},NodeAddress{Type:InternalDNS,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-173-220.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21b61f75acfaf0e7a5fc97a7aea262,SystemUUID:ec21b61f-75ac-faf0-e7a5-fc97a7aea262,BootID:48642020-5fc8-4238-bbe3-8b854e5d773e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-3069^018ddca0-97c5-11ed-9541-5eea89e07a99 kubernetes.io/csi/ebs.csi.aws.com^vol-053f4a816ab9c1a3a kubernetes.io/csi/ebs.csi.aws.com^vol-05fd4a6ac0b721add kubernetes.io/csi/ebs.csi.aws.com^vol-073136eb24d038f22 kubernetes.io/csi/ebs.csi.aws.com^vol-08fe0282b55b1a8eb],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08fe0282b55b1a8eb,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-073136eb24d038f22,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05fd4a6ac0b721add,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-053f4a816ab9c1a3a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-3069^018ddca0-97c5-11ed-9541-5eea89e07a99,DevicePath:,},},Config:nil,},}
Jan 19 06:51:25.246: INFO:
Logging kubelet events for node i-02873c346fcadbca8
Jan 19 06:51:25.351: INFO:
Logging pods the kubelet thinks is on node i-02873c346fcadbca8
Jan 19 06:51:25.466: INFO: ebs-csi-node-xwsp8 started at 2023-01-19 06:25:37 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:51:25.466: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:51:25.466: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:51:25.466: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-s952s started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:25.466: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wjgz6 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:25.466: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jn8lv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:25.466: INFO: pvc-volume-tester-4gg9l started at 2023-01-19 06:46:31 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container volume-tester ready: false, restart count 0
Jan 19 06:51:25.466: INFO: hostexec-i-02873c346fcadbca8-7mf4f started at 2023-01-19 06:48:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:51:25.466: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cck5q started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:25.466: INFO: csi-mockplugin-attacher-0 started at 2023-01-19 06:45:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:51:25.466: INFO: inline-volume-tester-4kbtk started at 2023-01-19 06:41:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 06:51:25.466: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-bs995 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:51:25.466: INFO: pod-4e2e712f-d361-46ff-80c0-b17246297aca started at 2023-01-19 06:48:22 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container write-pod ready: false, restart count 0
Jan 19 06:51:25.466: INFO: image-pull-testaec1a19b-de78-4495-876f-fef41eb449d2 started at 2023-01-19 06:49:56 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container image-pull-test ready: false, restart count 0
Jan 19 06:51:25.466: INFO: csi-mockplugin-0 started at 2023-01-19 06:45:48 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 06:51:25.466: INFO: Container driver-registrar ready: true, restart count 0
Jan 19 06:51:25.466: INFO: Container mock ready: true, restart count 0
Jan 19 06:51:25.466: INFO: inline-volume-tester-tcvsc started at 2023-01-19 06:46:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 06:51:25.466: INFO: csi-mockplugin-0 started at 2023-01-19 06:46:51 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 06:51:25.466: INFO: Container driver-registrar ready: false, restart count 0
Jan 19 06:51:25.466: INFO: Container mock ready: false, restart count 0
Jan 19 06:51:25.466: INFO: pod-disruption-failure-ignore-0-jggfn started at 2023-01-19 06:47:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container c ready: false, restart count 0
Jan 19 06:51:25.466: INFO: pod-disruption-failure-ignore-1-tdbw4 started at 2023-01-19 06:47:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container c ready: false, restart count 0
Jan 19 06:51:25.466: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-r8467 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:25.466: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-f8gmr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:25.466: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cfrb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:25.466: INFO: cilium-4hjl8 started at 2023-01-19 06:25:37 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:51:25.466: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:51:25.466: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zgw5r started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:25.466: INFO: csi-mockplugin-attacher-0 started at 2023-01-19 06:45:41 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:51:25.466: INFO: csi-mockplugin-attacher-0 started at 2023-01-19 06:46:51 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 06:51:25.466: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wchfw started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:25.466: INFO: pod-57de25c3-103c-4ba3-904f-fd6146f464ca started at 2023-01-19 06:50:56 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container write-pod ready: false, restart count 0
Jan 19 06:51:25.466: INFO: csi-mockplugin-0 started at 2023-01-19 06:46:44 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 06:51:25.466: INFO: Container driver-registrar ready: false, restart count 0
Jan 19 06:51:25.466: INFO: Container mock ready: false, restart count 0
Jan 19 06:51:25.466: INFO: inline-volume-tester2-r7fcc started at 2023-01-19 06:45:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 06:51:25.466: INFO: suspend-true-to-false-hfhzr started at 2023-01-19 06:45:20 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container c ready: false, restart count 0
Jan 19 06:51:25.466: INFO: csi-mockplugin-0 started at 2023-01-19 06:45:40 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 06:51:25.466: INFO: Container driver-registrar ready: false, restart count 0
Jan 19 06:51:25.466: INFO: Container mock ready: false, restart count 0
Jan 19 06:51:25.466: INFO: downwardapi-volume-f12783d1-7507-4797-99d3-23bb29404053 started at 2023-01-19 06:50:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container client-container ready: false, restart count 0
Jan 19 06:51:25.466: INFO: pod-configmaps-8a5f75cb-363f-4907-a928-dc005bf32fbb started at 2023-01-19 06:49:54 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:25.466: INFO: Container agnhost-container ready: false, restart count 0
Jan 19 06:51:25.867: INFO:
Latency metrics for node i-02873c346fcadbca8
Jan 19 06:51:25.867: INFO:
Logging node info for node i-0adb67e64e3ebad1e
Jan 19 06:51:25.970: INFO: Node Info: &Node{ObjectMeta:{i-0adb67e64e3ebad1e cf261699-b36b-4a3b-a17d-96421c0d524f 23496 0 2023-01-19 06:23:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0adb67e64e3ebad1e kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3a topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.62.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0adb67e64e3ebad1e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 06:23:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:24:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {protokube Update v1 2023-01-19 06:24:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 06:46:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0adb67e64e3ebad1e,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:46:43 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:46:43 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:46:43 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:46:43 +0000 UTC,LastTransitionTime:2023-01-19 06:24:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.172,},NodeAddress{Type:ExternalIP,Address:13.38.71.8,},NodeAddress{Type:InternalDNS,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-71-8.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2403e255bd6f24debe308a9c68029e,SystemUUID:ec2403e2-55bd-6f24-debe-308a9c68029e,BootID:7912dda1-10e2-4946-a373-bb76d21b3786,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43629447,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42792174,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965798,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:51:25.971: INFO:
Logging kubelet events for node i-0adb67e64e3ebad1e
Jan 19 06:51:26.076: INFO:
Logging pods the kubelet thinks is on node i-0adb67e64e3ebad1e
Jan 19 06:51:26.185: INFO: etcd-manager-main-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.185: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 06:51:26.185: INFO: kube-apiserver-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+2 container statuses recorded)
Jan 19 06:51:26.185: INFO: Container healthcheck ready: true, restart count 0
Jan 19 06:51:26.185: INFO: Container kube-apiserver ready: true, restart count 1
Jan 19 06:51:26.185: INFO: cilium-29vk6 started at 2023-01-19 06:24:01 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:51:26.185: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:51:26.185: INFO: Container cilium-agent ready: true, restart count 1
Jan 19 06:51:26.185: INFO: ebs-csi-controller-5bd98b456f-bt645 started at 2023-01-19 06:24:13 +0000 UTC (0+5 container statuses recorded)
Jan 19 06:51:26.185: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:51:26.185: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 06:51:26.185: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 06:51:26.185: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:51:26.185: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:51:26.185: INFO: dns-controller-69987775c6-q62qz started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.185: INFO: Container dns-controller ready: true, restart count 0
Jan 19 06:51:26.185: INFO: aws-cloud-controller-manager-8rq4f started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.185: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 19 06:51:26.185: INFO: etcd-manager-events-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.185: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 06:51:26.185: INFO: kube-scheduler-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.185: INFO: Container kube-scheduler ready: true, restart count 0
Jan 19 06:51:26.185: INFO: ebs-csi-node-z9pw9 started at 2023-01-19 06:24:10 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:51:26.185: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:51:26.185: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:51:26.185: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:51:26.185: INFO: cilium-operator-5dd44dc49f-pc5mf started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.185: INFO: Container cilium-operator ready: true, restart count 1
Jan 19 06:51:26.185: INFO: kops-controller-gwm5z started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.185: INFO: Container kops-controller ready: true, restart count 0
Jan 19 06:51:26.185: INFO: kube-controller-manager-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.185: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 19 06:51:26.559: INFO:
Latency metrics for node i-0adb67e64e3ebad1e
Jan 19 06:51:26.559: INFO:
Logging node info for node i-0bc9010b80d8fb7a3
Jan 19 06:51:26.663: INFO: Node Info: &Node{ObjectMeta:{i-0bc9010b80d8fb7a3 a233aec6-3e3a-474b-9d9b-37e112ada5dd 24801 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bc9010b80d8fb7a3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0bc9010b80d8fb7a3 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.13 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bc9010b80d8fb7a3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:50:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0bc9010b80d8fb7a3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:50:13 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:50:13 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:50:13 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:50:13 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.13,},NodeAddress{Type:ExternalIP,Address:15.236.218.34,},NodeAddress{Type:InternalDNS,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-218-34.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ede8175f1d6ab673e885453491f40,SystemUUID:ec2ede81-75f1-d6ab-673e-885453491f40,BootID:d8c02e70-1290-450f-9b63-595e3f9877b7,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:51:26.663: INFO:
Logging kubelet events for node i-0bc9010b80d8fb7a3
Jan 19 06:51:26.769: INFO:
Logging pods the kubelet thinks is on node i-0bc9010b80d8fb7a3
Jan 19 06:51:26.879: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wc82j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.879: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:26.879: INFO: fail-once-non-local-6l6df started at 2023-01-19 06:45:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.879: INFO: Container c ready: false, restart count 0
Jan 19 06:51:26.879: INFO: cilium-4db85 started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:51:26.879: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:51:26.879: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:51:26.879: INFO: fail-once-non-local-j5lgj started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.879: INFO: Container c ready: false, restart count 0
Jan 19 06:51:26.879: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-w9vxz started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.879: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:26.879: INFO: coredns-autoscaler-7cb5c5b969-l9mxh started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.879: INFO: Container autoscaler ready: true, restart count 0
Jan 19 06:51:26.879: INFO: csi-mockplugin-0 started at 2023-01-19 06:47:34 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:51:26.879: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 06:51:26.879: INFO: Container driver-registrar ready: false, restart count 0
Jan 19 06:51:26.879: INFO: Container mock ready: false, restart count 0
Jan 19 06:51:26.879: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-lgvhj started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.879: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:26.879: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-rw8m5 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.880: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:26.880: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4jfb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.880: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:26.880: INFO: coredns-559769c974-rfs6h started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.880: INFO: Container coredns ready: true, restart count 0
Jan 19 06:51:26.880: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-n5thx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.880: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:26.880: INFO: csi-mockplugin-attacher-0 started at 2023-01-19 06:47:34 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.880: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 06:51:26.880: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zdvsc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.880: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:26.880: INFO: fail-once-non-local-sp8qx started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.880: INFO: Container c ready: false, restart count 0
Jan 19 06:51:26.880: INFO: ebs-csi-node-p7m8r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:51:26.880: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:51:26.880: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:51:26.880: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:51:26.880: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kvlh9 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.880: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:26.880: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vk25m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.880: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:26.880: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kwxms started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:26.880: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:51:27.266: INFO:
Latency metrics for node i-0bc9010b80d8fb7a3
Jan 19 06:51:27.266: INFO:
Logging node info for node i-0fd7dedb902bd2b40
Jan 19 06:51:27.370: INFO: Node Info: &Node{ObjectMeta:{i-0fd7dedb902bd2b40 dcd1c2b0-c939-4b06-86d9-faa66cbd5f62 23860 0 2023-01-19 06:25:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fd7dedb902bd2b40 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0fd7dedb902bd2b40 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.15 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd7dedb902bd2b40"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:47:29 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:47:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0fd7dedb902bd2b40,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:47:29 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:47:29 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:47:29 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:47:29 +0000 UTC,LastTransitionTime:2023-01-19 06:25:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.15,},NodeAddress{Type:ExternalIP,Address:13.36.168.174,},NodeAddress{Type:InternalDNS,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-168-174.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2507f02fe9694e6687a10a99b81476,SystemUUID:ec2507f0-2fe9-694e-6687-a10a99b81476,BootID:4e2ef5d6-9152-47a6-9581-43ae00972132,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c,DevicePath:,},},Config:nil,},}
Jan 19 06:51:27.370: INFO:
Logging kubelet events for node i-0fd7dedb902bd2b40
Jan 19 06:51:27.476: INFO:
Logging pods the kubelet thinks is on node i-0fd7dedb902bd2b40
Jan 19 06:51:27.585: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-45qq2 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:27.585: INFO: suspend-true-to-false-fl56v started at 2023-01-19 06:46:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container c ready: false, restart count 0
Jan 19 06:51:27.585: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-hkwbn started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:27.585: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-q5n4f started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:27.585: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jk9pc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:27.585: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-ltgrx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:27.585: INFO: pod-0 started at 2023-01-19 06:48:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container donothing ready: true, restart count 0
Jan 19 06:51:27.585: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gmz6h started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:27.585: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-qz8nr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:27.585: INFO: cilium-2rqdw started at 2023-01-19 06:25:34 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:51:27.585: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:51:27.585: INFO: suspend-true-to-false-28mnz started at 2023-01-19 06:45:20 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container c ready: false, restart count 0
Jan 19 06:51:27.585: INFO: downward-api-30250d40-7f3b-4279-89e9-d5e0c068fd11 started at 2023-01-19 06:49:05 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container dapi-container ready: false, restart count 0
Jan 19 06:51:27.585: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-6294b started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:27.585: INFO: ebs-csi-node-x9tpg started at 2023-01-19 06:25:34 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:51:27.585: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:51:27.585: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:51:27.585: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-fc8jt started at 2023-01-19 06:34:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:27.585: INFO: suspend-true-to-false-58gp2 started at 2023-01-19 06:46:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container c ready: false, restart count 0
Jan 19 06:51:27.585: INFO: inline-volume-tester-mf6q7 started at 2023-01-19 06:34:58 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 19 06:51:27.585: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-58rnf started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:51:27.585: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:51:27.984: INFO:
Latency metrics for node i-0fd7dedb902bd2b40
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "volume-6718" for this suite. �[38;5;243m01/19/23 06:51:27.984�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sAdmissionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sdeny\spod\sand\sconfigmap\screation\s\[Conformance\]$'
test/e2e/apimachinery/webhook.go:826
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc000e81ef0, {0xc003679e30, 0x2c}, 0xc0034a5450, 0x20fb, 0x20fc)
test/e2e/apimachinery/webhook.go:826 +0xed2
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
test/e2e/apimachinery/webhook.go:102 +0x226
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 06:36:06.673�[0m
Jan 19 06:36:06.673: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename webhook �[38;5;243m01/19/23 06:36:06.674�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 06:36:06.986�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 06:36:07.193�[0m
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:90
�[1mSTEP:�[0m Setting up server cert �[38;5;243m01/19/23 06:36:07.611�[0m
�[1mSTEP:�[0m Create role binding to let webhook read extension-apiserver-authentication �[38;5;243m01/19/23 06:36:08.205�[0m
�[1mSTEP:�[0m Deploying the webhook pod �[38;5;243m01/19/23 06:36:08.311�[0m
�[1mSTEP:�[0m Wait for the deployment to be ready �[38;5;243m01/19/23 06:36:08.524�[0m
Jan 19 06:36:08.836: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:10.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:12.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:14.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:16.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:18.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:20.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:22.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:24.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:26.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:28.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:30.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:32.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:34.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:36.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:38.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:40.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:42.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:44.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:46.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:48.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:50.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:52.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:54.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:56.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:36:58.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:00.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:02.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:04.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:06.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:08.944: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:10.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:12.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:14.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:16.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:18.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:20.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:22.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:24.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:26.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:28.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:30.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:32.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:34.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:36.945: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:38.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:40.942: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:42.942: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:44.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:46.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:48.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:50.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:52.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:54.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:56.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:37:58.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:00.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:02.942: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:04.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:06.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:08.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:10.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:12.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:14.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:16.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:18.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:20.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:22.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:24.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:26.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:28.942: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:30.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:32.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:34.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:36.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:38.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:40.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:42.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:45.038: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:46.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:48.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:50.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:52.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:54.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:56.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:38:58.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:00.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:02.942: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:04.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:06.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:08.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:10.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:12.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:14.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:16.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:18.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:20.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:22.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:24.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:26.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:28.942: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:30.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:32.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:34.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:36.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:38.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:40.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:42.948: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:44.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:46.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:48.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:50.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:52.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:54.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:56.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:39:58.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:00.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:02.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:04.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:06.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:08.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:10.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:12.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:14.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:16.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:18.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:20.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:22.942: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:24.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:26.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:28.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:30.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:32.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:34.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:36.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:38.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:40.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:42.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:44.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:46.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:48.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:50.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:52.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:54.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:56.940: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:40:58.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:41:00.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:41:02.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:41:04.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:41:06.941: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:41:08.942: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:41:09.046: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 19 06:41:09.046: INFO: Unexpected error: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-2996):
<*errors.errorString | 0xc001103600>: {
s: "error waiting for deployment \"sample-webhook-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"sample-webhook-deployment-865554f4d9\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}",
}
Jan 19 06:41:09.046: FAIL: waiting for the deployment status valid%!(EXTRA string=registry.k8s.io/e2e-test-images/agnhost:2.43, string=sample-webhook-deployment, string=webhook-2996): error waiting for deployment "sample-webhook-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 6, 36, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-webhook-deployment-865554f4d9\" is progressing."}}, CollisionCount:(*int32)(nil)}
Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.deployWebhookAndService(0xc000e81ef0, {0xc003679e30, 0x2c}, 0xc0034a5450, 0x20fb, 0x20fc)
test/e2e/apimachinery/webhook.go:826 +0xed2
k8s.io/kubernetes/test/e2e/apimachinery.glob..func28.1()
test/e2e/apimachinery/webhook.go:102 +0x226
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/node/init/init.go:32
Jan 19 06:41:09.046: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/apimachinery/webhook.go:105
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 06:41:09.573�[0m
�[1mSTEP:�[0m Collecting events from namespace "webhook-2996". �[38;5;243m01/19/23 06:41:09.573�[0m
�[1mSTEP:�[0m Found 13 events. �[38;5;243m01/19/23 06:41:09.678�[0m
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:36:08 +0000 UTC - event for sample-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-webhook-deployment-865554f4d9 to 1
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:36:08 +0000 UTC - event for sample-webhook-deployment-865554f4d9: {replicaset-controller } SuccessfulCreate: Created pod: sample-webhook-deployment-865554f4d9-gkwhc
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:36:08 +0000 UTC - event for sample-webhook-deployment-865554f4d9-gkwhc: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6b1edac19958fdb1111f1573821de2d96ec744031f9033b4d0fa7e9dea78104d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:36:08 +0000 UTC - event for sample-webhook-deployment-865554f4d9-gkwhc: {default-scheduler } Scheduled: Successfully assigned webhook-2996/sample-webhook-deployment-865554f4d9-gkwhc to i-02873c346fcadbca8
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:36:21 +0000 UTC - event for sample-webhook-deployment-865554f4d9-gkwhc: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8e1e7b9e0a371ec7bfad4f09dd25b3f9124dcc20361375b2694746e5011e3549": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:36:35 +0000 UTC - event for sample-webhook-deployment-865554f4d9-gkwhc: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f72a1cdebeee38691cf5683fc89b18aa2d2b0b46a4e7754e4881cd80062cf8dd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:36:48 +0000 UTC - event for sample-webhook-deployment-865554f4d9-gkwhc: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d2f6c27a81d384aef46fde934014b0aa279ee188a42b3514858f121675920a87": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:36:59 +0000 UTC - event for sample-webhook-deployment-865554f4d9-gkwhc: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "319ce25886eae6f56a09831b128db782a7218f280b40f349d0f9f6b922434a49": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:37:14 +0000 UTC - event for sample-webhook-deployment-865554f4d9-gkwhc: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1e42c0b9630dc547a0f6c1ffddbb8ef9fb6766e0e0382f6042ab89989746aecb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:37:29 +0000 UTC - event for sample-webhook-deployment-865554f4d9-gkwhc: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d62675e59b7df7cd67be05df141d781a06b421f5c691880cb83ddc7b8f1f5d1d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:37:40 +0000 UTC - event for sample-webhook-deployment-865554f4d9-gkwhc: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "00af5fb3d29adb255fe702248d9cd20e1fda9aadea1dc49536ee19b903cf7699": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:37:51 +0000 UTC - event for sample-webhook-deployment-865554f4d9-gkwhc: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b1297184dc9334b158434a44aaa489950dac219a2b062c194d3318475c4a873c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:41:09.678: INFO: At 2023-01-19 06:38:04 +0000 UTC - event for sample-webhook-deployment-865554f4d9-gkwhc: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9e29462d30bfc0a6d3fab2041e10ca63a3da7aaf398467ab4045128c5e92af16": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 06:41:09.781: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 19 06:41:09.781: INFO:
Jan 19 06:41:09.886: INFO:
Logging node info for node i-01c8a84101e2eeddc
Jan 19 06:41:09.990: INFO: Node Info: &Node{ObjectMeta:{i-01c8a84101e2eeddc de952a6e-ca42-4dc7-9079-e5f5df729733 19350 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01c8a84101e2eeddc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-01c8a84101e2eeddc topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.49 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01c8a84101e2eeddc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:40:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-01c8a84101e2eeddc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.49,},NodeAddress{Type:ExternalIP,Address:15.188.127.11,},NodeAddress{Type:InternalDNS,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-188-127-11.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d066c25678610b99acde89c731a76,SystemUUID:ec2d066c-2567-8610-b99a-cde89c731a76,BootID:3983005e-c9f1-4922-bf79-f80a745c9c94,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:41:09.991: INFO:
Logging kubelet events for node i-01c8a84101e2eeddc
Jan 19 06:41:10.101: INFO:
Logging pods the kubelet thinks is on node i-01c8a84101e2eeddc
Jan 19 06:41:10.217: INFO: cilium-kt55x started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:41:10.217: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:41:10.217: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-5f725 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.217: INFO: csi-hostpathplugin-0 started at 2023-01-19 06:40:21 +0000 UTC (0+7 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 06:41:10.217: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 06:41:10.217: INFO: Container csi-resizer ready: false, restart count 0
Jan 19 06:41:10.217: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 19 06:41:10.217: INFO: Container hostpath ready: false, restart count 0
Jan 19 06:41:10.217: INFO: Container liveness-probe ready: false, restart count 0
Jan 19 06:41:10.217: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 19 06:41:10.217: INFO: coredns-559769c974-mjt6q started at 2023-01-19 06:26:14 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container coredns ready: true, restart count 0
Jan 19 06:41:10.217: INFO: netserver-0 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:10.217: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jngrg started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.217: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4nj84 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.217: INFO: pod-handle-http-request started at 2023-01-19 06:39:46 +0000 UTC (0+2 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container container-handle-http-request ready: false, restart count 0
Jan 19 06:41:10.217: INFO: Container container-handle-https-request ready: false, restart count 0
Jan 19 06:41:10.217: INFO: netserver-0 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:10.217: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gzbxm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.217: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jlhlb started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.217: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-dnqqv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.217: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vrmzk started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.217: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-nkg9j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.217: INFO: ebs-csi-node-52j6r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:10.217: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:10.217: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:41:10.217: INFO: pod-subpath-test-inlinevolume-zpb9 started at 2023-01-19 06:36:13 +0000 UTC (2+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Init container init-volume-inlinevolume-zpb9 ready: false, restart count 0
Jan 19 06:41:10.217: INFO: Init container test-init-volume-inlinevolume-zpb9 ready: false, restart count 0
Jan 19 06:41:10.217: INFO: Container test-container-subpath-inlinevolume-zpb9 ready: false, restart count 0
Jan 19 06:41:10.217: INFO: test-rs-d95wt started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container httpd ready: false, restart count 0
Jan 19 06:41:10.217: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-87z7m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.217: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-d82dm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.217: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:10.661: INFO:
Latency metrics for node i-01c8a84101e2eeddc
Jan 19 06:41:10.661: INFO:
Logging node info for node i-02873c346fcadbca8
Jan 19 06:41:10.766: INFO: Node Info: &Node{ObjectMeta:{i-02873c346fcadbca8 b6b38d81-4c4f-47c3-8a5d-ac5718bb26a8 18142 0 2023-01-19 06:25:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02873c346fcadbca8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-02873c346fcadbca8 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-02873c346fcadbca8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:37:55 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:38:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-02873c346fcadbca8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.215,},NodeAddress{Type:ExternalIP,Address:13.36.173.220,},NodeAddress{Type:InternalDNS,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-173-220.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21b61f75acfaf0e7a5fc97a7aea262,SystemUUID:ec21b61f-75ac-faf0-e7a5-fc97a7aea262,BootID:48642020-5fc8-4238-bbe3-8b854e5d773e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0193d14c5ce38dc18 kubernetes.io/csi/ebs.csi.aws.com^vol-05aeca504bceab9e0 kubernetes.io/csi/ebs.csi.aws.com^vol-0d1d97df9e92f7db0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d1d97df9e92f7db0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0193d14c5ce38dc18,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05aeca504bceab9e0,DevicePath:,},},Config:nil,},}
Jan 19 06:41:10.766: INFO:
Logging kubelet events for node i-02873c346fcadbca8
Jan 19 06:41:10.873: INFO:
Logging pods the kubelet thinks is on node i-02873c346fcadbca8
Jan 19 06:41:10.987: INFO: test-pod-09b898ed-1e72-4b3d-b642-09c68ee1bf30 started at 2023-01-19 06:39:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container agnhost-container ready: false, restart count 0
Jan 19 06:41:10.987: INFO: test-webserver-27dc5e4a-f07e-41b8-8552-8b12aedc0e20 started at 2023-01-19 06:40:16 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container test-webserver ready: false, restart count 0
Jan 19 06:41:10.987: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-r8467 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.987: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-f8gmr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.987: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cfrb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:10.987: INFO: image-pull-test02c0aac0-7d46-4614-aed4-ccfac5eaff6b started at 2023-01-19 06:39:56 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container image-pull-test ready: false, restart count 0
Jan 19 06:41:10.987: INFO: ss2-0 started at 2023-01-19 06:36:00 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:10.987: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zgw5r started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.987: INFO: netserver-1 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:10.987: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wchfw started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.987: INFO: cilium-4hjl8 started at 2023-01-19 06:25:37 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:41:10.987: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:41:10.987: INFO: test-container-pod started at 2023-01-19 06:40:31 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:10.987: INFO: inline-volume-tester2-fmh9p started at 2023-01-19 06:34:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 06:41:10.987: INFO: netserver-1 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:10.987: INFO: test-rs-rw2w8 started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container httpd ready: false, restart count 0
Jan 19 06:41:10.987: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-s952s started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.987: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wjgz6 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.987: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jn8lv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.987: INFO: ss-0 started at 2023-01-19 06:37:53 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:10.987: INFO: ebs-csi-node-xwsp8 started at 2023-01-19 06:25:37 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:10.987: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:10.987: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:41:10.987: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cck5q started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:10.987: INFO: pfpod started at 2023-01-19 06:36:13 +0000 UTC (0+2 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container portforwardtester ready: false, restart count 0
Jan 19 06:41:10.987: INFO: Container readiness ready: false, restart count 0
Jan 19 06:41:10.987: INFO: ss-0 started at 2023-01-19 06:35:01 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:10.987: INFO: ss2-0 started at 2023-01-19 06:35:54 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:10.987: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-bs995 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:10.987: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:11.433: INFO:
Latency metrics for node i-02873c346fcadbca8
Jan 19 06:41:11.434: INFO:
Logging node info for node i-0adb67e64e3ebad1e
Jan 19 06:41:11.538: INFO: Node Info: &Node{ObjectMeta:{i-0adb67e64e3ebad1e cf261699-b36b-4a3b-a17d-96421c0d524f 17770 0 2023-01-19 06:23:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0adb67e64e3ebad1e kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3a topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.62.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0adb67e64e3ebad1e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 06:23:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:24:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {protokube Update v1 2023-01-19 06:24:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 06:36:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0adb67e64e3ebad1e,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:24:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.172,},NodeAddress{Type:ExternalIP,Address:13.38.71.8,},NodeAddress{Type:InternalDNS,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-71-8.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2403e255bd6f24debe308a9c68029e,SystemUUID:ec2403e2-55bd-6f24-debe-308a9c68029e,BootID:7912dda1-10e2-4946-a373-bb76d21b3786,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43629447,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42792174,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965798,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:41:11.538: INFO:
Logging kubelet events for node i-0adb67e64e3ebad1e
Jan 19 06:41:11.645: INFO:
Logging pods the kubelet thinks is on node i-0adb67e64e3ebad1e
Jan 19 06:41:11.754: INFO: etcd-manager-events-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:11.754: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 06:41:11.754: INFO: etcd-manager-main-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:11.754: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 06:41:11.754: INFO: kube-apiserver-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+2 container statuses recorded)
Jan 19 06:41:11.754: INFO: Container healthcheck ready: true, restart count 0
Jan 19 06:41:11.754: INFO: Container kube-apiserver ready: true, restart count 1
Jan 19 06:41:11.754: INFO: cilium-29vk6 started at 2023-01-19 06:24:01 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:41:11.754: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:41:11.754: INFO: Container cilium-agent ready: true, restart count 1
Jan 19 06:41:11.754: INFO: ebs-csi-controller-5bd98b456f-bt645 started at 2023-01-19 06:24:13 +0000 UTC (0+5 container statuses recorded)
Jan 19 06:41:11.754: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:41:11.754: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 06:41:11.754: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 06:41:11.754: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:11.754: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:11.754: INFO: dns-controller-69987775c6-q62qz started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:11.754: INFO: Container dns-controller ready: true, restart count 0
Jan 19 06:41:11.754: INFO: aws-cloud-controller-manager-8rq4f started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:11.754: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 19 06:41:11.754: INFO: kube-controller-manager-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:11.754: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 19 06:41:11.754: INFO: kube-scheduler-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:11.754: INFO: Container kube-scheduler ready: true, restart count 0
Jan 19 06:41:11.754: INFO: ebs-csi-node-z9pw9 started at 2023-01-19 06:24:10 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:41:11.754: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:11.754: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:11.754: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:41:11.754: INFO: cilium-operator-5dd44dc49f-pc5mf started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:11.754: INFO: Container cilium-operator ready: true, restart count 1
Jan 19 06:41:11.754: INFO: kops-controller-gwm5z started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:11.754: INFO: Container kops-controller ready: true, restart count 0
Jan 19 06:41:12.130: INFO:
Latency metrics for node i-0adb67e64e3ebad1e
Jan 19 06:41:12.130: INFO:
Logging node info for node i-0bc9010b80d8fb7a3
Jan 19 06:41:12.234: INFO: Node Info: &Node{ObjectMeta:{i-0bc9010b80d8fb7a3 a233aec6-3e3a-474b-9d9b-37e112ada5dd 18849 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bc9010b80d8fb7a3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0bc9010b80d8fb7a3 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.13 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bc9010b80d8fb7a3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:40:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0bc9010b80d8fb7a3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.13,},NodeAddress{Type:ExternalIP,Address:15.236.218.34,},NodeAddress{Type:InternalDNS,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-218-34.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ede8175f1d6ab673e885453491f40,SystemUUID:ec2ede81-75f1-d6ab-673e-885453491f40,BootID:d8c02e70-1290-450f-9b63-595e3f9877b7,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:41:12.235: INFO:
Logging kubelet events for node i-0bc9010b80d8fb7a3
Jan 19 06:41:12.341: INFO:
Logging pods the kubelet thinks is on node i-0bc9010b80d8fb7a3
Jan 19 06:41:12.455: INFO: netserver-2 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:12.455: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-rw8m5 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:12.455: INFO: coredns-559769c974-rfs6h started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container coredns ready: true, restart count 0
Jan 19 06:41:12.455: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-n5thx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:12.455: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zdvsc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:12.455: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4jfb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:12.455: INFO: pod-secrets-97b423cb-db9a-4eb1-a66a-95f0f3c3d055 started at 2023-01-19 06:40:08 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container secret-volume-test ready: false, restart count 0
Jan 19 06:41:12.455: INFO: fail-once-non-local-sp8qx started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container c ready: false, restart count 0
Jan 19 06:41:12.455: INFO: ebs-csi-node-p7m8r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:12.455: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:12.455: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:41:12.455: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kvlh9 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:12.455: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vk25m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:12.455: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kwxms started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:12.455: INFO: cilium-4db85 started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:41:12.455: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:41:12.455: INFO: fail-once-non-local-j5lgj started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container c ready: false, restart count 0
Jan 19 06:41:12.455: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-w9vxz started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:12.455: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wc82j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:12.455: INFO: coredns-autoscaler-7cb5c5b969-l9mxh started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container autoscaler ready: true, restart count 0
Jan 19 06:41:12.455: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-lgvhj started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:12.455: INFO: netserver-2 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:12.455: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:12.854: INFO:
Latency metrics for node i-0bc9010b80d8fb7a3
Jan 19 06:41:12.854: INFO:
Logging node info for node i-0fd7dedb902bd2b40
Jan 19 06:41:12.959: INFO: Node Info: &Node{ObjectMeta:{i-0fd7dedb902bd2b40 dcd1c2b0-c939-4b06-86d9-faa66cbd5f62 19268 0 2023-01-19 06:25:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fd7dedb902bd2b40 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0fd7dedb902bd2b40 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.15 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd7dedb902bd2b40"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:40:25 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:40:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0fd7dedb902bd2b40,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.15,},NodeAddress{Type:ExternalIP,Address:13.36.168.174,},NodeAddress{Type:InternalDNS,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-168-174.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2507f02fe9694e6687a10a99b81476,SystemUUID:ec2507f0-2fe9-694e-6687-a10a99b81476,BootID:4e2ef5d6-9152-47a6-9581-43ae00972132,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0434bfb8d414b168a kubernetes.io/csi/ebs.csi.aws.com^vol-046138a1832bcff2c kubernetes.io/csi/ebs.csi.aws.com^vol-049dd3d103a06d67a kubernetes.io/csi/ebs.csi.aws.com^vol-06c6dac4c8bb96bd4 kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-046138a1832bcff2c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06c6dac4c8bb96bd4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-049dd3d103a06d67a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0434bfb8d414b168a,DevicePath:,},},Config:nil,},}
Jan 19 06:41:12.959: INFO:
Logging kubelet events for node i-0fd7dedb902bd2b40
Jan 19 06:41:13.066: INFO:
Logging pods the kubelet thinks is on node i-0fd7dedb902bd2b40
Jan 19 06:41:13.178: INFO: busybox-e0f4ec78-8a17-4742-b780-27f4c738c15e started at 2023-01-19 06:38:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container busybox ready: false, restart count 0
Jan 19 06:41:13.178: INFO: pod-3425cf74-675f-4345-8eb8-e79b1612a826 started at 2023-01-19 06:40:49 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container write-pod ready: false, restart count 0
Jan 19 06:41:13.178: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-ltgrx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:13.178: INFO: hostexec-i-0fd7dedb902bd2b40-jbp89 started at 2023-01-19 06:40:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:41:13.178: INFO: cilium-2rqdw started at 2023-01-19 06:25:34 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:41:13.178: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:41:13.178: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gmz6h started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:13.178: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-qz8nr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:13.178: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-6294b started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:13.178: INFO: ebs-csi-node-x9tpg started at 2023-01-19 06:25:34 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:13.178: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:13.178: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:41:13.178: INFO: inline-volume-tester-gt9hf started at 2023-01-19 06:34:10 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 19 06:41:13.178: INFO: inline-volume-tester-mf6q7 started at 2023-01-19 06:34:58 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 06:41:13.178: INFO: netserver-3 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:13.178: INFO: ss-1 started at 2023-01-19 06:36:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:13.178: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-58rnf started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:13.178: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-fc8jt started at 2023-01-19 06:34:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:13.178: INFO: test-rs-h6zjm started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container httpd ready: false, restart count 0
Jan 19 06:41:13.178: INFO: netserver-3 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:13.178: INFO: host-test-container-pod started at 2023-01-19 06:40:31 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:41:13.178: INFO: ss2-1 started at 2023-01-19 06:35:55 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:13.178: INFO: test-grpc-730c5dd9-aa89-476c-a8f1-4b9fa8fe749d started at 2023-01-19 06:39:53 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container etcd ready: true, restart count 0
Jan 19 06:41:13.178: INFO: pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6 started at 2023-01-19 06:40:22 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container write-pod ready: false, restart count 0
Jan 19 06:41:13.178: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-hkwbn started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:13.178: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-45qq2 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:13.178: INFO: pod-80d67e58-24ea-4871-866e-0ef63ad77eab started at 2023-01-19 06:34:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container write-pod ready: true, restart count 0
Jan 19 06:41:13.178: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jk9pc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:13.178: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-q5n4f started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:13.178: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:13.709: INFO:
Latency metrics for node i-0fd7dedb902bd2b40
�[1mSTEP:�[0m Collecting events from namespace "webhook-2996-markers". �[38;5;243m01/19/23 06:41:13.709�[0m
�[1mSTEP:�[0m Found 0 events. �[38;5;243m01/19/23 06:41:13.813�[0m
Jan 19 06:41:13.917: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 19 06:41:13.917: INFO:
Jan 19 06:41:14.022: INFO:
Logging node info for node i-01c8a84101e2eeddc
Jan 19 06:41:14.126: INFO: Node Info: &Node{ObjectMeta:{i-01c8a84101e2eeddc de952a6e-ca42-4dc7-9079-e5f5df729733 19350 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01c8a84101e2eeddc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-01c8a84101e2eeddc topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.49 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01c8a84101e2eeddc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:40:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-01c8a84101e2eeddc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.49,},NodeAddress{Type:ExternalIP,Address:15.188.127.11,},NodeAddress{Type:InternalDNS,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-188-127-11.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d066c25678610b99acde89c731a76,SystemUUID:ec2d066c-2567-8610-b99a-cde89c731a76,BootID:3983005e-c9f1-4922-bf79-f80a745c9c94,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:41:14.126: INFO:
Logging kubelet events for node i-01c8a84101e2eeddc
Jan 19 06:41:14.232: INFO:
Logging pods the kubelet thinks is on node i-01c8a84101e2eeddc
Jan 19 06:41:14.344: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gzbxm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:14.344: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jlhlb started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:14.344: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-dnqqv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:14.344: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vrmzk started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:14.344: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-nkg9j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:14.344: INFO: ebs-csi-node-52j6r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:14.344: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:14.344: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:41:14.344: INFO: pod-subpath-test-inlinevolume-zpb9 started at 2023-01-19 06:36:13 +0000 UTC (2+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Init container init-volume-inlinevolume-zpb9 ready: false, restart count 0
Jan 19 06:41:14.344: INFO: Init container test-init-volume-inlinevolume-zpb9 ready: false, restart count 0
Jan 19 06:41:14.344: INFO: Container test-container-subpath-inlinevolume-zpb9 ready: false, restart count 0
Jan 19 06:41:14.344: INFO: test-rs-d95wt started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container httpd ready: false, restart count 0
Jan 19 06:41:14.344: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-87z7m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:14.344: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-d82dm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:14.344: INFO: cilium-kt55x started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:41:14.344: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:41:14.344: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-5f725 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:14.344: INFO: csi-hostpathplugin-0 started at 2023-01-19 06:40:21 +0000 UTC (0+7 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 06:41:14.344: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 06:41:14.344: INFO: Container csi-resizer ready: false, restart count 0
Jan 19 06:41:14.344: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 19 06:41:14.344: INFO: Container hostpath ready: false, restart count 0
Jan 19 06:41:14.344: INFO: Container liveness-probe ready: false, restart count 0
Jan 19 06:41:14.344: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 19 06:41:14.344: INFO: coredns-559769c974-mjt6q started at 2023-01-19 06:26:14 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container coredns ready: true, restart count 0
Jan 19 06:41:14.344: INFO: netserver-0 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:14.344: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jngrg started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:14.344: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4nj84 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:14.344: INFO: pod-handle-http-request started at 2023-01-19 06:39:46 +0000 UTC (0+2 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container container-handle-http-request ready: false, restart count 0
Jan 19 06:41:14.344: INFO: Container container-handle-https-request ready: false, restart count 0
Jan 19 06:41:14.344: INFO: netserver-0 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:14.344: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:14.753: INFO:
Latency metrics for node i-01c8a84101e2eeddc
Jan 19 06:41:14.753: INFO:
Logging node info for node i-02873c346fcadbca8
Jan 19 06:41:14.857: INFO: Node Info: &Node{ObjectMeta:{i-02873c346fcadbca8 b6b38d81-4c4f-47c3-8a5d-ac5718bb26a8 18142 0 2023-01-19 06:25:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02873c346fcadbca8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-02873c346fcadbca8 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-02873c346fcadbca8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:37:55 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:38:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-02873c346fcadbca8,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:38:03 +0000 UTC,LastTransitionTime:2023-01-19 06:25:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.215,},NodeAddress{Type:ExternalIP,Address:13.36.173.220,},NodeAddress{Type:InternalDNS,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-02873c346fcadbca8.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-173-220.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21b61f75acfaf0e7a5fc97a7aea262,SystemUUID:ec21b61f-75ac-faf0-e7a5-fc97a7aea262,BootID:48642020-5fc8-4238-bbe3-8b854e5d773e,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0193d14c5ce38dc18 kubernetes.io/csi/ebs.csi.aws.com^vol-05aeca504bceab9e0 kubernetes.io/csi/ebs.csi.aws.com^vol-0d1d97df9e92f7db0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0d1d97df9e92f7db0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0193d14c5ce38dc18,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05aeca504bceab9e0,DevicePath:,},},Config:nil,},}
Jan 19 06:41:14.857: INFO:
Logging kubelet events for node i-02873c346fcadbca8
Jan 19 06:41:14.963: INFO:
Logging pods the kubelet thinks is on node i-02873c346fcadbca8
Jan 19 06:41:15.080: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-f8gmr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:15.080: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cfrb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:15.080: INFO: image-pull-test02c0aac0-7d46-4614-aed4-ccfac5eaff6b started at 2023-01-19 06:39:56 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container image-pull-test ready: false, restart count 0
Jan 19 06:41:15.080: INFO: ss2-0 started at 2023-01-19 06:36:00 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:15.080: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-r8467 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:15.080: INFO: netserver-1 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:15.080: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wchfw started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:15.080: INFO: cilium-4hjl8 started at 2023-01-19 06:25:37 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:41:15.080: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:41:15.080: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zgw5r started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:15.080: INFO: test-container-pod started at 2023-01-19 06:40:31 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:15.080: INFO: netserver-1 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:15.080: INFO: test-rs-rw2w8 started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container httpd ready: false, restart count 0
Jan 19 06:41:15.080: INFO: inline-volume-tester2-fmh9p started at 2023-01-19 06:34:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 06:41:15.080: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-s952s started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:15.080: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wjgz6 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:15.080: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jn8lv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:15.080: INFO: ss-0 started at 2023-01-19 06:37:53 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:15.080: INFO: ebs-csi-node-xwsp8 started at 2023-01-19 06:25:37 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:15.080: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:15.080: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:41:15.080: INFO: pfpod started at 2023-01-19 06:36:13 +0000 UTC (0+2 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container portforwardtester ready: false, restart count 0
Jan 19 06:41:15.080: INFO: Container readiness ready: false, restart count 0
Jan 19 06:41:15.080: INFO: ss-0 started at 2023-01-19 06:35:01 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:15.080: INFO: ss2-0 started at 2023-01-19 06:35:54 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:15.080: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-cck5q started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:15.080: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-bs995 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:15.080: INFO: test-webserver-27dc5e4a-f07e-41b8-8552-8b12aedc0e20 started at 2023-01-19 06:40:16 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container test-webserver ready: false, restart count 0
Jan 19 06:41:15.080: INFO: test-pod-09b898ed-1e72-4b3d-b642-09c68ee1bf30 started at 2023-01-19 06:39:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.080: INFO: Container agnhost-container ready: false, restart count 0
Jan 19 06:41:15.486: INFO:
Latency metrics for node i-02873c346fcadbca8
Jan 19 06:41:15.486: INFO:
Logging node info for node i-0adb67e64e3ebad1e
Jan 19 06:41:15.590: INFO: Node Info: &Node{ObjectMeta:{i-0adb67e64e3ebad1e cf261699-b36b-4a3b-a17d-96421c0d524f 17770 0 2023-01-19 06:23:44 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0adb67e64e3ebad1e kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-3a topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.62.172 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0adb67e64e3ebad1e"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 06:23:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:24:11 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {protokube Update v1 2023-01-19 06:24:13 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:24:20 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 06:36:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0adb67e64e3ebad1e,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:23:38 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:36:31 +0000 UTC,LastTransitionTime:2023-01-19 06:24:11 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.62.172,},NodeAddress{Type:ExternalIP,Address:13.38.71.8,},NodeAddress{Type:InternalDNS,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0adb67e64e3ebad1e.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-38-71-8.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2403e255bd6f24debe308a9c68029e,SystemUUID:ec2403e2-55bd-6f24-debe-308a9c68029e,BootID:7912dda1-10e2-4946-a373-bb76d21b3786,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43629447,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42792174,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965798,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:41:15.590: INFO:
Logging kubelet events for node i-0adb67e64e3ebad1e
Jan 19 06:41:15.696: INFO:
Logging pods the kubelet thinks is on node i-0adb67e64e3ebad1e
Jan 19 06:41:15.805: INFO: ebs-csi-node-z9pw9 started at 2023-01-19 06:24:10 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:41:15.805: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:15.805: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:15.805: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:41:15.805: INFO: cilium-operator-5dd44dc49f-pc5mf started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.805: INFO: Container cilium-operator ready: true, restart count 1
Jan 19 06:41:15.805: INFO: kops-controller-gwm5z started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.805: INFO: Container kops-controller ready: true, restart count 0
Jan 19 06:41:15.805: INFO: kube-controller-manager-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.805: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 19 06:41:15.805: INFO: kube-scheduler-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.805: INFO: Container kube-scheduler ready: true, restart count 0
Jan 19 06:41:15.805: INFO: kube-apiserver-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+2 container statuses recorded)
Jan 19 06:41:15.805: INFO: Container healthcheck ready: true, restart count 0
Jan 19 06:41:15.805: INFO: Container kube-apiserver ready: true, restart count 1
Jan 19 06:41:15.805: INFO: cilium-29vk6 started at 2023-01-19 06:24:01 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:41:15.805: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:41:15.805: INFO: Container cilium-agent ready: true, restart count 1
Jan 19 06:41:15.805: INFO: ebs-csi-controller-5bd98b456f-bt645 started at 2023-01-19 06:24:13 +0000 UTC (0+5 container statuses recorded)
Jan 19 06:41:15.805: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 06:41:15.805: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 06:41:15.805: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 06:41:15.805: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:15.805: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:15.805: INFO: dns-controller-69987775c6-q62qz started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.805: INFO: Container dns-controller ready: true, restart count 0
Jan 19 06:41:15.805: INFO: aws-cloud-controller-manager-8rq4f started at 2023-01-19 06:24:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.805: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 19 06:41:15.805: INFO: etcd-manager-events-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.805: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 06:41:15.805: INFO: etcd-manager-main-i-0adb67e64e3ebad1e started at 2023-01-19 06:23:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:15.805: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 06:41:16.183: INFO:
Latency metrics for node i-0adb67e64e3ebad1e
Jan 19 06:41:16.183: INFO:
Logging node info for node i-0bc9010b80d8fb7a3
Jan 19 06:41:16.287: INFO: Node Info: &Node{ObjectMeta:{i-0bc9010b80d8fb7a3 a233aec6-3e3a-474b-9d9b-37e112ada5dd 18849 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bc9010b80d8fb7a3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0bc9010b80d8fb7a3 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.13 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bc9010b80d8fb7a3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:40:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0bc9010b80d8fb7a3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:39:59 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.13,},NodeAddress{Type:ExternalIP,Address:15.236.218.34,},NodeAddress{Type:InternalDNS,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bc9010b80d8fb7a3.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-236-218-34.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ede8175f1d6ab673e885453491f40,SystemUUID:ec2ede81-75f1-d6ab-673e-885453491f40,BootID:d8c02e70-1290-450f-9b63-595e3f9877b7,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 06:41:16.287: INFO:
Logging kubelet events for node i-0bc9010b80d8fb7a3
Jan 19 06:41:16.393: INFO:
Logging pods the kubelet thinks is on node i-0bc9010b80d8fb7a3
Jan 19 06:41:16.503: INFO: netserver-2 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:16.503: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-rw8m5 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:16.503: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4jfb4 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:16.503: INFO: coredns-559769c974-rfs6h started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container coredns ready: true, restart count 0
Jan 19 06:41:16.503: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-n5thx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:16.503: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-zdvsc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:16.503: INFO: pod-secrets-97b423cb-db9a-4eb1-a66a-95f0f3c3d055 started at 2023-01-19 06:40:08 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container secret-volume-test ready: false, restart count 0
Jan 19 06:41:16.503: INFO: fail-once-non-local-sp8qx started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container c ready: false, restart count 0
Jan 19 06:41:16.503: INFO: ebs-csi-node-p7m8r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:16.503: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:16.503: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:41:16.503: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kvlh9 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:16.503: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vk25m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:16.503: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-kwxms started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:16.503: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-wc82j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:16.503: INFO: cilium-4db85 started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:41:16.503: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:41:16.503: INFO: fail-once-non-local-j5lgj started at 2023-01-19 06:40:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container c ready: false, restart count 0
Jan 19 06:41:16.503: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-w9vxz started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:16.503: INFO: coredns-autoscaler-7cb5c5b969-l9mxh started at 2023-01-19 06:25:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container autoscaler ready: true, restart count 0
Jan 19 06:41:16.503: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-lgvhj started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:16.503: INFO: netserver-2 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:16.503: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:16.896: INFO:
Latency metrics for node i-0bc9010b80d8fb7a3
Jan 19 06:41:16.896: INFO:
Logging node info for node i-0fd7dedb902bd2b40
Jan 19 06:41:17.000: INFO: Node Info: &Node{ObjectMeta:{i-0fd7dedb902bd2b40 dcd1c2b0-c939-4b06-86d9-faa66cbd5f62 19268 0 2023-01-19 06:25:33 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0fd7dedb902bd2b40 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-0fd7dedb902bd2b40 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.15 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0fd7dedb902bd2b40"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:40:25 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 06:40:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-0fd7dedb902bd2b40,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:33 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:40:42 +0000 UTC,LastTransitionTime:2023-01-19 06:25:46 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.15,},NodeAddress{Type:ExternalIP,Address:13.36.168.174,},NodeAddress{Type:InternalDNS,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-0fd7dedb902bd2b40.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-36-168-174.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2507f02fe9694e6687a10a99b81476,SystemUUID:ec2507f0-2fe9-694e-6687-a10a99b81476,BootID:4e2ef5d6-9152-47a6-9581-43ae00972132,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0434bfb8d414b168a kubernetes.io/csi/ebs.csi.aws.com^vol-046138a1832bcff2c kubernetes.io/csi/ebs.csi.aws.com^vol-049dd3d103a06d67a kubernetes.io/csi/ebs.csi.aws.com^vol-06c6dac4c8bb96bd4 kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0729686b92f6e573c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-046138a1832bcff2c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06c6dac4c8bb96bd4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-049dd3d103a06d67a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0434bfb8d414b168a,DevicePath:,},},Config:nil,},}
Jan 19 06:41:17.000: INFO:
Logging kubelet events for node i-0fd7dedb902bd2b40
Jan 19 06:41:17.106: INFO:
Logging pods the kubelet thinks is on node i-0fd7dedb902bd2b40
Jan 19 06:41:17.218: INFO: cilium-2rqdw started at 2023-01-19 06:25:34 +0000 UTC (1+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 06:41:17.218: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 06:41:17.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gmz6h started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:17.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-qz8nr started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:17.218: INFO: hostexec-i-0fd7dedb902bd2b40-jbp89 started at 2023-01-19 06:40:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:41:17.218: INFO: ebs-csi-node-x9tpg started at 2023-01-19 06:25:34 +0000 UTC (0+3 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 06:41:17.218: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 06:41:17.218: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 06:41:17.218: INFO: inline-volume-tester-gt9hf started at 2023-01-19 06:34:10 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 19 06:41:17.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-6294b started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:17.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-58rnf started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:17.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-fc8jt started at 2023-01-19 06:34:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0
Jan 19 06:41:17.218: INFO: test-rs-h6zjm started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container httpd ready: false, restart count 0
Jan 19 06:41:17.218: INFO: inline-volume-tester-mf6q7 started at 2023-01-19 06:34:58 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 06:41:17.218: INFO: netserver-3 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:17.218: INFO: ss-1 started at 2023-01-19 06:36:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:17.218: INFO: netserver-3 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container webserver ready: true, restart count 0
Jan 19 06:41:17.218: INFO: ss2-1 started at 2023-01-19 06:35:55 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container webserver ready: false, restart count 0
Jan 19 06:41:17.218: INFO: test-grpc-730c5dd9-aa89-476c-a8f1-4b9fa8fe749d started at 2023-01-19 06:39:53 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container etcd ready: true, restart count 0
Jan 19 06:41:17.218: INFO: pod-9e5ec518-2fb0-460c-ad68-43bfbd7accf6 started at 2023-01-19 06:40:22 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container write-pod ready: false, restart count 0
Jan 19 06:41:17.218: INFO: host-test-container-pod started at 2023-01-19 06:40:31 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 06:41:17.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-hkwbn started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:17.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-45qq2 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:17.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jk9pc started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:17.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-q5n4f started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:17.218: INFO: pod-80d67e58-24ea-4871-866e-0ef63ad77eab started at 2023-01-19 06:34:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container write-pod ready: true, restart count 0
Jan 19 06:41:17.218: INFO: pod-3425cf74-675f-4345-8eb8-e79b1612a826 started at 2023-01-19 06:40:49 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container write-pod ready: false, restart count 0
Jan 19 06:41:17.218: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-ltgrx started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0
Jan 19 06:41:17.218: INFO: busybox-e0f4ec78-8a17-4742-b780-27f4c738c15e started at 2023-01-19 06:38:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 06:41:17.218: INFO: Container busybox ready: false, restart count 0
Jan 19 06:41:17.701: INFO:
Latency metrics for node i-0fd7dedb902bd2b40
[DeferCleanup (Each)] [sig-api-machinery] AdmissionWebhook [Privileged:ClusterAdmin]
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "webhook-2996" for this suite. �[38;5;243m01/19/23 06:41:17.701�[0m
�[1mSTEP:�[0m Destroying namespace "webhook-2996-markers" for this suite. �[38;5;243m01/19/23 06:41:17.807�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sReplicaSet\sshould\slist\sand\sdelete\sa\scollection\sof\sReplicaSets\s\[Conformance\]$'
test/e2e/apps/replica_set.go:585 k8s.io/kubernetes/test/e2e/apps.listRSDeleteCollection(0xc004f52a08?) test/e2e/apps/replica_set.go:585 +0x51a k8s.io/kubernetes/test/e2e/apps.glob..func9.7() test/e2e/apps/replica_set.go:166 +0x1d
[BeforeEach] [sig-apps] ReplicaSet set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 06:39:42.077�[0m Jan 19 06:39:42.077: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename replicaset �[38;5;243m01/19/23 06:39:42.078�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 06:39:42.391�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 06:39:42.597�[0m [BeforeEach] [sig-apps] ReplicaSet test/e2e/framework/metrics/init/init.go:31 [It] should list and delete a collection of ReplicaSets [Conformance] test/e2e/apps/replica_set.go:165 �[1mSTEP:�[0m Create a ReplicaSet �[38;5;243m01/19/23 06:39:42.803�[0m �[1mSTEP:�[0m Verify that the required pods have come up �[38;5;243m01/19/23 06:39:42.908�[0m Jan 19 06:39:43.012: INFO: Pod name sample-pod: Found 3 pods out of 3 �[1mSTEP:�[0m ensuring each pod is running �[38;5;243m01/19/23 06:39:43.012�[0m Jan 19 06:39:43.012: INFO: Waiting up to 5m0s for pod "test-rs-rw2w8" in namespace "replicaset-7381" to be "running" Jan 19 06:39:43.012: INFO: Waiting up to 5m0s for pod "test-rs-d95wt" in namespace "replicaset-7381" to be "running" Jan 19 06:39:43.012: INFO: Waiting up to 5m0s for pod "test-rs-h6zjm" in namespace "replicaset-7381" to be "running" Jan 19 06:39:43.116: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 103.925317ms Jan 19 06:39:43.116: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 103.899349ms Jan 19 06:39:43.116: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 103.918183ms Jan 19 06:39:45.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.208877929s Jan 19 06:39:45.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2.208832763s Jan 19 06:39:45.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.208864043s Jan 19 06:39:47.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.208362548s Jan 19 06:39:47.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4.20843824s Jan 19 06:39:47.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4.208453903s Jan 19 06:39:49.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 6.208592934s Jan 19 06:39:49.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 6.208596663s Jan 19 06:39:49.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 6.20869051s Jan 19 06:39:51.223: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 8.211225375s Jan 19 06:39:51.224: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 8.212486619s Jan 19 06:39:51.224: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 8.212462065s Jan 19 06:39:53.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 10.208536481s Jan 19 06:39:53.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 10.208548278s Jan 19 06:39:53.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 10.208550929s Jan 19 06:39:55.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 12.208151066s Jan 19 06:39:55.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 12.208108323s Jan 19 06:39:55.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 12.208077775s Jan 19 06:39:57.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 14.208406454s Jan 19 06:39:57.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 14.20850735s Jan 19 06:39:57.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 14.208448994s Jan 19 06:39:59.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 16.208368188s Jan 19 06:39:59.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 16.208435463s Jan 19 06:39:59.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 16.208513974s Jan 19 06:40:01.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 18.20865403s Jan 19 06:40:01.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 18.208611863s Jan 19 06:40:01.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 18.20877116s Jan 19 06:40:03.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 20.208606136s Jan 19 06:40:03.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 20.208636675s Jan 19 06:40:03.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 20.208701201s Jan 19 06:40:05.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 22.209157258s Jan 19 06:40:05.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 22.209232882s Jan 19 06:40:05.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 22.209254962s Jan 19 06:40:07.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 24.20816868s Jan 19 06:40:07.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 24.208244257s Jan 19 06:40:07.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 24.208250282s Jan 19 06:40:09.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 26.208677604s Jan 19 06:40:09.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 26.208598923s Jan 19 06:40:09.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 26.208675531s Jan 19 06:40:11.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 28.208568962s Jan 19 06:40:11.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 28.208527225s Jan 19 06:40:11.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 28.208530664s Jan 19 06:40:13.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 30.208501337s Jan 19 06:40:13.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 30.208547346s Jan 19 06:40:13.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 30.208583627s Jan 19 06:40:15.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 32.20836962s Jan 19 06:40:15.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 32.208462593s Jan 19 06:40:15.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 32.208442829s Jan 19 06:40:17.223: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 34.211178062s Jan 19 06:40:17.223: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 34.211249393s Jan 19 06:40:17.223: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 34.211263581s Jan 19 06:40:19.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 36.209543099s Jan 19 06:40:19.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 36.209467458s Jan 19 06:40:19.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 36.209575872s Jan 19 06:40:21.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 38.209521045s Jan 19 06:40:21.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 38.209578215s Jan 19 06:40:21.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 38.209490435s Jan 19 06:40:23.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 40.208778982s Jan 19 06:40:23.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 40.208748034s Jan 19 06:40:23.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 40.208723763s Jan 19 06:40:25.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 42.209308581s Jan 19 06:40:25.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 42.209598975s Jan 19 06:40:25.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 42.209629268s Jan 19 06:40:27.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 44.209385035s Jan 19 06:40:27.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 44.209309443s Jan 19 06:40:27.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 44.209340021s Jan 19 06:40:29.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 46.208990199s Jan 19 06:40:29.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 46.208914557s Jan 19 06:40:29.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 46.208945089s Jan 19 06:40:31.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 48.210415865s Jan 19 06:40:31.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 48.210416057s Jan 19 06:40:31.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 48.210491346s Jan 19 06:40:33.224: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 50.211708249s Jan 19 06:40:33.224: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 50.211707252s Jan 19 06:40:33.224: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 50.211911149s Jan 19 06:40:35.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 52.209527059s Jan 19 06:40:35.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 52.209557664s Jan 19 06:40:35.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 52.209724538s Jan 19 06:40:37.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 54.208784083s Jan 19 06:40:37.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 54.208727886s Jan 19 06:40:37.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 54.208802444s Jan 19 06:40:39.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 56.209112904s Jan 19 06:40:39.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 56.209196949s Jan 19 06:40:39.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 56.209195831s Jan 19 06:40:41.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 58.21021306s Jan 19 06:40:41.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 58.210182463s Jan 19 06:40:41.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 58.210345158s Jan 19 06:40:43.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.208875672s Jan 19 06:40:43.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.209045908s Jan 19 06:40:43.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.209180274s Jan 19 06:40:45.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.209232397s Jan 19 06:40:45.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.209328933s Jan 19 06:40:45.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.209972553s Jan 19 06:40:47.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.20873793s Jan 19 06:40:47.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.208813657s Jan 19 06:40:47.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.208768634s Jan 19 06:40:49.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.208342409s Jan 19 06:40:49.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.208415418s Jan 19 06:40:49.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.208426644s Jan 19 06:40:51.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.209395455s Jan 19 06:40:51.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.209370937s Jan 19 06:40:51.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.20946546s Jan 19 06:40:53.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.208785077s Jan 19 06:40:53.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.20883623s Jan 19 06:40:53.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.208835508s Jan 19 06:40:55.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.209520133s Jan 19 06:40:55.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.209439217s Jan 19 06:40:55.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.209520809s Jan 19 06:40:57.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.209705418s Jan 19 06:40:57.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.209750567s Jan 19 06:40:57.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.209674868s Jan 19 06:40:59.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.208519027s Jan 19 06:40:59.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.208549635s Jan 19 06:40:59.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.208674117s Jan 19 06:41:01.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.208965149s Jan 19 06:41:01.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.208918832s Jan 19 06:41:01.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.208888238s Jan 19 06:41:03.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.209676073s Jan 19 06:41:03.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.209706768s Jan 19 06:41:03.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.209985898s Jan 19 06:41:05.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.209227244s Jan 19 06:41:05.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.21002096s Jan 19 06:41:05.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.209981571s Jan 19 06:41:07.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.208587725s Jan 19 06:41:07.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.208607487s Jan 19 06:41:07.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.208939808s Jan 19 06:41:09.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.209555232s Jan 19 06:41:09.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.209614413s Jan 19 06:41:09.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.209595773s Jan 19 06:41:11.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.208682873s Jan 19 06:41:11.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.208652274s Jan 19 06:41:11.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.20873566s Jan 19 06:41:13.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.208860382s Jan 19 06:41:13.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.208879652s Jan 19 06:41:13.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.208910352s Jan 19 06:41:15.227: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.215368733s Jan 19 06:41:15.227: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.215448541s Jan 19 06:41:15.228: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.216269685s Jan 19 06:41:17.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.208471006s Jan 19 06:41:17.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.208568392s Jan 19 06:41:17.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.208614238s Jan 19 06:41:19.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.210235694s Jan 19 06:41:19.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.210190717s Jan 19 06:41:19.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.210160129s Jan 19 06:41:21.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.209289076s Jan 19 06:41:21.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.20921337s Jan 19 06:41:21.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.209255348s Jan 19 06:41:23.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.2088186s Jan 19 06:41:23.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.208788094s Jan 19 06:41:23.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.208863736s Jan 19 06:41:25.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.208661773s Jan 19 06:41:25.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.208706705s Jan 19 06:41:25.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.2086311s Jan 19 06:41:27.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.210276974s Jan 19 06:41:27.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.210231928s Jan 19 06:41:27.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.210226125s Jan 19 06:41:29.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.209570984s Jan 19 06:41:29.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.2096718s Jan 19 06:41:29.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.20959615s Jan 19 06:41:31.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.208388166s Jan 19 06:41:31.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.208418692s Jan 19 06:41:31.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.208535334s Jan 19 06:41:33.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.208869123s Jan 19 06:41:33.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.208835795s Jan 19 06:41:33.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.208805047s Jan 19 06:41:35.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.209337794s Jan 19 06:41:35.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.209395971s Jan 19 06:41:35.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.209380256s Jan 19 06:41:37.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.20873762s Jan 19 06:41:37.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.208692585s Jan 19 06:41:37.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.208771961s Jan 19 06:41:39.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.209801583s Jan 19 06:41:39.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.209756531s Jan 19 06:41:39.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.209726008s Jan 19 06:41:41.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.208571852s Jan 19 06:41:41.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.20852568s Jan 19 06:41:41.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.208494666s Jan 19 06:41:43.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.208514128s Jan 19 06:41:43.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.208544737s Jan 19 06:41:43.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.208648676s Jan 19 06:41:45.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.209740297s Jan 19 06:41:45.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.210515292s Jan 19 06:41:45.223: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.210525241s Jan 19 06:41:47.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.208373767s Jan 19 06:41:47.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.208430222s Jan 19 06:41:47.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.208486391s Jan 19 06:41:49.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.209518082s Jan 19 06:41:49.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.209487468s Jan 19 06:41:49.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.209680328s Jan 19 06:41:51.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.208372834s Jan 19 06:41:51.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.208476626s Jan 19 06:41:51.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.208462344s Jan 19 06:41:53.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.209833963s Jan 19 06:41:53.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.209912181s Jan 19 06:41:53.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.209842137s Jan 19 06:41:55.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.209049896s Jan 19 06:41:55.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.209211089s Jan 19 06:41:55.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.209576161s Jan 19 06:41:57.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.210018143s Jan 19 06:41:57.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.21007259s Jan 19 06:41:57.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.210129562s Jan 19 06:41:59.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.208633566s Jan 19 06:41:59.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.208677313s Jan 19 06:41:59.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.208736755s Jan 19 06:42:01.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.208526139s Jan 19 06:42:01.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.208513545s Jan 19 06:42:01.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.208669822s Jan 19 06:42:03.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.209914252s Jan 19 06:42:03.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.209869211s Jan 19 06:42:03.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.209845435s Jan 19 06:42:05.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.208416236s Jan 19 06:42:05.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.208370433s Jan 19 06:42:05.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.208403081s Jan 19 06:42:07.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.208878302s Jan 19 06:42:07.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.208833454s Jan 19 06:42:07.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.208832259s Jan 19 06:42:09.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.208336835s Jan 19 06:42:09.220: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.208390927s Jan 19 06:42:09.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.208358024s Jan 19 06:42:11.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.208604156s Jan 19 06:42:11.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.20858359s Jan 19 06:42:11.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.208681616s Jan 19 06:42:13.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.208697262s Jan 19 06:42:13.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.20875875s Jan 19 06:42:13.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.208803778s Jan 19 06:42:15.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.209381859s Jan 19 06:42:15.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.209443561s Jan 19 06:42:15.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.209640156s Jan 19 06:42:17.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.208662173s Jan 19 06:42:17.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.208822626s Jan 19 06:42:17.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.20884557s Jan 19 06:42:19.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.208608507s Jan 19 06:42:19.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.208569755s Jan 19 06:42:19.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.208603809s Jan 19 06:42:21.220: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.208411553s Jan 19 06:42:21.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.208486894s Jan 19 06:42:21.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.208902975s Jan 19 06:42:23.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.208570005s Jan 19 06:42:23.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.208654301s Jan 19 06:42:23.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.208841626s Jan 19 06:42:25.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.209201292s Jan 19 06:42:25.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.209246656s Jan 19 06:42:25.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.209170854s Jan 19 06:42:27.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.208843541s Jan 19 06:42:27.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.208895283s Jan 19 06:42:27.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.208976817s Jan 19 06:42:29.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.209518614s Jan 19 06:42:29.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.209442944s Jan 19 06:42:29.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.209473636s Jan 19 06:42:31.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.208844497s Jan 19 06:42:31.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.208819935s Jan 19 06:42:31.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.208950811s Jan 19 06:42:33.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.209405572s Jan 19 06:42:33.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.209463531s Jan 19 06:42:33.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.20953246s Jan 19 06:42:35.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.209928625s Jan 19 06:42:35.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.210037326s Jan 19 06:42:35.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.209993624s Jan 19 06:42:37.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.209110663s Jan 19 06:42:37.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.209049132s Jan 19 06:42:37.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.20920295s Jan 19 06:42:39.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.208993791s Jan 19 06:42:39.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.208932579s Jan 19 06:42:39.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.209040645s Jan 19 06:42:41.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.209539408s Jan 19 06:42:41.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.209533537s Jan 19 06:42:41.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.209502926s Jan 19 06:42:43.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.209775111s Jan 19 06:42:43.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.209744902s Jan 19 06:42:43.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.209886975s Jan 19 06:42:45.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.209013163s Jan 19 06:42:45.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.209107133s Jan 19 06:42:45.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.209146635s Jan 19 06:42:47.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.209273167s Jan 19 06:42:47.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.209228126s Jan 19 06:42:47.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.209324998s Jan 19 06:42:49.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.208540794s Jan 19 06:42:49.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.208655476s Jan 19 06:42:49.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.208645925s Jan 19 06:42:51.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.208739689s Jan 19 06:42:51.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.208694766s Jan 19 06:42:51.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.208664157s Jan 19 06:42:53.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.209028502s Jan 19 06:42:53.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.209110623s Jan 19 06:42:53.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.209092069s Jan 19 06:42:55.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.20969652s Jan 19 06:42:55.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.209667779s Jan 19 06:42:55.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.209722939s Jan 19 06:42:57.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.209150784s Jan 19 06:42:57.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.209181388s Jan 19 06:42:57.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.209226442s Jan 19 06:42:59.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.209244651s Jan 19 06:42:59.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.209168202s Jan 19 06:42:59.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.209198872s Jan 19 06:43:01.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.209058744s Jan 19 06:43:01.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.209028742s Jan 19 06:43:01.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.209164435s Jan 19 06:43:03.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.20889732s Jan 19 06:43:03.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.208821757s Jan 19 06:43:03.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.208863802s Jan 19 06:43:05.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.209754363s Jan 19 06:43:05.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.209830011s Jan 19 06:43:05.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.20979343s Jan 19 06:43:07.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.208708988s Jan 19 06:43:07.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.208785462s Jan 19 06:43:07.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.208809024s Jan 19 06:43:09.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.20886419s Jan 19 06:43:09.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.20890398s Jan 19 06:43:09.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.208828332s Jan 19 06:43:11.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.209247686s Jan 19 06:43:11.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.209188598s Jan 19 06:43:11.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.209228178s Jan 19 06:43:13.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.209045535s Jan 19 06:43:13.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.209014911s Jan 19 06:43:13.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.209170647s Jan 19 06:43:15.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.209134838s Jan 19 06:43:15.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.209283776s Jan 19 06:43:15.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.209305055s Jan 19 06:43:17.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.209666458s Jan 19 06:43:17.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.209635807s Jan 19 06:43:17.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.209749949s Jan 19 06:43:19.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.208681555s Jan 19 06:43:19.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.20863816s Jan 19 06:43:19.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.208656285s Jan 19 06:43:21.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.208895554s Jan 19 06:43:21.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.208850565s Jan 19 06:43:21.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.208834746s Jan 19 06:43:23.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.20885697s Jan 19 06:43:23.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.208924593s Jan 19 06:43:23.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.208916368s Jan 19 06:43:25.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.20936528s Jan 19 06:43:25.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.209520134s Jan 19 06:43:25.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.209477571s Jan 19 06:43:27.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.208659536s Jan 19 06:43:27.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.208901311s Jan 19 06:43:27.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.208880296s Jan 19 06:43:29.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.21012193s Jan 19 06:43:29.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.210167093s Jan 19 06:43:29.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.210090641s Jan 19 06:43:31.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.209862776s Jan 19 06:43:31.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.209824983s Jan 19 06:43:31.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.209810898s Jan 19 06:43:33.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.209653477s Jan 19 06:43:33.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.209622884s Jan 19 06:43:33.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.209745089s Jan 19 06:43:35.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.209463777s Jan 19 06:43:35.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.209518665s Jan 19 06:43:35.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.2095626s Jan 19 06:43:37.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.210171545s Jan 19 06:43:37.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.210259116s Jan 19 06:43:37.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.210223383s Jan 19 06:43:39.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.209198865s Jan 19 06:43:39.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.209340937s Jan 19 06:43:39.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.209308313s Jan 19 06:43:41.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.210380796s Jan 19 06:43:41.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.210503566s Jan 19 06:43:41.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.210448808s Jan 19 06:43:43.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.20953655s Jan 19 06:43:43.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.209578122s Jan 19 06:43:43.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.209725764s Jan 19 06:43:45.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.208648531s Jan 19 06:43:45.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.208760946s Jan 19 06:43:45.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.208905242s Jan 19 06:43:47.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.20882518s Jan 19 06:43:47.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.208833157s Jan 19 06:43:47.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.208928061s Jan 19 06:43:49.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.209526764s Jan 19 06:43:49.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.209467092s Jan 19 06:43:49.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.209540982s Jan 19 06:43:51.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.208577376s Jan 19 06:43:51.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.208673043s Jan 19 06:43:51.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.208637658s Jan 19 06:43:53.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.209105833s Jan 19 06:43:53.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.209105013s Jan 19 06:43:53.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.209196838s Jan 19 06:43:55.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.209319785s Jan 19 06:43:55.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.209350323s Jan 19 06:43:55.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.209395358s Jan 19 06:43:57.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.210134056s Jan 19 06:43:57.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.210189574s Jan 19 06:43:57.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.210114583s Jan 19 06:43:59.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.208700339s Jan 19 06:43:59.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.208669792s Jan 19 06:43:59.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.208822212s Jan 19 06:44:01.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.209115465s Jan 19 06:44:01.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.209136345s Jan 19 06:44:01.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.209105831s Jan 19 06:44:03.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.209437131s Jan 19 06:44:03.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.209793303s Jan 19 06:44:03.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.209741891s Jan 19 06:44:05.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.209410286s Jan 19 06:44:05.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.209465949s Jan 19 06:44:05.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.209460009s Jan 19 06:44:07.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.208861014s Jan 19 06:44:07.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.208831591s Jan 19 06:44:07.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.208844933s Jan 19 06:44:09.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.209077569s Jan 19 06:44:09.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.20911142s Jan 19 06:44:09.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.209153097s Jan 19 06:44:11.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.209167579s Jan 19 06:44:11.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.209091972s Jan 19 06:44:11.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.209190386s Jan 19 06:44:13.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.208560346s Jan 19 06:44:13.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.209111295s Jan 19 06:44:13.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.209233841s Jan 19 06:44:15.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.209549646s Jan 19 06:44:15.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.209566443s Jan 19 06:44:15.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.20956521s Jan 19 06:44:17.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.209142488s Jan 19 06:44:17.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.209096367s Jan 19 06:44:17.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.209143621s Jan 19 06:44:19.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.210174309s Jan 19 06:44:19.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.210098446s Jan 19 06:44:19.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.210190515s Jan 19 06:44:21.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.209488824s Jan 19 06:44:21.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.209443783s Jan 19 06:44:21.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.209443026s Jan 19 06:44:23.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.209386092s Jan 19 06:44:23.223: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.210568065s Jan 19 06:44:23.223: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.2106764s Jan 19 06:44:25.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.209522038s Jan 19 06:44:25.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.209490411s Jan 19 06:44:25.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.20957495s Jan 19 06:44:27.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.209758316s Jan 19 06:44:27.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.209760964s Jan 19 06:44:27.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.209835323s Jan 19 06:44:29.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.208708598s Jan 19 06:44:29.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.208783038s Jan 19 06:44:29.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.208813452s Jan 19 06:44:31.222: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.210115134s Jan 19 06:44:31.222: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.21006822s Jan 19 06:44:31.222: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.210063923s Jan 19 06:44:33.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.208745668s Jan 19 06:44:33.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.2088213s Jan 19 06:44:33.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.208806099s Jan 19 06:44:35.221: INFO: Pod "test-rs-h6zjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.209291241s Jan 19 06:44:35.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.209330756s Jan 19 06:44:35.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.209375767s Jan 19 06:44:37.220: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.208489892s Jan 19 06:44:37.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.209006015s Jan 19 06:44:37.221: INFO: Pod "test-rs-h6zjm": Phase="Running", Reason="", readiness=true. Elapsed: 4m54.209117267s Jan 19 06:44:37.221: INFO: Pod "test-rs-h6zjm" satisfied condition "running" Jan 19 06:44:39.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.208588429s Jan 19 06:44:39.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.208633475s Jan 19 06:44:41.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.208892533s Jan 19 06:44:41.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.208847438s Jan 19 06:44:43.221: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.20875204s Jan 19 06:44:43.221: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.208743157s Jan 19 06:44:43.325: INFO: Pod "test-rs-rw2w8": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.313336886s Jan 19 06:44:43.325: INFO: Pod "test-rs-d95wt": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.313317742s Jan 19 06:44:43.325: INFO: Unexpected error: Failed to create pods: failed to wait for pods running: [timed out while waiting for pod replicaset-7381/test-rs-rw2w8 to be running timed out while waiting for pod replicaset-7381/test-rs-d95wt to be running]: <*errors.errorString | 0xc0013d0810>: { s: "failed to wait for pods running: [timed out while waiting for pod replicaset-7381/test-rs-rw2w8 to be running timed out while waiting for pod replicaset-7381/test-rs-d95wt to be running]", } Jan 19 06:44:43.326: FAIL: Failed to create pods: failed to wait for pods running: [timed out while waiting for pod replicaset-7381/test-rs-rw2w8 to be running timed out while waiting for pod replicaset-7381/test-rs-d95wt to be running]: failed to wait for pods running: [timed out while waiting for pod replicaset-7381/test-rs-rw2w8 to be running timed out while waiting for pod replicaset-7381/test-rs-d95wt to be running] Full Stack Trace k8s.io/kubernetes/test/e2e/apps.listRSDeleteCollection(0xc004f52a08?) test/e2e/apps/replica_set.go:585 +0x51a k8s.io/kubernetes/test/e2e/apps.glob..func9.7() test/e2e/apps/replica_set.go:166 +0x1d [AfterEach] [sig-apps] ReplicaSet test/e2e/framework/node/init/init.go:32 Jan 19 06:44:43.326: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] ReplicaSet test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-apps] ReplicaSet dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 06:44:43.431�[0m �[1mSTEP:�[0m Collecting events from namespace "replicaset-7381". �[38;5;243m01/19/23 06:44:43.432�[0m �[1mSTEP:�[0m Found 39 events. �[38;5;243m01/19/23 06:44:43.537�[0m Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:42 +0000 UTC - event for test-rs: {replicaset-controller } SuccessfulCreate: Created pod: test-rs-d95wt Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:42 +0000 UTC - event for test-rs: {replicaset-controller } SuccessfulCreate: Created pod: test-rs-h6zjm Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:42 +0000 UTC - event for test-rs: {replicaset-controller } SuccessfulCreate: Created pod: test-rs-rw2w8 Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:42 +0000 UTC - event for test-rs-d95wt: {default-scheduler } Scheduled: Successfully assigned replicaset-7381/test-rs-d95wt to i-01c8a84101e2eeddc Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:42 +0000 UTC - event for test-rs-h6zjm: {default-scheduler } Scheduled: Successfully assigned replicaset-7381/test-rs-h6zjm to i-0fd7dedb902bd2b40 Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:42 +0000 UTC - event for test-rs-rw2w8: {default-scheduler } Scheduled: Successfully assigned replicaset-7381/test-rs-rw2w8 to i-02873c346fcadbca8 Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:43 +0000 UTC - event for test-rs-d95wt: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2cfb78a2671a0f61f5302ac1eca1eb0a5e30fa56e0661e1c8007113d26540582": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:43 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "10182d114cebef63f7d623daf38c793d230f6172fca8ce97f73dfd194c4edb0d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:43 +0000 UTC - event for test-rs-rw2w8: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "57e1413ccc4bc35d961f68a5e1c6a7af4585dace205e9d5f9213bcc78de47fb4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:54 +0000 UTC - event for test-rs-d95wt: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3fe0204b90998c43e1ea04a6e10eb770b17f4321b57a887d06f5900d7cfc174b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:57 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cba57be868634abc517413e578000b0c7667ad138535ec30726f9b783b700ca7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:39:57 +0000 UTC - event for test-rs-rw2w8: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "497c97776128f08a67fbda22e359fe34f239e3de542403b62a4daf693c5bc76c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:10 +0000 UTC - event for test-rs-d95wt: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "028dbe9d21d1ed9f5abecb07d6368e7c78ca8ca40fb895a2c9ca9fbb0645a52b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:10 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3988b0cc2d38473081f2c43ab9af6a64b28eca4d54a614cce768d8c9e391ca3e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:13 +0000 UTC - event for test-rs-rw2w8: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4e17088d34537c07d45b6a2e3ba112da9ebbbfb9d551ed8a579077ff902982a9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:22 +0000 UTC - event for test-rs-d95wt: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "da9180092b55e0a406c2e9ad848af6f902727d61a2439124d39aaaddccf7a1ea": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:23 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6e116a4927e1bae2e382a3898ff6990baf084887e9bf93989be79e7fb107231b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:26 +0000 UTC - event for test-rs-rw2w8: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c8028ecfd005c4229a0e365770ae60229492f181e65e5db8221a862ad35cdfd2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:34 +0000 UTC - event for test-rs-d95wt: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cdd9f6e382757f53bddc985068229154d7e93d8929ecee74596d584b586dd33e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:37 +0000 UTC - event for test-rs-rw2w8: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5f9719cddf39d306144400bf38b917c10613c98f58b44e771d1b904d61260c39": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:39 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a6b999124ce0dd837ad3b0e0e54c633b85183805f7a41fccd489f864a487ed7b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:48 +0000 UTC - event for test-rs-d95wt: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "da3ae1a2d19d39655acf125873d61b28dd9e35f6b49cdf3ca04fe91d117280eb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:51 +0000 UTC - event for test-rs-rw2w8: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c0ddc230d570438a78db8660384dff921a050d76d20974cf9110031b1ad15146": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:54 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8228c78ceee404730dffac25569ba018a3d9672258b1de2f141c95f7819c4798": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:40:59 +0000 UTC - event for test-rs-d95wt: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2cebf98a874226a31ed8e10ed5f580fd18fa895c7673cfd194ef621d115acd01": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:41:05 +0000 UTC - event for test-rs-rw2w8: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "501c70cd2c53beccddf566a37a0bb93ceec5805285dde7029a514449de5f26d9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:41:07 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1cb3ec605d807d23924cf584a59b577ae4e5cc287f7fc2aeeb3b884ceaf19018": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:41:10 +0000 UTC - event for test-rs-d95wt: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "193d4208cd0ab222bac8099cdba033e990c690b806b93885d6b6e9bb226bf8f0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:41:18 +0000 UTC - event for test-rs-rw2w8: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "32bb577d2823077188348b155d67061f9b19d0a87dcaf70e59624d6166e692eb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:41:19 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "57ff6ca56b45e46f37cda7c99cb73dcf896a3519560db43cbe4a0bcc68bca1c9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:41:21 +0000 UTC - event for test-rs-d95wt: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a79c35640016d13480dd7d2e7cb8844466e3096ad29c6ea0e04091c574619518": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:41:32 +0000 UTC - event for test-rs-rw2w8: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "91e205158d7fb8272efc9d8e820c75268b5a54b0683e287fe6ddb2f51c4187b2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:41:34 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "68a7b8e0b2263ab0462b1586b4f25048b9755a3df06517e455905597ce5f2410": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:41:35 +0000 UTC - event for test-rs-d95wt: {kubelet i-01c8a84101e2eeddc} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a844fa27882da49d8b9d5e0fa978e5c9315c754b52e2a7c8bf934ad8821c468b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:41:45 +0000 UTC - event for test-rs-rw2w8: {kubelet i-02873c346fcadbca8} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c6079bade8c50dbbfe7a30530d66443aa2176c96643a6b290e73c41ec99783cd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:41:49 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "000b2805d3b5b6f69f9fb37786f467dbdeee58fc23c4d885fd686cec2cfa8cb3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 06:44:43.537: INFO: At 2023-01-19 06:44:35 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} Started: Started container httpd Jan 19 06:44:43.537: INFO: At 2023-01-19 06:44:35 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} Created: Created container httpd Jan 19 06:44:43.537: INFO: At 2023-01-19 06:44:35 +0000 UTC - event for test-rs-h6zjm: {kubelet i-0fd7dedb902bd2b40} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine Jan 19 06:44:43.641: INFO: POD NODE PHASE GRACE CONDITIONS Jan 19 06:44:43.641: INFO: test-rs-d95wt i-01c8a84101e2eeddc Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:39:42 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:39:42 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:39:42 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:39:42 +0000 UTC }] Jan 19 06:44:43.641: INFO: test-rs-h6zjm i-0fd7dedb902bd2b40 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:39:42 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:44:35 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:44:35 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:39:42 +0000 UTC }] Jan 19 06:44:43.641: INFO: test-rs-rw2w8 i-02873c346fcadbca8 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:39:42 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:39:42 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:39:42 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 06:39:42 +0000 UTC }] Jan 19 06:44:43.641: INFO: Jan 19 06:44:43.748: INFO: Unable to fetch replicaset-7381/test-rs-d95wt/httpd logs: the server rejected our request for an unknown reason (get pods test-rs-d95wt) Jan 19 06:44:43.961: INFO: Unable to fetch replicaset-7381/test-rs-rw2w8/httpd logs: the server rejected our request for an unknown reason (get pods test-rs-rw2w8) Jan 19 06:44:44.066: INFO: Logging node info for node i-01c8a84101e2eeddc Jan 19 06:44:44.170: INFO: Node Info: &Node{ObjectMeta:{i-01c8a84101e2eeddc de952a6e-ca42-4dc7-9079-e5f5df729733 19350 0 2023-01-19 06:25:32 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01c8a84101e2eeddc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-01c8a84101e2eeddc topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.49 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01c8a84101e2eeddc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 06:25:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 06:34:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 06:40:58 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-3a/i-01c8a84101e2eeddc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:32 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 06:40:58 +0000 UTC,LastTransitionTime:2023-01-19 06:25:45 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.49,},NodeAddress{Type:ExternalIP,Address:15.188.127.11,},NodeAddress{Type:InternalDNS,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:Hostname,Address:i-01c8a84101e2eeddc.eu-west-3.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-188-127-11.eu-west-3.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2d066c25678610b99acde89c731a76,SystemUUID:ec2d066c-2567-8610-b99a-cde89c731a76,BootID:3983005e-c9f1-4922-bf79-f80a745c9c94,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 06:44:44.170: INFO: Logging kubelet events for node i-01c8a84101e2eeddc Jan 19 06:44:44.277: INFO: Logging pods the kubelet thinks is on node i-01c8a84101e2eeddc Jan 19 06:44:44.387: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-vrmzk started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:44:44.387: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-nkg9j started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:44:44.387: INFO: ebs-csi-node-52j6r started at 2023-01-19 06:25:33 +0000 UTC (0+3 container statuses recorded) Jan 19 06:44:44.387: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 06:44:44.387: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 06:44:44.387: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 06:44:44.387: INFO: test-rs-d95wt started at 2023-01-19 06:39:42 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container httpd ready: false, restart count 0 Jan 19 06:44:44.387: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-87z7m started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:44:44.387: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-d82dm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: false, restart count 0 Jan 19 06:44:44.387: INFO: cilium-kt55x started at 2023-01-19 06:25:33 +0000 UTC (1+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 06:44:44.387: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 06:44:44.387: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-5f725 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:44:44.387: INFO: csi-hostpathplugin-0 started at 2023-01-19 06:40:21 +0000 UTC (0+7 container statuses recorded) Jan 19 06:44:44.387: INFO: Container csi-attacher ready: false, restart count 0 Jan 19 06:44:44.387: INFO: Container csi-provisioner ready: false, restart count 0 Jan 19 06:44:44.387: INFO: Container csi-resizer ready: false, restart count 0 Jan 19 06:44:44.387: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 19 06:44:44.387: INFO: Container hostpath ready: false, restart count 0 Jan 19 06:44:44.387: INFO: Container liveness-probe ready: false, restart count 0 Jan 19 06:44:44.387: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 19 06:44:44.387: INFO: coredns-559769c974-mjt6q started at 2023-01-19 06:26:14 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container coredns ready: true, restart count 0 Jan 19 06:44:44.387: INFO: netserver-0 started at 2023-01-19 06:40:17 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container webserver ready: true, restart count 0 Jan 19 06:44:44.387: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jngrg started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:44:44.387: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-4nj84 started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:44:44.387: INFO: pod-handle-http-request started at 2023-01-19 06:39:46 +0000 UTC (0+2 container statuses recorded) Jan 19 06:44:44.387: INFO: Container container-handle-http-request ready: false, restart count 0 Jan 19 06:44:44.387: INFO: Container container-handle-https-request ready: false, restart count 0 Jan 19 06:44:44.387: INFO: netserver-0 started at 2023-01-19 06:34:59 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container webserver ready: true, restart count 0 Jan 19 06:44:44.387: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-gzbxm started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:44:44.387: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-jlhlb started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:44:44.387: INFO: cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e-dnqqv started at 2023-01-19 06:34:26 +0000 UTC (0+1 container statuses recorded) Jan 19 06:44:44.387: INFO: Container cleanup40-68c0cf82-1135-4302-9b38-8e63e283a02e ready: true, restart count 0 Jan 19 06:44:44.782: INFO: Latency metrics for node i-01c8a84101e2eeddc Jan 19 06:44:44.782: INFO: Logging node info for node i-02873c346fcadbca8 Jan 19 06:44:44.887: INFO: Node Info: &Node{ObjectMeta:{i-02873c346fcadbca8 b6b38d81-4c4f-47c3-8a5d-ac5718bb26a8 19646 0 2023-01-19 06:25:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-3 failure-domain.beta.kubernetes.io/zone:eu-west-3a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02873c346fcadbca8 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-3a topology.hostpath.csi/node:i-02873c346fcadbca8 topology.kubernetes.io/region:eu-west-3 topology.kubernetes.io/zone:eu-west-3a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-02873c346fcadbca8"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 06:25:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type