e2e-kops-grid-cilium-eni-deb10-k26-ko26 #1610825486617808896 Results

Test Failures

Kubernetes e2e suite [It] External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource 5m19s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sexisting\sdirectories\swhen\sreadOnly\sspecified\sin\sthe\svolumeSource$'

test/e2e/framework/pod/output/output.go:237
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc00476f200?, {0x75c02b7?, 0x0?}, 0xc00476f200, 0x0, {0xc003e47e70, 0x1, 0x1}, 0x22?)
	test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
	test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc0018d93b0, {0xc004dfb7e8, 0x16}, 0xc00476f200, 0x0)
	test/e2e/storage/testsuites/subpath.go:691 +0x15c
k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func18()
	test/e2e/storage/testsuites/subpath.go:411 +0x24f
				[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/05/23 02:45:06.348�[0m
Jan  5 02:45:06.348: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename provisioning �[38;5;243m01/05/23 02:45:06.35�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/05/23 02:45:06.68�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/05/23 02:45:06.898�[0m
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
  test/e2e/framework/metrics/init/init.go:31
[It] should support existing directories when readOnly specified in the volumeSource
  test/e2e/storage/testsuites/subpath.go:395
Jan  5 02:45:07.116: INFO: Creating resource for dynamic PV
Jan  5 02:45:07.117: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
�[1mSTEP:�[0m creating a StorageClass provisioning-8207-e2e-scbqhdw �[38;5;243m01/05/23 02:45:07.117�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/05/23 02:45:07.228�[0m
Jan  5 02:45:07.228: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating pod pod-subpath-test-dynamicpv-rdf9 �[38;5;243m01/05/23 02:45:07.449�[0m
�[1mSTEP:�[0m Creating a pod to test subpath �[38;5;243m01/05/23 02:45:07.449�[0m
Jan  5 02:45:07.562: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-rdf9" in namespace "provisioning-8207" to be "Succeeded or Failed"
Jan  5 02:45:07.672: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 109.366634ms
Jan  5 02:45:09.781: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218990081s
Jan  5 02:45:11.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4.219694688s
Jan  5 02:45:13.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 6.220065477s
Jan  5 02:45:15.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 8.220361684s
Jan  5 02:45:17.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 10.219916111s
Jan  5 02:45:19.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 12.219792631s
Jan  5 02:45:21.784: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 14.221649845s
Jan  5 02:45:23.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 16.219165435s
Jan  5 02:45:25.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 18.219694616s
Jan  5 02:45:27.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 20.220222684s
Jan  5 02:45:29.785: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 22.222468925s
Jan  5 02:45:31.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 24.219808373s
Jan  5 02:45:33.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 26.219054285s
Jan  5 02:45:35.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 28.219883704s
Jan  5 02:45:37.781: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 30.218768944s
Jan  5 02:45:39.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 32.21993601s
Jan  5 02:45:41.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 34.219815598s
Jan  5 02:45:43.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 36.219885041s
Jan  5 02:45:45.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 38.219698813s
Jan  5 02:45:47.790: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 40.227237018s
Jan  5 02:45:49.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 42.22010231s
Jan  5 02:45:51.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 44.220068118s
Jan  5 02:45:53.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 46.220031116s
Jan  5 02:45:55.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 48.219665061s
Jan  5 02:45:57.781: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 50.218999502s
Jan  5 02:45:59.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 52.219856621s
Jan  5 02:46:01.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 54.219947074s
Jan  5 02:46:03.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 56.219927366s
Jan  5 02:46:05.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 58.219716579s
Jan  5 02:46:07.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.219157799s
Jan  5 02:46:09.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.219914235s
Jan  5 02:46:11.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.219069838s
Jan  5 02:46:13.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.219915331s
Jan  5 02:46:15.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.219982773s
Jan  5 02:46:17.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.219116653s
Jan  5 02:46:19.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.219616552s
Jan  5 02:46:21.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.220011825s
Jan  5 02:46:23.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.219934857s
Jan  5 02:46:25.788: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.225682573s
Jan  5 02:46:27.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.220284872s
Jan  5 02:46:29.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.220033081s
Jan  5 02:46:31.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.21949769s
Jan  5 02:46:33.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.219127838s
Jan  5 02:46:35.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.220021767s
Jan  5 02:46:37.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.220886029s
Jan  5 02:46:39.784: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.221080991s
Jan  5 02:46:41.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.219175064s
Jan  5 02:46:43.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.219334697s
Jan  5 02:46:45.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.219258301s
Jan  5 02:46:47.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.22019998s
Jan  5 02:46:49.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.219750791s
Jan  5 02:46:51.785: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.222370246s
Jan  5 02:46:53.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.219247252s
Jan  5 02:46:55.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.219398231s
Jan  5 02:46:57.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.219115811s
Jan  5 02:46:59.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.219121293s
Jan  5 02:47:01.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.219969717s
Jan  5 02:47:03.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.219743687s
Jan  5 02:47:05.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.220421275s
Jan  5 02:47:07.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.220167742s
Jan  5 02:47:09.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.219370018s
Jan  5 02:47:11.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.219197898s
Jan  5 02:47:13.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.219834611s
Jan  5 02:47:15.785: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.222432986s
Jan  5 02:47:17.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.220199008s
Jan  5 02:47:19.784: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.221759373s
Jan  5 02:47:21.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.219998863s
Jan  5 02:47:23.781: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.218942856s
Jan  5 02:47:25.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.220329483s
Jan  5 02:47:27.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.2193052s
Jan  5 02:47:29.785: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.222169515s
Jan  5 02:47:31.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.219335945s
Jan  5 02:47:33.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.219322592s
Jan  5 02:47:35.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.220232729s
Jan  5 02:47:37.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.220141788s
Jan  5 02:47:39.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.2194376s
Jan  5 02:47:41.785: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.222087464s
Jan  5 02:47:43.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.219799641s
Jan  5 02:47:45.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.220261201s
Jan  5 02:47:47.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.219997819s
Jan  5 02:47:49.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.220076352s
Jan  5 02:47:51.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.220110649s
Jan  5 02:47:53.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.219220611s
Jan  5 02:47:55.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.220320437s
Jan  5 02:47:57.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.21968835s
Jan  5 02:47:59.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.220132999s
Jan  5 02:48:01.784: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.221415907s
Jan  5 02:48:03.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.219952337s
Jan  5 02:48:05.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.220222734s
Jan  5 02:48:07.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.219283001s
Jan  5 02:48:09.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.21917194s
Jan  5 02:48:11.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.220304364s
Jan  5 02:48:13.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.219619176s
Jan  5 02:48:15.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.219508572s
Jan  5 02:48:17.781: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.218996194s
Jan  5 02:48:19.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.220018938s
Jan  5 02:48:21.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.220161328s
Jan  5 02:48:23.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.219322771s
Jan  5 02:48:25.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.219618916s
Jan  5 02:48:27.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.22030253s
Jan  5 02:48:29.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.219981788s
Jan  5 02:48:31.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.219064585s
Jan  5 02:48:33.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.220230907s
Jan  5 02:48:35.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.219567279s
Jan  5 02:48:37.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.219271204s
Jan  5 02:48:39.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.219349322s
Jan  5 02:48:41.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.219816495s
Jan  5 02:48:43.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.220079726s
Jan  5 02:48:45.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.219689323s
Jan  5 02:48:47.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.220201997s
Jan  5 02:48:49.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.21974577s
Jan  5 02:48:51.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.219150302s
Jan  5 02:48:53.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.220263734s
Jan  5 02:48:55.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.219586209s
Jan  5 02:48:57.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.219853736s
Jan  5 02:48:59.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.220050381s
Jan  5 02:49:01.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.219866589s
Jan  5 02:49:03.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.219403693s
Jan  5 02:49:05.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.219922052s
Jan  5 02:49:07.784: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.221317129s
Jan  5 02:49:09.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.219103098s
Jan  5 02:49:11.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.219926748s
Jan  5 02:49:13.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.219950922s
Jan  5 02:49:15.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.219454041s
Jan  5 02:49:17.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.219304966s
Jan  5 02:49:19.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.219029183s
Jan  5 02:49:21.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.219747988s
Jan  5 02:49:23.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.219568175s
Jan  5 02:49:25.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.220097893s
Jan  5 02:49:27.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.21927924s
Jan  5 02:49:29.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.219180832s
Jan  5 02:49:31.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.219821854s
Jan  5 02:49:33.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.220041038s
Jan  5 02:49:35.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.219957763s
Jan  5 02:49:37.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.219598255s
Jan  5 02:49:39.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.219749085s
Jan  5 02:49:41.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.220097207s
Jan  5 02:49:43.784: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.221479301s
Jan  5 02:49:45.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.220202404s
Jan  5 02:49:47.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.219800511s
Jan  5 02:49:49.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.22024554s
Jan  5 02:49:51.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.219466092s
Jan  5 02:49:53.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.219893676s
Jan  5 02:49:55.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.220561137s
Jan  5 02:49:57.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.220280599s
Jan  5 02:49:59.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.220029385s
Jan  5 02:50:01.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.220367924s
Jan  5 02:50:03.784: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.221129627s
Jan  5 02:50:05.783: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.220455777s
Jan  5 02:50:07.782: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.219499466s
Jan  5 02:50:07.892: INFO: Pod "pod-subpath-test-dynamicpv-rdf9": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.329118809s
Jan  5 02:50:08.112: INFO: Failed to get logs from node "i-01bd5bfa9703f3bd3" pod "pod-subpath-test-dynamicpv-rdf9" container "init-volume-dynamicpv-rdf9": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-rdf9)
Jan  5 02:50:08.222: INFO: Failed to get logs from node "i-01bd5bfa9703f3bd3" pod "pod-subpath-test-dynamicpv-rdf9" container "test-init-subpath-dynamicpv-rdf9": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-rdf9)
Jan  5 02:50:08.333: INFO: Failed to get logs from node "i-01bd5bfa9703f3bd3" pod "pod-subpath-test-dynamicpv-rdf9" container "test-container-subpath-dynamicpv-rdf9": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-rdf9)
�[1mSTEP:�[0m delete the pod �[38;5;243m01/05/23 02:50:08.333�[0m
Jan  5 02:50:08.446: INFO: Waiting for pod pod-subpath-test-dynamicpv-rdf9 to disappear
Jan  5 02:50:08.556: INFO: Pod pod-subpath-test-dynamicpv-rdf9 still exists
Jan  5 02:50:10.556: INFO: Waiting for pod pod-subpath-test-dynamicpv-rdf9 to disappear
Jan  5 02:50:10.666: INFO: Pod pod-subpath-test-dynamicpv-rdf9 no longer exists
Jan  5 02:50:10.666: INFO: Unexpected error: 
    <*errors.errorString | 0xc004d1cd30>: {
        s: "expected pod \"pod-subpath-test-dynamicpv-rdf9\" success: timed out while waiting for pod provisioning-8207/pod-subpath-test-dynamicpv-rdf9 to be Succeeded or Failed",
    }
Jan  5 02:50:10.666: FAIL: expected pod "pod-subpath-test-dynamicpv-rdf9" success: timed out while waiting for pod provisioning-8207/pod-subpath-test-dynamicpv-rdf9 to be Succeeded or Failed

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc00476f200?, {0x75c02b7?, 0x0?}, 0xc00476f200, 0x0, {0xc003e47e70, 0x1, 0x1}, 0x22?)
	test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
	test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc0018d93b0, {0xc004dfb7e8, 0x16}, 0xc00476f200, 0x0)
	test/e2e/storage/testsuites/subpath.go:691 +0x15c
k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func18()
	test/e2e/storage/testsuites/subpath.go:411 +0x24f
�[1mSTEP:�[0m Deleting pod �[38;5;243m01/05/23 02:50:10.666�[0m
Jan  5 02:50:10.666: INFO: Deleting pod "pod-subpath-test-dynamicpv-rdf9" in namespace "provisioning-8207"
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/05/23 02:50:10.775�[0m
Jan  5 02:50:10.995: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.com6gj9w"
Jan  5 02:50:11.106: INFO: Waiting up to 5m0s for PersistentVolume pvc-832f90d5-50b2-49b6-acfe-cc31b32c35e5 to get deleted
Jan  5 02:50:11.216: INFO: PersistentVolume pvc-832f90d5-50b2-49b6-acfe-cc31b32c35e5 found and phase=Released (109.392972ms)
Jan  5 02:50:16.326: INFO: PersistentVolume pvc-832f90d5-50b2-49b6-acfe-cc31b32c35e5 found and phase=Released (5.219788797s)
Jan  5 02:50:21.436: INFO: PersistentVolume pvc-832f90d5-50b2-49b6-acfe-cc31b32c35e5 was removed
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/05/23 02:50:21.436�[0m
[AfterEach] [Testpattern: Dynamic PV (default fs)] subPath
  test/e2e/framework/node/init/init.go:32
Jan  5 02:50:21.552: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/05/23 02:50:21.663�[0m
�[1mSTEP:�[0m Collecting events from namespace "provisioning-8207". �[38;5;243m01/05/23 02:50:21.663�[0m
�[1mSTEP:�[0m Found 16 events. �[38;5;243m01/05/23 02:50:21.773�[0m
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:45:07 +0000 UTC - event for ebs.csi.aws.com6gj9w: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:45:07 +0000 UTC - event for ebs.csi.aws.com6gj9w: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:45:07 +0000 UTC - event for ebs.csi.aws.com6gj9w: {ebs.csi.aws.com_ebs-csi-controller-6b8d786cf8-2c9wj_d0ba6ade-b289-473e-80f8-50cc0f55ce2b } Provisioning: External provisioner is provisioning volume for claim "provisioning-8207/ebs.csi.aws.com6gj9w"
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:45:10 +0000 UTC - event for ebs.csi.aws.com6gj9w: {ebs.csi.aws.com_ebs-csi-controller-6b8d786cf8-2c9wj_d0ba6ade-b289-473e-80f8-50cc0f55ce2b } ProvisioningSucceeded: Successfully provisioned volume pvc-832f90d5-50b2-49b6-acfe-cc31b32c35e5
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:45:11 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {default-scheduler } Scheduled: Successfully assigned provisioning-8207/pod-subpath-test-dynamicpv-rdf9 to i-01bd5bfa9703f3bd3
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:45:13 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-832f90d5-50b2-49b6-acfe-cc31b32c35e5" 
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:45:16 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e24bfd1f8ed22568cba7857e1a3341f833665b7028780a05d7430eabee8ac5ed": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:45:28 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b2bf7f24ddecf2a3927b15da021c6c4e2ac3bf77a25338a7f51c7e2eb70edb6b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:45:43 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a53f4efa2d57de5d855f80df9a41b99dc8e1e0ff5e720f03c8570eed2adc2671": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:45:58 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "91ae564b63b12e1f7167ba6b90ede0bf42a0345197e5a3640f81674013110239": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:46:09 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e86897692a3845eb7cdfe3bb05b537777cb53ce7ea3409c3468339aa315f64cf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:46:23 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "964245e94e87a5bcf9cbaa96730af3cc1e705cb4c936cbe676bb7f722b8451e3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:46:37 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "df5853c88566b2ef2a657a846cce7350a905bc07e8bd8743e2e6d7ca9f3a1bef": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:46:50 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ab7c2c7558632149a28246ea4ecffabbf4178b7135b9be0f6eaa83bfbf7dbfa8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:47:02 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1dde6d5fc72e3e1368fdef64170398e46ad2a935705874dd13b0f11d72894774": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:21.773: INFO: At 2023-01-05 02:47:15 +0000 UTC - event for pod-subpath-test-dynamicpv-rdf9: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "00c0ca258edbeb4c6309dfc41088aff210dd4f341cb0d99bbaacdc18d0c570db": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:21.883: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan  5 02:50:21.883: INFO: 
Jan  5 02:50:21.994: INFO: 
Logging node info for node i-01bd5bfa9703f3bd3
Jan  5 02:50:22.103: INFO: Node Info: &Node{ObjectMeta:{i-01bd5bfa9703f3bd3    69222d04-c2bf-45d2-98fb-9486844f5c9b 10478 0 2023-01-05 02:34:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01bd5bfa9703f3bd3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-01bd5bfa9703f3bd3 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.211 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-146":"i-01bd5bfa9703f3bd3","ebs.csi.aws.com":"i-01bd5bfa9703f3bd3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:50:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-05 02:50:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-01bd5bfa9703f3bd3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:09 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:09 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:09 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:50:09 +0000 UTC,LastTransitionTime:2023-01-05 02:34:21 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.211,},NodeAddress{Type:ExternalIP,Address:3.127.108.91,},NodeAddress{Type:InternalDNS,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-127-108-91.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c4f0d8dc84e5ae1e29667dae48eae,SystemUUID:ec2c4f0d-8dc8-4e5a-e1e2-9667dae48eae,BootID:b09c708e-7e9b-478b-a41e-54cca7d4cf91,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-146^30f69951-8ca3-11ed-a871-f256e7dbdb77 kubernetes.io/csi/ebs.csi.aws.com^vol-0e6bc0e2cf2e0bf4c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e6bc0e2cf2e0bf4c,DevicePath:,},},Config:nil,},}
Jan  5 02:50:22.104: INFO: 
Logging kubelet events for node i-01bd5bfa9703f3bd3
Jan  5 02:50:22.216: INFO: 
Logging pods the kubelet thinks is on node i-01bd5bfa9703f3bd3
Jan  5 02:50:22.336: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-xjdj7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:22.336: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x started at 2023-01-05 02:45:39 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container sample-crd-conversion-webhook ready: false, restart count 0
Jan  5 02:50:22.336: INFO: netserver-0 started at 2023-01-05 02:47:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:22.336: INFO: affinity-clusterip-transition-7hz95 started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container affinity-clusterip-transition ready: true, restart count 0
Jan  5 02:50:22.336: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wppds started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:22.336: INFO: dns-test-5e174570-82af-4b4c-98b3-8be4084efa2e started at 2023-01-05 02:46:38 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  5 02:50:22.336: INFO: 	Container querier ready: false, restart count 0
Jan  5 02:50:22.336: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:22.336: INFO: netserver-0 started at 2023-01-05 02:50:09 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:22.336: INFO: dns-test-3b53ba68-c445-4758-b5cc-0ab0531d8eea started at 2023-01-05 02:45:51 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  5 02:50:22.336: INFO: 	Container querier ready: false, restart count 0
Jan  5 02:50:22.336: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:22.336: INFO: externalname-service-55bx4 started at 2023-01-05 02:49:35 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container externalname-service ready: false, restart count 0
Jan  5 02:50:22.336: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-n5tbp started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:22.336: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gb74d started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:22.336: INFO: hostexec-i-01bd5bfa9703f3bd3-6bn56 started at 2023-01-05 02:44:08 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.336: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:50:22.337: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tc8w7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:22.337: INFO: local-client started at 2023-01-05 02:49:03 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container local-client ready: false, restart count 0
Jan  5 02:50:22.337: INFO: execpod-affinityk6fqz started at 2023-01-05 02:49:05 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  5 02:50:22.337: INFO: pvc-volume-tester-zm48w started at 2023-01-05 02:46:45 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container volume-tester ready: false, restart count 0
Jan  5 02:50:22.337: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-h4jxc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:22.337: INFO: cilium-fqg7v started at 2023-01-05 02:34:09 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:50:22.337: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:50:22.337: INFO: ebs-csi-node-gg6js started at 2023-01-05 02:34:09 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:22.337: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:22.337: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:50:22.337: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nz7dc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:22.337: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-v9t4w started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:22.337: INFO: csi-mockplugin-0 started at 2023-01-05 02:41:00 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:50:22.337: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  5 02:50:22.337: INFO: 	Container mock ready: true, restart count 0
Jan  5 02:50:22.337: INFO: csi-mockplugin-attacher-0 started at 2023-01-05 02:41:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:50:22.337: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-bd4zs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:22.337: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-fj2vh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:22.337: INFO: test-pod-1 started at 2023-01-05 02:48:48 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container token-test ready: false, restart count 0
Jan  5 02:50:22.337: INFO: test-pod-2 started at 2023-01-05 02:48:48 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container token-test ready: false, restart count 0
Jan  5 02:50:22.337: INFO: inline-volume-tester-7ddfs started at 2023-01-05 02:44:45 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:22.337: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  5 02:50:22.837: INFO: 
Latency metrics for node i-01bd5bfa9703f3bd3
Jan  5 02:50:22.837: INFO: 
Logging node info for node i-025e1f38135aff0cb
Jan  5 02:50:22.947: INFO: Node Info: &Node{ObjectMeta:{i-025e1f38135aff0cb    e077826c-bb74-41f6-aafe-d16d1e1a4e20 8465 0 2023-01-05 02:34:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-025e1f38135aff0cb kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-025e1f38135aff0cb topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.96 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-025e1f38135aff0cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:46:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-025e1f38135aff0cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.96,},NodeAddress{Type:ExternalIP,Address:18.195.60.12,},NodeAddress{Type:InternalDNS,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-195-60-12.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec223249b01164600b2958646dddca75,SystemUUID:ec223249-b011-6460-0b29-58646dddca75,BootID:7a5edf7e-21fb-482a-aeb0-e226be4da837,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:50:22.947: INFO: 
Logging kubelet events for node i-025e1f38135aff0cb
Jan  5 02:50:23.059: INFO: 
Logging pods the kubelet thinks is on node i-025e1f38135aff0cb
Jan  5 02:50:23.177: INFO: netserver-1 started at 2023-01-05 02:47:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:23.177: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wq84l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.177: INFO: affinity-clusterip-transition-5275l started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container affinity-clusterip-transition ready: true, restart count 0
Jan  5 02:50:23.177: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-b68nw started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.177: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tg6gz started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.177: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:48:41 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:50:23.177: INFO: ebs-csi-node-hqlnq started at 2023-01-05 02:34:06 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:23.177: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:23.177: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:50:23.177: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-g4spn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.177: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gg7zk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.177: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-p5wf4 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.177: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lnv9l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.177: INFO: netserver-1 started at 2023-01-05 02:50:09 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:23.177: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-zkfhs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.177: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-mrk29 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.177: INFO: pod-04f917a0-2305-4c6a-8f90-9db335e1d12e started at 2023-01-05 02:50:10 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:50:23.177: INFO: cilium-rjzq7 started at 2023-01-05 02:34:06 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:50:23.177: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:50:23.177: INFO: coredns-559769c974-7vlfn started at 2023-01-05 02:34:41 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:50:23.177: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-z8xgj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.177: INFO: hostexec-i-025e1f38135aff0cb-ft52q started at 2023-01-05 02:50:05 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:50:23.177: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:46:55 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:50:23.177: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:50:23.177: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:50:23.572: INFO: 
Latency metrics for node i-025e1f38135aff0cb
Jan  5 02:50:23.572: INFO: 
Logging node info for node i-029f31a6b034de1c6
Jan  5 02:50:23.682: INFO: Node Info: &Node{ObjectMeta:{i-029f31a6b034de1c6    6eaa3884-9088-400b-96bc-7fe0bc27f677 9982 0 2023-01-05 02:34:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-029f31a6b034de1c6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-029f31a6b034de1c6 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.206 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-029f31a6b034de1c6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:48:49 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-05 02:48:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-029f31a6b034de1c6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:48:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:48:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:48:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:48:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.206,},NodeAddress{Type:ExternalIP,Address:3.71.43.14,},NodeAddress{Type:InternalDNS,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-43-14.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be2b1604bcc2946df20723d761dd9,SystemUUID:ec2be2b1-604b-cc29-46df-20723d761dd9,BootID:998135dd-fb0c-441d-85ec-d92193042b65,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ac9e65b8e974a254],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ac9e65b8e974a254,DevicePath:,},},Config:nil,},}
Jan  5 02:50:23.682: INFO: 
Logging kubelet events for node i-029f31a6b034de1c6
Jan  5 02:50:23.794: INFO: 
Logging pods the kubelet thinks is on node i-029f31a6b034de1c6
Jan  5 02:50:23.913: INFO: netserver-2 started at 2023-01-05 02:47:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:50:23.913: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-sp7hv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.913: INFO: affinity-clusterip-transition-8v8lg started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container affinity-clusterip-transition ready: true, restart count 0
Jan  5 02:50:23.913: INFO: pod-subpath-test-preprovisionedpv-vmmx started at 2023-01-05 02:49:49 +0000 UTC (2+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Init container init-volume-preprovisionedpv-vmmx ready: false, restart count 0
Jan  5 02:50:23.913: INFO: 	Init container test-init-subpath-preprovisionedpv-vmmx ready: false, restart count 0
Jan  5 02:50:23.913: INFO: 	Container test-container-subpath-preprovisionedpv-vmmx ready: false, restart count 0
Jan  5 02:50:23.913: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-k6j85 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.913: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ht7lv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.913: INFO: hostexec-i-029f31a6b034de1c6-bz949 started at 2023-01-05 02:49:37 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:50:23.913: INFO: implicit-nonroot-uid started at 2023-01-05 02:47:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container implicit-nonroot-uid ready: false, restart count 0
Jan  5 02:50:23.913: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-54jfx started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.913: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-c45mb started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.913: INFO: ebs-csi-node-tb9gj started at 2023-01-05 02:34:17 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:23.913: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:23.913: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:50:23.913: INFO: cilium-v2frt started at 2023-01-05 02:34:17 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:50:23.913: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:50:23.913: INFO: pod-19cfa542-8ad7-424f-86ab-9b51935574b0 started at 2023-01-05 02:48:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:50:23.913: INFO: pod-24d14a31-2cf4-4c8d-bb75-9d7fd895bf4b started at 2023-01-05 02:45:26 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:50:23.913: INFO: pod-8ffe8f57-8965-48ef-85a1-bf788f766275 started at 2023-01-05 02:48:45 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:50:23.913: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-vb4kg started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.913: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:46:07 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:50:23.913: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:50:23.913: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:50:23.913: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:50:23.913: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:50:23.913: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:50:23.913: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:50:23.913: INFO: test-pod-3 started at 2023-01-05 02:48:48 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container token-test ready: false, restart count 0
Jan  5 02:50:23.913: INFO: hostexec-i-029f31a6b034de1c6-g7jck started at 2023-01-05 02:48:51 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:50:23.913: INFO: externalname-service-s92dl started at 2023-01-05 02:49:35 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container externalname-service ready: false, restart count 0
Jan  5 02:50:23.913: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ccgnj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.913: INFO: hostexec-i-029f31a6b034de1c6-p84w4 started at 2023-01-05 02:45:22 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:50:23.913: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nqgmc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.913: INFO: netserver-2 started at 2023-01-05 02:50:09 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:23.913: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-khzwh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:23.913: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lzwd8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:23.913: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:24.333: INFO: 
Latency metrics for node i-029f31a6b034de1c6
Jan  5 02:50:24.333: INFO: 
Logging node info for node i-03e2b3d27125ad085
Jan  5 02:50:24.443: INFO: Node Info: &Node{ObjectMeta:{i-03e2b3d27125ad085    9cffc38a-f9d7-40cb-848c-a16086a32ac9 10538 0 2023-01-05 02:32:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e2b3d27125ad085 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.123 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03e2b3d27125ad085"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-05 02:32:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-05 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:33:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:50:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e2b3d27125ad085,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:20 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:20 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:20 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:50:20 +0000 UTC,LastTransitionTime:2023-01-05 02:33:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.123,},NodeAddress{Type:ExternalIP,Address:3.124.193.93,},NodeAddress{Type:InternalDNS,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-124-193-93.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2e40ce762960a4f05822e85e89a6d7,SystemUUID:ec2e40ce-7629-60a4-f058-22e85e89a6d7,BootID:e3c9a56f-3559-40b1-99e3-6055bc36443e,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.1],SizeBytes:42982336,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.1],SizeBytes:42804914,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.1],SizeBytes:4967337,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:50:24.443: INFO: 
Logging kubelet events for node i-03e2b3d27125ad085
Jan  5 02:50:24.555: INFO: 
Logging pods the kubelet thinks is on node i-03e2b3d27125ad085
Jan  5 02:50:24.673: INFO: kube-controller-manager-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  5 02:50:24.673: INFO: kube-scheduler-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  5 02:50:24.673: INFO: cilium-pbccf started at 2023-01-05 02:33:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:50:24.673: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:50:24.673: INFO: kops-controller-6mxst started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Container kops-controller ready: true, restart count 0
Jan  5 02:50:24.673: INFO: ebs-csi-controller-6b8d786cf8-2c9wj started at 2023-01-05 02:33:04 +0000 UTC (0+5 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  5 02:50:24.673: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:50:24.673: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  5 02:50:24.673: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:24.673: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:24.673: INFO: cilium-operator-6f8d6c4bf-kdqfd started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  5 02:50:24.673: INFO: dns-controller-56cf649474-cnnkp started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Container dns-controller ready: true, restart count 0
Jan  5 02:50:24.673: INFO: etcd-manager-main-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:50:24.673: INFO: kube-apiserver-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+2 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Container healthcheck ready: true, restart count 0
Jan  5 02:50:24.673: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  5 02:50:24.673: INFO: aws-cloud-controller-manager-qmldf started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  5 02:50:24.673: INFO: ebs-csi-node-f7tgk started at 2023-01-05 02:33:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:24.673: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:24.673: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:50:24.673: INFO: etcd-manager-events-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:24.673: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:50:25.055: INFO: 
Latency metrics for node i-03e2b3d27125ad085
Jan  5 02:50:25.055: INFO: 
Logging node info for node i-03e466e3a84d9f004
Jan  5 02:50:25.165: INFO: Node Info: &Node{ObjectMeta:{i-03e466e3a84d9f004    eb024a0b-a711-42e7-8f3b-c92ac348ecd2 10430 0 2023-01-05 02:34:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e466e3a84d9f004 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-03e466e3a84d9f004 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.198 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-401":"i-03e466e3a84d9f004","ebs.csi.aws.com":"i-03e466e3a84d9f004"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:50:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e466e3a84d9f004,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:49:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:49:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:49:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:49:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.198,},NodeAddress{Type:ExternalIP,Address:3.71.182.65,},NodeAddress{Type:InternalDNS,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-182-65.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2183d91500f4a0d14c0ffcaa6a62ca,SystemUUID:ec2183d9-1500-f4a0-d14c-0ffcaa6a62ca,BootID:54ae1a2e-030d-4aec-bab9-224c76049655,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:50:25.166: INFO: 
Logging kubelet events for node i-03e466e3a84d9f004
Jan  5 02:50:25.278: INFO: 
Logging pods the kubelet thinks is on node i-03e466e3a84d9f004
Jan  5 02:50:25.395: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-67br6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:25.395: INFO: cilium-8rhhk started at 2023-01-05 02:34:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:50:25.395: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:50:25.395: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-md2kk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:25.395: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-s9zvl started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:25.395: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-dlzfn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:25.395: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gbdkt started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:25.395: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-2j7x6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:50:25.395: INFO: ebs-csi-node-9smg4 started at 2023-01-05 02:34:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:25.395: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:25.395: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:50:25.395: INFO: csi-mockplugin-0 started at 2023-01-05 02:45:44 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:50:25.395: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  5 02:50:25.395: INFO: 	Container mock ready: true, restart count 0
Jan  5 02:50:25.395: INFO: coredns-autoscaler-7cb5c5b969-bh8d6 started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container autoscaler ready: true, restart count 0
Jan  5 02:50:25.395: INFO: coredns-559769c974-skw4s started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:50:25.395: INFO: netserver-3 started at 2023-01-05 02:50:10 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:25.395: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gt2l8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:25.395: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-7zfwf started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:25.395: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-9qqj9 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:25.395: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-6jwx6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:25.395: INFO: netserver-3 started at 2023-01-05 02:47:02 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:25.395: INFO: hostexec-i-03e466e3a84d9f004-vbxzx started at 2023-01-05 02:46:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:50:25.395: INFO: pod-d23ae6e2-6e2b-4da4-9428-7b75348dbb12 started at 2023-01-05 02:46:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:25.395: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:50:25.782: INFO: 
Latency metrics for node i-03e466e3a84d9f004
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "provisioning-8207" for this suite. �[38;5;243m01/05/23 02:50:25.782�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (default fs)] volumes should store data 6m1s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\svolumes\sshould\sstore\sdata$'

test/e2e/framework/volume/fixtures.go:539
k8s.io/kubernetes/test/e2e/framework/volume.testVolumeClient(0xc0018312c0, {{0xc0052ae5e0, 0xb}, {0x75c30d7, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...)
	test/e2e/framework/volume/fixtures.go:539 +0x148
k8s.io/kubernetes/test/e2e/framework/volume.TestVolumeClient(...)
	test/e2e/framework/volume/fixtures.go:523
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/volumes.go:187 +0x4ff
				[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/05/23 02:38:37.016�[0m
Jan  5 02:38:37.016: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename volume �[38;5;243m01/05/23 02:38:37.017�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/05/23 02:38:37.357�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/05/23 02:38:37.582�[0m
[BeforeEach] [Testpattern: Dynamic PV (default fs)] volumes
  test/e2e/framework/metrics/init/init.go:31
[It] should store data
  test/e2e/storage/testsuites/volumes.go:158
Jan  5 02:38:37.808: INFO: Creating resource for dynamic PV
Jan  5 02:38:37.808: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
�[1mSTEP:�[0m creating a StorageClass volume-1268-e2e-sc9pzd7 �[38;5;243m01/05/23 02:38:37.808�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/05/23 02:38:37.924�[0m
Jan  5 02:38:37.924: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m starting external-injector �[38;5;243m01/05/23 02:38:38.153�[0m
Jan  5 02:38:38.268: INFO: Waiting up to 5m0s for pod "external-injector" in namespace "volume-1268" to be "running"
Jan  5 02:38:38.383: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 114.889889ms
Jan  5 02:38:40.496: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.228121122s
Jan  5 02:38:42.497: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.229119448s
Jan  5 02:38:44.497: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.228850416s
Jan  5 02:38:46.497: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.228950227s
Jan  5 02:38:48.497: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 10.229005049s
Jan  5 02:38:50.497: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 12.228988235s
Jan  5 02:38:52.497: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 14.228935248s
Jan  5 02:38:54.502: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 16.233591035s
Jan  5 02:38:56.497: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 18.22883588s
Jan  5 02:38:58.498: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 20.229713636s
Jan  5 02:39:00.497: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 22.229209348s
Jan  5 02:39:02.498: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 24.229505601s
Jan  5 02:39:04.497: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 26.228921864s
Jan  5 02:39:06.497: INFO: Pod "external-injector": Phase="Running", Reason="", readiness=true. Elapsed: 28.228282524s
Jan  5 02:39:06.497: INFO: Pod "external-injector" satisfied condition "running"
�[1mSTEP:�[0m Writing text file contents in the container. �[38;5;243m01/05/23 02:39:06.497�[0m
Jan  5 02:39:06.497: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9d8036e7-8ca0-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=volume-1268 exec external-injector --namespace=volume-1268 -- /bin/sh -c echo 'Hello from ebs.csi.aws.com from namespace volume-1268' > /opt/0/index.html; sync'
Jan  5 02:39:07.714: INFO: stderr: ""
Jan  5 02:39:07.714: INFO: stdout: ""
�[1mSTEP:�[0m Checking that text file contents are perfect. �[38;5;243m01/05/23 02:39:07.714�[0m
Jan  5 02:39:07.714: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9d8036e7-8ca0-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=volume-1268 exec external-injector --namespace=volume-1268 -- cat /opt/0/index.html'
Jan  5 02:39:08.902: INFO: stderr: ""
Jan  5 02:39:08.902: INFO: stdout: "Hello from ebs.csi.aws.com from namespace volume-1268\n"
Jan  5 02:39:08.902: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:volume-1268 PodName:external-injector ContainerName:external-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan  5 02:39:08.902: INFO: >>> kubeConfig: /root/.kube/config
Jan  5 02:39:08.903: INFO: ExecWithOptions: Clientset creation
Jan  5 02:39:08.903: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io/api/v1/namespaces/volume-1268/pods/external-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=external-injector&container=external-injector&stderr=true&stdout=true)
Jan  5 02:39:09.685: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:volume-1268 PodName:external-injector ContainerName:external-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan  5 02:39:09.685: INFO: >>> kubeConfig: /root/.kube/config
Jan  5 02:39:09.685: INFO: ExecWithOptions: Clientset creation
Jan  5 02:39:09.685: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io/api/v1/namespaces/volume-1268/pods/external-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=external-injector&container=external-injector&stderr=true&stdout=true)
�[1mSTEP:�[0m Deleting pod external-injector in namespace volume-1268 �[38;5;243m01/05/23 02:39:10.493�[0m
Jan  5 02:39:10.610: INFO: Waiting for pod external-injector to disappear
Jan  5 02:39:10.723: INFO: Pod external-injector still exists
Jan  5 02:39:12.724: INFO: Waiting for pod external-injector to disappear
Jan  5 02:39:12.838: INFO: Pod external-injector still exists
Jan  5 02:39:14.723: INFO: Waiting for pod external-injector to disappear
Jan  5 02:39:14.836: INFO: Pod external-injector no longer exists
�[1mSTEP:�[0m starting external-client �[38;5;243m01/05/23 02:39:14.836�[0m
Jan  5 02:39:14.953: INFO: Waiting up to 5m0s for pod "external-client" in namespace "volume-1268" to be "running"
Jan  5 02:39:15.066: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 112.911743ms
Jan  5 02:39:17.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2.226551695s
Jan  5 02:39:19.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4.227077875s
Jan  5 02:39:21.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6.226847166s
Jan  5 02:39:23.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8.226415362s
Jan  5 02:39:25.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10.226792626s
Jan  5 02:39:27.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12.226275461s
Jan  5 02:39:29.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14.227280856s
Jan  5 02:39:31.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 16.227491545s
Jan  5 02:39:33.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 18.227093875s
Jan  5 02:39:35.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 20.227139821s
Jan  5 02:39:37.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 22.226415723s
Jan  5 02:39:39.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 24.226429159s
Jan  5 02:39:41.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 26.226306405s
Jan  5 02:39:43.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 28.226334824s
Jan  5 02:39:45.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 30.226898814s
Jan  5 02:39:47.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 32.226455314s
Jan  5 02:39:49.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 34.226834753s
Jan  5 02:39:51.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 36.226523371s
Jan  5 02:39:53.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 38.226394235s
Jan  5 02:39:55.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 40.226303664s
Jan  5 02:39:57.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 42.226006584s
Jan  5 02:39:59.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 44.226547946s
Jan  5 02:40:01.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 46.226135534s
Jan  5 02:40:03.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 48.227186382s
Jan  5 02:40:05.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 50.226354779s
Jan  5 02:40:07.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 52.226151746s
Jan  5 02:40:09.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 54.226338224s
Jan  5 02:40:11.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 56.226500222s
Jan  5 02:40:13.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 58.226443128s
Jan  5 02:40:15.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.226086665s
Jan  5 02:40:17.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.226118708s
Jan  5 02:40:19.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.226219664s
Jan  5 02:40:21.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.226969602s
Jan  5 02:40:23.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.226741663s
Jan  5 02:40:25.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.226167083s
Jan  5 02:40:27.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.226293973s
Jan  5 02:40:29.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.22662115s
Jan  5 02:40:31.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.227131589s
Jan  5 02:40:33.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.226192502s
Jan  5 02:40:35.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.226479122s
Jan  5 02:40:37.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.226333989s
Jan  5 02:40:39.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.226636655s
Jan  5 02:40:41.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.227059443s
Jan  5 02:40:43.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.226541773s
Jan  5 02:40:45.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.226225336s
Jan  5 02:40:47.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.22640923s
Jan  5 02:40:49.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.22605956s
Jan  5 02:40:51.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.226510763s
Jan  5 02:40:53.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.226199964s
Jan  5 02:40:55.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.226279383s
Jan  5 02:40:57.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.225916806s
Jan  5 02:40:59.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.226182836s
Jan  5 02:41:01.182: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.228796472s
Jan  5 02:41:03.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.227310954s
Jan  5 02:41:05.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.226528004s
Jan  5 02:41:07.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.226798794s
Jan  5 02:41:09.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.226221957s
Jan  5 02:41:11.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.226396302s
Jan  5 02:41:13.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.22696425s
Jan  5 02:41:15.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.227079648s
Jan  5 02:41:17.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.226615442s
Jan  5 02:41:19.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.226948111s
Jan  5 02:41:21.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.22616137s
Jan  5 02:41:23.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.226217105s
Jan  5 02:41:25.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.226007729s
Jan  5 02:41:27.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.226299156s
Jan  5 02:41:29.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.226629301s
Jan  5 02:41:31.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.226172277s
Jan  5 02:41:33.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.226107371s
Jan  5 02:41:35.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.22681048s
Jan  5 02:41:37.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.22627779s
Jan  5 02:41:39.182: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.228765649s
Jan  5 02:41:41.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.226098675s
Jan  5 02:41:43.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.226329503s
Jan  5 02:41:45.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.226047581s
Jan  5 02:41:47.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.226610274s
Jan  5 02:41:49.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.226059745s
Jan  5 02:41:51.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.226547689s
Jan  5 02:41:53.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.226701512s
Jan  5 02:41:55.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.225886647s
Jan  5 02:41:57.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.226857484s
Jan  5 02:41:59.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.22627542s
Jan  5 02:42:01.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.227076254s
Jan  5 02:42:03.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.227141119s
Jan  5 02:42:05.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.227378246s
Jan  5 02:42:07.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.227146562s
Jan  5 02:42:09.181: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.228281475s
Jan  5 02:42:11.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.227128348s
Jan  5 02:42:13.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.226182372s
Jan  5 02:42:15.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.226565293s
Jan  5 02:42:17.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.226064507s
Jan  5 02:42:19.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.226955449s
Jan  5 02:42:21.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.227026814s
Jan  5 02:42:23.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.226090362s
Jan  5 02:42:25.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.226096912s
Jan  5 02:42:27.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.226387327s
Jan  5 02:42:29.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.226399038s
Jan  5 02:42:31.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.225960244s
Jan  5 02:42:33.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.226656234s
Jan  5 02:42:35.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.226231868s
Jan  5 02:42:37.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.226010729s
Jan  5 02:42:39.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.226100983s
Jan  5 02:42:41.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.226634233s
Jan  5 02:42:43.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.226254221s
Jan  5 02:42:45.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.226412326s
Jan  5 02:42:47.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.226444005s
Jan  5 02:42:49.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.226593106s
Jan  5 02:42:51.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.226928054s
Jan  5 02:42:53.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.22624737s
Jan  5 02:42:55.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.226818753s
Jan  5 02:42:57.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.226273781s
Jan  5 02:42:59.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.22703627s
Jan  5 02:43:01.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.226895768s
Jan  5 02:43:03.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.226712168s
Jan  5 02:43:05.181: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.227730252s
Jan  5 02:43:07.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.226227255s
Jan  5 02:43:09.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.227102221s
Jan  5 02:43:11.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.226725443s
Jan  5 02:43:13.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.226548021s
Jan  5 02:43:15.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.226993605s
Jan  5 02:43:17.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.226749202s
Jan  5 02:43:19.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.226958618s
Jan  5 02:43:21.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.227213681s
Jan  5 02:43:23.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.22607578s
Jan  5 02:43:25.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.226341541s
Jan  5 02:43:27.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.226553125s
Jan  5 02:43:29.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.225980827s
Jan  5 02:43:31.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.226815213s
Jan  5 02:43:33.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.226271263s
Jan  5 02:43:35.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.227059132s
Jan  5 02:43:37.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.226867241s
Jan  5 02:43:39.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.226436669s
Jan  5 02:43:41.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.226491141s
Jan  5 02:43:43.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.226039747s
Jan  5 02:43:45.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.226864181s
Jan  5 02:43:47.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.226662279s
Jan  5 02:43:49.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.226916888s
Jan  5 02:43:51.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.226039453s
Jan  5 02:43:53.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.226622057s
Jan  5 02:43:55.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.226993834s
Jan  5 02:43:57.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.226751248s
Jan  5 02:43:59.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.226421015s
Jan  5 02:44:01.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.226985526s
Jan  5 02:44:03.182: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.228962853s
Jan  5 02:44:05.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.226465061s
Jan  5 02:44:07.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.226395827s
Jan  5 02:44:09.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.226145962s
Jan  5 02:44:11.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.226203265s
Jan  5 02:44:13.180: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.227162727s
Jan  5 02:44:15.179: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.22657056s
Jan  5 02:44:15.292: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.339480181s
�[1mSTEP:�[0m Deleting pod external-client in namespace volume-1268 �[38;5;243m01/05/23 02:44:15.292�[0m
Jan  5 02:44:15.407: INFO: Waiting for pod external-client to disappear
Jan  5 02:44:15.519: INFO: Pod external-client still exists
Jan  5 02:44:17.520: INFO: Waiting for pod external-client to disappear
Jan  5 02:44:17.633: INFO: Pod external-client no longer exists
Jan  5 02:44:17.633: FAIL: Failed to create client pod: timed out while waiting for pod volume-1268/external-client to be running

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/volume.testVolumeClient(0xc0018312c0, {{0xc0052ae5e0, 0xb}, {0x75c30d7, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...)
	test/e2e/framework/volume/fixtures.go:539 +0x148
k8s.io/kubernetes/test/e2e/framework/volume.TestVolumeClient(...)
	test/e2e/framework/volume/fixtures.go:523
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/volumes.go:187 +0x4ff
�[1mSTEP:�[0m cleaning the environment after external �[38;5;243m01/05/23 02:44:17.633�[0m
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/05/23 02:44:17.633�[0m
Jan  5 02:44:17.859: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.coml4297"
Jan  5 02:44:17.973: INFO: Waiting up to 5m0s for PersistentVolume pvc-edf65256-eef5-4c74-944c-c57f80931080 to get deleted
Jan  5 02:44:18.086: INFO: PersistentVolume pvc-edf65256-eef5-4c74-944c-c57f80931080 found and phase=Released (112.637634ms)
Jan  5 02:44:23.200: INFO: PersistentVolume pvc-edf65256-eef5-4c74-944c-c57f80931080 found and phase=Released (5.226155205s)
Jan  5 02:44:28.313: INFO: PersistentVolume pvc-edf65256-eef5-4c74-944c-c57f80931080 found and phase=Released (10.339472277s)
Jan  5 02:44:33.427: INFO: PersistentVolume pvc-edf65256-eef5-4c74-944c-c57f80931080 was removed
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/05/23 02:44:33.427�[0m
[AfterEach] [Testpattern: Dynamic PV (default fs)] volumes
  test/e2e/framework/node/init/init.go:32
Jan  5 02:44:33.542: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/05/23 02:44:33.657�[0m
�[1mSTEP:�[0m Collecting events from namespace "volume-1268". �[38;5;243m01/05/23 02:44:33.657�[0m
�[1mSTEP:�[0m Found 23 events. �[38;5;243m01/05/23 02:44:33.77�[0m
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:38:37 +0000 UTC - event for ebs.csi.aws.coml4297: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:38:38 +0000 UTC - event for ebs.csi.aws.coml4297: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:38:38 +0000 UTC - event for ebs.csi.aws.coml4297: {ebs.csi.aws.com_ebs-csi-controller-6b8d786cf8-2c9wj_d0ba6ade-b289-473e-80f8-50cc0f55ce2b } Provisioning: External provisioner is provisioning volume for claim "volume-1268/ebs.csi.aws.coml4297"
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:38:41 +0000 UTC - event for ebs.csi.aws.coml4297: {ebs.csi.aws.com_ebs-csi-controller-6b8d786cf8-2c9wj_d0ba6ade-b289-473e-80f8-50cc0f55ce2b } ProvisioningSucceeded: Successfully provisioned volume pvc-edf65256-eef5-4c74-944c-c57f80931080
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:38:42 +0000 UTC - event for external-injector: {default-scheduler } Scheduled: Successfully assigned volume-1268/external-injector to i-029f31a6b034de1c6
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:38:44 +0000 UTC - event for external-injector: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-edf65256-eef5-4c74-944c-c57f80931080" 
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:38:56 +0000 UTC - event for external-injector: {kubelet i-029f31a6b034de1c6} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:38:56 +0000 UTC - event for external-injector: {kubelet i-029f31a6b034de1c6} Created: Created container external-injector
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:38:57 +0000 UTC - event for external-injector: {kubelet i-029f31a6b034de1c6} Started: Started container external-injector
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:39:10 +0000 UTC - event for external-injector: {kubelet i-029f31a6b034de1c6} Killing: Stopping container external-injector
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:39:14 +0000 UTC - event for external-client: {default-scheduler } Scheduled: Successfully assigned volume-1268/external-client to i-01bd5bfa9703f3bd3
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:39:14 +0000 UTC - event for external-client: {attachdetach-controller } FailedAttachVolume: Multi-Attach error for volume "pvc-edf65256-eef5-4c74-944c-c57f80931080" Volume is already exclusively attached to one node and can't be attached to another
Jan  5 02:44:33.770: INFO: At 2023-01-05 02:39:32 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "34e8e587c627a03e67fbd54dded11de904ff6f3ee4921b1e0d1d87d04366e6d2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:33.771: INFO: At 2023-01-05 02:39:32 +0000 UTC - event for external-client: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-edf65256-eef5-4c74-944c-c57f80931080" 
Jan  5 02:44:33.771: INFO: At 2023-01-05 02:39:47 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "badbe9b1117ab073cf1cf8cee41fe3037325ef84cb48f1b4e9b06f3ef69339ae": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:33.771: INFO: At 2023-01-05 02:40:03 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ace7ecd99610fe4a3c31fdfb0b833234243586f19273a2635a926b086e6687dd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:33.771: INFO: At 2023-01-05 02:40:14 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "47c00da7414cd798f7feb5ce9feda9c20bf0fede6b658a96193ec23370dc1b92": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:33.771: INFO: At 2023-01-05 02:40:29 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "aefed51ed85c6aa65b32989424c26d19efac91cacaa5c7ea74e14710cb4a520e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:33.771: INFO: At 2023-01-05 02:40:40 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "31bd88bb531f32e4bfcf4f75cad1c3d38b76100344fe0bae7732a65577375a8f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:33.771: INFO: At 2023-01-05 02:40:55 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "204694554317b862c7de71db8d5a15c426aeb3318f102b67ff288f7f23cb7474": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:33.771: INFO: At 2023-01-05 02:41:06 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b55c51afb9659797c9999aa391b40fb21c9f89f45b28e804e55846d48027dff6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:33.771: INFO: At 2023-01-05 02:41:19 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b9d3ef59c4e1719ffc65ad2a413407ba4bdc410cd18358d2beab719e638f9835": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:33.771: INFO: At 2023-01-05 02:41:34 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "580dbbbd36594c3ed492db00c305ca3fdfe580df8d53cc5305221b7165deb4d8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:33.884: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan  5 02:44:33.884: INFO: 
Jan  5 02:44:33.998: INFO: 
Logging node info for node i-01bd5bfa9703f3bd3
Jan  5 02:44:34.111: INFO: Node Info: &Node{ObjectMeta:{i-01bd5bfa9703f3bd3    69222d04-c2bf-45d2-98fb-9486844f5c9b 7181 0 2023-01-05 02:34:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01bd5bfa9703f3bd3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-01bd5bfa9703f3bd3 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.211 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01bd5bfa9703f3bd3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:44:22 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-05 02:44:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-01bd5bfa9703f3bd3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:44:22 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:44:22 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:44:22 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:44:22 +0000 UTC,LastTransitionTime:2023-01-05 02:34:21 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.211,},NodeAddress{Type:ExternalIP,Address:3.127.108.91,},NodeAddress{Type:InternalDNS,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-127-108-91.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c4f0d8dc84e5ae1e29667dae48eae,SystemUUID:ec2c4f0d-8dc8-4e5a-e1e2-9667dae48eae,BootID:b09c708e-7e9b-478b-a41e-54cca7d4cf91,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0fd62b8d38b0aae69],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0fd62b8d38b0aae69,DevicePath:,},},Config:nil,},}
Jan  5 02:44:34.112: INFO: 
Logging kubelet events for node i-01bd5bfa9703f3bd3
Jan  5 02:44:34.227: INFO: 
Logging pods the kubelet thinks is on node i-01bd5bfa9703f3bd3
Jan  5 02:44:34.353: INFO: test-container-pod started at 2023-01-05 02:40:00 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:44:34.353: INFO: inline-volume-tester-h74xj started at 2023-01-05 02:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  5 02:44:34.353: INFO: cilium-fqg7v started at 2023-01-05 02:34:09 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:34.353: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:34.353: INFO: ebs-csi-node-gg6js started at 2023-01-05 02:34:09 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:34.353: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:34.353: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:34.353: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nz7dc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:34.353: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-v9t4w started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:44:34.353: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-h4jxc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:34.353: INFO: hostexec-i-01bd5bfa9703f3bd3-n5wdm started at 2023-01-05 02:41:37 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:34.353: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-bd4zs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:34.353: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-fj2vh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:34.353: INFO: csi-mockplugin-0 started at 2023-01-05 02:41:00 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:44:34.353: INFO: 	Container driver-registrar ready: false, restart count 0
Jan  5 02:44:34.353: INFO: 	Container mock ready: false, restart count 0
Jan  5 02:44:34.353: INFO: csi-mockplugin-attacher-0 started at 2023-01-05 02:41:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:44:34.353: INFO: local-injector started at 2023-01-05 02:44:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container local-injector ready: false, restart count 0
Jan  5 02:44:34.353: INFO: netserver-0 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:34.353: INFO: termination-message-container58ca479c-b658-481b-b5b5-e074f05cff2c started at 2023-01-05 02:40:22 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container termination-message-container ready: false, restart count 0
Jan  5 02:44:34.353: INFO: ss2-0 started at 2023-01-05 02:38:18 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:34.353: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-xjdj7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:34.353: INFO: pod-9c32868a-252f-484c-bb70-cade4aec0129 started at 2023-01-05 02:39:35 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:44:34.353: INFO: pod-subpath-test-preprovisionedpv-dprj started at 2023-01-05 02:41:49 +0000 UTC (2+2 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Init container init-volume-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:34.353: INFO: 	Init container test-init-subpath-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:34.353: INFO: 	Container test-container-subpath-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:34.353: INFO: 	Container test-container-volume-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:34.353: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wppds started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:34.353: INFO: host-test-container-pod started at 2023-01-05 02:40:00 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:34.353: INFO: test-rs-hpvh8 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container httpd ready: true, restart count 0
Jan  5 02:44:34.353: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-n5tbp started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:34.353: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gb74d started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:34.353: INFO: pod-projected-configmaps-691cf090-de91-467f-95f8-8d0dcb9aeee7 started at 2023-01-05 02:40:06 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container projected-configmap-volume-test ready: false, restart count 0
Jan  5 02:44:34.353: INFO: hostexec-i-01bd5bfa9703f3bd3-6bn56 started at 2023-01-05 02:44:08 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:34.353: INFO: hostexec-i-01bd5bfa9703f3bd3-lm4fl started at 2023-01-05 02:39:13 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:34.353: INFO: pod-subpath-test-inlinevolume-h59m started at 2023-01-05 02:39:49 +0000 UTC (2+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Init container init-volume-inlinevolume-h59m ready: false, restart count 0
Jan  5 02:44:34.353: INFO: 	Init container test-init-volume-inlinevolume-h59m ready: false, restart count 0
Jan  5 02:44:34.353: INFO: 	Container test-container-subpath-inlinevolume-h59m ready: false, restart count 0
Jan  5 02:44:34.353: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tc8w7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:34.353: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:34.869: INFO: 
Latency metrics for node i-01bd5bfa9703f3bd3
Jan  5 02:44:34.869: INFO: 
Logging node info for node i-025e1f38135aff0cb
Jan  5 02:44:34.983: INFO: Node Info: &Node{ObjectMeta:{i-025e1f38135aff0cb    e077826c-bb74-41f6-aafe-d16d1e1a4e20 6075 0 2023-01-05 02:34:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-025e1f38135aff0cb kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-025e1f38135aff0cb topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.96 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-896":"csi-mock-csi-mock-volumes-896","ebs.csi.aws.com":"i-025e1f38135aff0cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:40:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-025e1f38135aff0cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.96,},NodeAddress{Type:ExternalIP,Address:18.195.60.12,},NodeAddress{Type:InternalDNS,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-195-60-12.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec223249b01164600b2958646dddca75,SystemUUID:ec223249-b011-6460-0b29-58646dddca75,BootID:7a5edf7e-21fb-482a-aeb0-e226be4da837,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:34.983: INFO: 
Logging kubelet events for node i-025e1f38135aff0cb
Jan  5 02:44:35.099: INFO: 
Logging pods the kubelet thinks is on node i-025e1f38135aff0cb
Jan  5 02:44:35.220: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-g4spn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.220: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gg7zk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.220: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-p5wf4 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:44:35.220: INFO: ebs-csi-node-hqlnq started at 2023-01-05 02:34:06 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:35.220: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:35.220: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:35.220: INFO: pvc-volume-tester-jxcfl started at 2023-01-05 02:40:26 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container volume-tester ready: false, restart count 0
Jan  5 02:44:35.220: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-zkfhs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.220: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-mrk29 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.220: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lnv9l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.220: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-z8xgj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.220: INFO: pod-e30c2e03-515c-4253-8cda-dc355d03e809 started at 2023-01-05 02:39:35 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:44:35.220: INFO: cilium-rjzq7 started at 2023-01-05 02:34:06 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:35.220: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:35.220: INFO: coredns-559769c974-7vlfn started at 2023-01-05 02:34:41 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:44:35.220: INFO: hostexec-i-025e1f38135aff0cb-vvrb4 started at 2023-01-05 02:39:17 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:35.220: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-b68nw started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.220: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tg6gz started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.220: INFO: csi-mockplugin-0 started at 2023-01-05 02:39:18 +0000 UTC (0+4 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container busybox ready: true, restart count 0
Jan  5 02:44:35.220: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:44:35.220: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  5 02:44:35.220: INFO: 	Container mock ready: true, restart count 0
Jan  5 02:44:35.220: INFO: netserver-1 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:35.220: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wq84l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.220: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.639: INFO: 
Latency metrics for node i-025e1f38135aff0cb
Jan  5 02:44:35.639: INFO: 
Logging node info for node i-029f31a6b034de1c6
Jan  5 02:44:35.752: INFO: Node Info: &Node{ObjectMeta:{i-029f31a6b034de1c6    6eaa3884-9088-400b-96bc-7fe0bc27f677 6319 0 2023-01-05 02:34:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-029f31a6b034de1c6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-029f31a6b034de1c6 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.206 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-029f31a6b034de1c6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:41:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-029f31a6b034de1c6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.206,},NodeAddress{Type:ExternalIP,Address:3.71.43.14,},NodeAddress{Type:InternalDNS,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-43-14.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be2b1604bcc2946df20723d761dd9,SystemUUID:ec2be2b1-604b-cc29-46df-20723d761dd9,BootID:998135dd-fb0c-441d-85ec-d92193042b65,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:35.753: INFO: 
Logging kubelet events for node i-029f31a6b034de1c6
Jan  5 02:44:35.868: INFO: 
Logging pods the kubelet thinks is on node i-029f31a6b034de1c6
Jan  5 02:44:35.990: INFO: pod-configmaps-4c7c5cae-5dc1-4cf3-b2ef-98693ffaf50d started at 2023-01-05 02:44:26 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  5 02:44:35.990: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:40:04 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:44:35.990: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:44:35.990: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:44:35.990: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:44:35.990: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:44:35.990: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:44:35.990: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:44:35.990: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-vb4kg started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.990: INFO: netserver-2 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:35.990: INFO: pod-secrets-6ab0c9d1-ce7d-4547-9044-0162e6ad2809 started at 2023-01-05 02:44:31 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container secret-test ready: false, restart count 0
Jan  5 02:44:35.990: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ccgnj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.990: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nqgmc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.990: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-khzwh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.990: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lzwd8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.990: INFO: busybox-readonly-true-b614b5dd-87ef-4d07-94e4-d3c79ca10590 started at 2023-01-05 02:41:11 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container busybox-readonly-true-b614b5dd-87ef-4d07-94e4-d3c79ca10590 ready: false, restart count 0
Jan  5 02:44:35.990: INFO: pod-af540b87-53cd-4665-bf39-2f3a5eed9100 started at 2023-01-05 02:40:44 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:44:35.990: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-sp7hv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.990: INFO: test-rs-mvsf6 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container httpd ready: false, restart count 0
Jan  5 02:44:35.990: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-k6j85 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.990: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ht7lv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.990: INFO: hostexec-i-029f31a6b034de1c6-jhvjk started at 2023-01-05 02:40:40 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:35.990: INFO: ss2-1 started at 2023-01-05 02:38:28 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:35.990: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-54jfx started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.990: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-c45mb started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:35.990: INFO: ebs-csi-node-tb9gj started at 2023-01-05 02:34:17 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:35.990: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:35.990: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:35.990: INFO: cilium-v2frt started at 2023-01-05 02:34:17 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:35.990: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:35.990: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:36.410: INFO: 
Latency metrics for node i-029f31a6b034de1c6
Jan  5 02:44:36.410: INFO: 
Logging node info for node i-03e2b3d27125ad085
Jan  5 02:44:36.523: INFO: Node Info: &Node{ObjectMeta:{i-03e2b3d27125ad085    9cffc38a-f9d7-40cb-848c-a16086a32ac9 5785 0 2023-01-05 02:32:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e2b3d27125ad085 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.123 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03e2b3d27125ad085"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-05 02:32:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-05 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:33:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:40:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e2b3d27125ad085,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:33:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.123,},NodeAddress{Type:ExternalIP,Address:3.124.193.93,},NodeAddress{Type:InternalDNS,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-124-193-93.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2e40ce762960a4f05822e85e89a6d7,SystemUUID:ec2e40ce-7629-60a4-f058-22e85e89a6d7,BootID:e3c9a56f-3559-40b1-99e3-6055bc36443e,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.1],SizeBytes:42982336,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.1],SizeBytes:42804914,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.1],SizeBytes:4967337,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:36.524: INFO: 
Logging kubelet events for node i-03e2b3d27125ad085
Jan  5 02:44:36.639: INFO: 
Logging pods the kubelet thinks is on node i-03e2b3d27125ad085
Jan  5 02:44:36.760: INFO: etcd-manager-main-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:44:36.760: INFO: kube-controller-manager-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  5 02:44:36.760: INFO: kube-scheduler-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  5 02:44:36.760: INFO: cilium-pbccf started at 2023-01-05 02:33:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:36.760: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:36.760: INFO: kops-controller-6mxst started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Container kops-controller ready: true, restart count 0
Jan  5 02:44:36.760: INFO: ebs-csi-controller-6b8d786cf8-2c9wj started at 2023-01-05 02:33:04 +0000 UTC (0+5 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  5 02:44:36.760: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:44:36.760: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  5 02:44:36.760: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:36.760: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:36.760: INFO: cilium-operator-6f8d6c4bf-kdqfd started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  5 02:44:36.760: INFO: dns-controller-56cf649474-cnnkp started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Container dns-controller ready: true, restart count 0
Jan  5 02:44:36.760: INFO: etcd-manager-events-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:44:36.760: INFO: kube-apiserver-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+2 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Container healthcheck ready: true, restart count 0
Jan  5 02:44:36.760: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  5 02:44:36.760: INFO: aws-cloud-controller-manager-qmldf started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  5 02:44:36.760: INFO: ebs-csi-node-f7tgk started at 2023-01-05 02:33:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:36.760: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:36.760: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:36.760: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:37.144: INFO: 
Latency metrics for node i-03e2b3d27125ad085
Jan  5 02:44:37.144: INFO: 
Logging node info for node i-03e466e3a84d9f004
Jan  5 02:44:37.257: INFO: Node Info: &Node{ObjectMeta:{i-03e466e3a84d9f004    eb024a0b-a711-42e7-8f3b-c92ac348ecd2 6961 0 2023-01-05 02:34:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e466e3a84d9f004 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-03e466e3a84d9f004 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.198 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03e466e3a84d9f004"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:43:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e466e3a84d9f004,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.198,},NodeAddress{Type:ExternalIP,Address:3.71.182.65,},NodeAddress{Type:InternalDNS,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-182-65.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2183d91500f4a0d14c0ffcaa6a62ca,SystemUUID:ec2183d9-1500-f4a0-d14c-0ffcaa6a62ca,BootID:54ae1a2e-030d-4aec-bab9-224c76049655,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:37.257: INFO: 
Logging kubelet events for node i-03e466e3a84d9f004
Jan  5 02:44:37.372: INFO: 
Logging pods the kubelet thinks is on node i-03e466e3a84d9f004
Jan  5 02:44:37.495: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gt2l8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:37.495: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-7zfwf started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:37.495: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-9qqj9 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:37.495: INFO: csi-mockplugin-attacher-0 started at 2023-01-05 02:39:28 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:44:37.495: INFO: coredns-autoscaler-7cb5c5b969-bh8d6 started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container autoscaler ready: true, restart count 0
Jan  5 02:44:37.495: INFO: coredns-559769c974-skw4s started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:44:37.495: INFO: csi-mockplugin-0 started at 2023-01-05 02:39:28 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:44:37.495: INFO: 	Container driver-registrar ready: false, restart count 0
Jan  5 02:44:37.495: INFO: 	Container mock ready: false, restart count 0
Jan  5 02:44:37.495: INFO: pod-subpath-test-preprovisionedpv-h5s6 started at 2023-01-05 02:40:34 +0000 UTC (0+2 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container test-container-subpath-preprovisionedpv-h5s6 ready: false, restart count 0
Jan  5 02:44:37.495: INFO: 	Container test-container-volume-preprovisionedpv-h5s6 ready: false, restart count 0
Jan  5 02:44:37.495: INFO: pod-subpath-test-preprovisionedpv-qljw started at 2023-01-05 02:41:19 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Init container init-volume-preprovisionedpv-qljw ready: false, restart count 0
Jan  5 02:44:37.495: INFO: 	Container test-container-subpath-preprovisionedpv-qljw ready: false, restart count 0
Jan  5 02:44:37.495: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-6jwx6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:37.495: INFO: hostexec-i-03e466e3a84d9f004-wfhss started at 2023-01-05 02:41:03 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:37.495: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-dlzfn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:37.495: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:44:32 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:44:37.495: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:44:37.495: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:44:37.495: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:44:37.495: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:44:37.495: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:44:37.495: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:44:37.495: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gbdkt started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:37.495: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-67br6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:37.495: INFO: cilium-8rhhk started at 2023-01-05 02:34:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:37.495: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:37.495: INFO: hostexec-i-03e466e3a84d9f004-xgsbh started at 2023-01-05 02:40:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:37.495: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-md2kk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:37.495: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-s9zvl started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:37.495: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-2j7x6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:44:37.495: INFO: netserver-3 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:37.495: INFO: ebs-csi-node-9smg4 started at 2023-01-05 02:34:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:37.495: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:37.495: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:37.495: INFO: test-rs-lbcl5 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container httpd ready: false, restart count 0
Jan  5 02:44:37.495: INFO: ss2-2 started at 2023-01-05 02:38:51 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:37.495: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:44:37.956: INFO: 
Latency metrics for node i-03e466e3a84d9f004
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] volumes
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "volume-1268" for this suite. �[38;5;243m01/05/23 02:44:37.956�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (ext4)] volumes should store data 6m24s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(ext4\)\]\svolumes\sshould\sstore\sdata$'

test/e2e/framework/volume/fixtures.go:539
k8s.io/kubernetes/test/e2e/framework/volume.testVolumeClient(0xc000da5e00, {{0xc002fd05e0, 0xb}, {0x75c30d7, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...)
	test/e2e/framework/volume/fixtures.go:539 +0x148
k8s.io/kubernetes/test/e2e/framework/volume.TestVolumeClient(...)
	test/e2e/framework/volume/fixtures.go:523
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/volumes.go:187 +0x4ff
				[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/05/23 02:38:05.686�[0m
Jan  5 02:38:05.686: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename volume �[38;5;243m01/05/23 02:38:05.687�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/05/23 02:38:06.026�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/05/23 02:38:06.248�[0m
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  test/e2e/framework/metrics/init/init.go:31
[It] should store data
  test/e2e/storage/testsuites/volumes.go:158
Jan  5 02:38:06.502: INFO: Creating resource for dynamic PV
Jan  5 02:38:06.503: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
�[1mSTEP:�[0m creating a StorageClass volume-1079-e2e-scm7mml �[38;5;243m01/05/23 02:38:06.503�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/05/23 02:38:06.617�[0m
Jan  5 02:38:06.617: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m starting external-injector �[38;5;243m01/05/23 02:38:06.847�[0m
Jan  5 02:38:06.961: INFO: Waiting up to 5m0s for pod "external-injector" in namespace "volume-1079" to be "running"
Jan  5 02:38:07.075: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 114.050959ms
Jan  5 02:38:09.187: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.226512728s
Jan  5 02:38:11.188: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.226639786s
Jan  5 02:38:13.187: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.226410985s
Jan  5 02:38:15.194: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.233201963s
Jan  5 02:38:17.191: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 10.229787765s
Jan  5 02:38:19.186: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 12.225564673s
Jan  5 02:38:21.188: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 14.22744835s
Jan  5 02:38:23.187: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 16.2260647s
Jan  5 02:38:25.187: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 18.226132275s
Jan  5 02:38:27.187: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 20.226281059s
Jan  5 02:38:29.187: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 22.226257095s
Jan  5 02:38:31.188: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 24.226804673s
Jan  5 02:38:33.214: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 26.253422763s
Jan  5 02:38:35.186: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 28.225403032s
Jan  5 02:38:37.191: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 30.230042216s
Jan  5 02:38:39.187: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 32.226316475s
Jan  5 02:38:41.188: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 34.22705921s
Jan  5 02:38:43.187: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 36.226033644s
Jan  5 02:38:45.187: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 38.226387757s
Jan  5 02:38:47.188: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 40.227539761s
Jan  5 02:38:49.187: INFO: Pod "external-injector": Phase="Running", Reason="", readiness=true. Elapsed: 42.225677756s
Jan  5 02:38:49.187: INFO: Pod "external-injector" satisfied condition "running"
�[1mSTEP:�[0m Writing text file contents in the container. �[38;5;243m01/05/23 02:38:49.187�[0m
Jan  5 02:38:49.187: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9d8036e7-8ca0-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=volume-1079 exec external-injector --namespace=volume-1079 -- /bin/sh -c echo 'Hello from ebs.csi.aws.com from namespace volume-1079' > /opt/0/index.html; sync'
Jan  5 02:38:50.435: INFO: stderr: ""
Jan  5 02:38:50.435: INFO: stdout: ""
�[1mSTEP:�[0m Checking that text file contents are perfect. �[38;5;243m01/05/23 02:38:50.435�[0m
Jan  5 02:38:50.436: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9d8036e7-8ca0-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=volume-1079 exec external-injector --namespace=volume-1079 -- cat /opt/0/index.html'
Jan  5 02:38:51.627: INFO: stderr: ""
Jan  5 02:38:51.627: INFO: stdout: "Hello from ebs.csi.aws.com from namespace volume-1079\n"
Jan  5 02:38:51.627: INFO: ExecWithOptions {Command:[/bin/sh -c test -d /opt/0] Namespace:volume-1079 PodName:external-injector ContainerName:external-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan  5 02:38:51.627: INFO: >>> kubeConfig: /root/.kube/config
Jan  5 02:38:51.628: INFO: ExecWithOptions: Clientset creation
Jan  5 02:38:51.628: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io/api/v1/namespaces/volume-1079/pods/external-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-d+%2Fopt%2F0&container=external-injector&container=external-injector&stderr=true&stdout=true)
Jan  5 02:38:52.367: INFO: ExecWithOptions {Command:[/bin/sh -c test -b /opt/0] Namespace:volume-1079 PodName:external-injector ContainerName:external-injector Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Jan  5 02:38:52.367: INFO: >>> kubeConfig: /root/.kube/config
Jan  5 02:38:52.368: INFO: ExecWithOptions: Clientset creation
Jan  5 02:38:52.368: INFO: ExecWithOptions: execute(POST https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io/api/v1/namespaces/volume-1079/pods/external-injector/exec?command=%2Fbin%2Fsh&command=-c&command=test+-b+%2Fopt%2F0&container=external-injector&container=external-injector&stderr=true&stdout=true)
�[1mSTEP:�[0m Checking fsType is correct. �[38;5;243m01/05/23 02:38:53.114�[0m
Jan  5 02:38:53.114: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9d8036e7-8ca0-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=volume-1079 exec external-injector --namespace=volume-1079 -- grep  /opt/0  /proc/mounts'
Jan  5 02:38:54.285: INFO: stderr: ""
Jan  5 02:38:54.285: INFO: stdout: "/dev/nvme3n1 /opt/0 ext4 rw,relatime 0 0\n"
�[1mSTEP:�[0m Deleting pod external-injector in namespace volume-1079 �[38;5;243m01/05/23 02:38:54.285�[0m
Jan  5 02:38:54.417: INFO: Waiting for pod external-injector to disappear
Jan  5 02:38:54.539: INFO: Pod external-injector still exists
Jan  5 02:38:56.540: INFO: Waiting for pod external-injector to disappear
Jan  5 02:38:56.651: INFO: Pod external-injector still exists
Jan  5 02:38:58.540: INFO: Waiting for pod external-injector to disappear
Jan  5 02:38:58.651: INFO: Pod external-injector still exists
Jan  5 02:39:00.540: INFO: Waiting for pod external-injector to disappear
Jan  5 02:39:00.651: INFO: Pod external-injector still exists
Jan  5 02:39:02.540: INFO: Waiting for pod external-injector to disappear
Jan  5 02:39:02.652: INFO: Pod external-injector still exists
Jan  5 02:39:04.539: INFO: Waiting for pod external-injector to disappear
Jan  5 02:39:04.651: INFO: Pod external-injector still exists
Jan  5 02:39:06.540: INFO: Waiting for pod external-injector to disappear
Jan  5 02:39:06.651: INFO: Pod external-injector no longer exists
�[1mSTEP:�[0m starting external-client �[38;5;243m01/05/23 02:39:06.651�[0m
Jan  5 02:39:06.770: INFO: Waiting up to 5m0s for pod "external-client" in namespace "volume-1079" to be "running"
Jan  5 02:39:06.881: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 111.380089ms
Jan  5 02:39:08.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2.223284571s
Jan  5 02:39:10.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4.224006143s
Jan  5 02:39:12.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6.223439056s
Jan  5 02:39:14.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8.223394208s
Jan  5 02:39:16.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10.223608331s
Jan  5 02:39:18.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12.223709868s
Jan  5 02:39:20.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14.223966299s
Jan  5 02:39:22.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 16.223630988s
Jan  5 02:39:24.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 18.223502751s
Jan  5 02:39:26.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 20.223457277s
Jan  5 02:39:28.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 22.223925184s
Jan  5 02:39:30.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 24.223233436s
Jan  5 02:39:32.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 26.224042958s
Jan  5 02:39:34.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 28.223974355s
Jan  5 02:39:36.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 30.223851312s
Jan  5 02:39:38.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 32.223857894s
Jan  5 02:39:40.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 34.223327707s
Jan  5 02:39:42.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 36.223785749s
Jan  5 02:39:44.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 38.223731905s
Jan  5 02:39:46.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 40.223189915s
Jan  5 02:39:48.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 42.22361955s
Jan  5 02:39:50.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 44.223271963s
Jan  5 02:39:52.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 46.223416074s
Jan  5 02:39:54.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 48.223707807s
Jan  5 02:39:56.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 50.223135033s
Jan  5 02:39:58.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 52.223153745s
Jan  5 02:40:00.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 54.223977944s
Jan  5 02:40:02.995: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 56.224711361s
Jan  5 02:40:04.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 58.223519158s
Jan  5 02:40:06.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.223662574s
Jan  5 02:40:08.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.223644033s
Jan  5 02:40:10.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.223478107s
Jan  5 02:40:12.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.223971593s
Jan  5 02:40:14.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.223559246s
Jan  5 02:40:16.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.223725716s
Jan  5 02:40:18.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.223946568s
Jan  5 02:40:20.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.223811454s
Jan  5 02:40:22.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.223298711s
Jan  5 02:40:24.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.224109536s
Jan  5 02:40:26.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.223292171s
Jan  5 02:40:28.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.223778515s
Jan  5 02:40:30.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.223239938s
Jan  5 02:40:32.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.223590257s
Jan  5 02:40:34.996: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.226357732s
Jan  5 02:40:36.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.223174346s
Jan  5 02:40:38.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.223171361s
Jan  5 02:40:40.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.223823298s
Jan  5 02:40:42.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.22358006s
Jan  5 02:40:44.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.223993327s
Jan  5 02:40:46.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.224150968s
Jan  5 02:40:48.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.223424099s
Jan  5 02:40:50.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.223052067s
Jan  5 02:40:52.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.223635443s
Jan  5 02:40:54.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.22415755s
Jan  5 02:40:56.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.223572407s
Jan  5 02:40:58.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.223683306s
Jan  5 02:41:00.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.223566297s
Jan  5 02:41:02.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.224110622s
Jan  5 02:41:04.995: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.224819915s
Jan  5 02:41:06.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.22385061s
Jan  5 02:41:08.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.224121672s
Jan  5 02:41:10.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.223852563s
Jan  5 02:41:12.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.223686896s
Jan  5 02:41:14.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.223780499s
Jan  5 02:41:16.997: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.226998268s
Jan  5 02:41:18.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.223692203s
Jan  5 02:41:20.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.223633679s
Jan  5 02:41:22.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.223672538s
Jan  5 02:41:24.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.224157842s
Jan  5 02:41:26.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.223183517s
Jan  5 02:41:28.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.223109281s
Jan  5 02:41:30.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.223022869s
Jan  5 02:41:32.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.22372625s
Jan  5 02:41:34.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.223720407s
Jan  5 02:41:37.000: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.229857879s
Jan  5 02:41:38.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.223768175s
Jan  5 02:41:40.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.223797508s
Jan  5 02:41:42.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.223983116s
Jan  5 02:41:44.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.22355466s
Jan  5 02:41:46.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.223850593s
Jan  5 02:41:48.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.223796678s
Jan  5 02:41:50.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.223232807s
Jan  5 02:41:52.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.223693713s
Jan  5 02:41:54.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.22355899s
Jan  5 02:41:56.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.223804236s
Jan  5 02:41:58.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.223812235s
Jan  5 02:42:00.995: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.224643244s
Jan  5 02:42:02.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.224201916s
Jan  5 02:42:04.998: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.227951048s
Jan  5 02:42:06.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.223779148s
Jan  5 02:42:08.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.224270725s
Jan  5 02:42:10.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.223694264s
Jan  5 02:42:12.998: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.227634994s
Jan  5 02:42:14.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.223922955s
Jan  5 02:42:16.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.22312208s
Jan  5 02:42:18.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.223386143s
Jan  5 02:42:20.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.22414887s
Jan  5 02:42:22.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.223157125s
Jan  5 02:42:24.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.22347669s
Jan  5 02:42:26.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.223585529s
Jan  5 02:42:28.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.223932064s
Jan  5 02:42:30.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.224247383s
Jan  5 02:42:32.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.223489926s
Jan  5 02:42:34.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.223818805s
Jan  5 02:42:36.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.223627108s
Jan  5 02:42:38.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.223605559s
Jan  5 02:42:40.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.223219858s
Jan  5 02:42:42.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.223714408s
Jan  5 02:42:44.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.224167112s
Jan  5 02:42:46.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.223877831s
Jan  5 02:42:48.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.223652503s
Jan  5 02:42:50.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.224610267s
Jan  5 02:42:52.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.223862395s
Jan  5 02:42:54.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.223825617s
Jan  5 02:42:56.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.223209893s
Jan  5 02:42:58.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.223387033s
Jan  5 02:43:00.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.223953941s
Jan  5 02:43:02.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.224078131s
Jan  5 02:43:04.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.22372573s
Jan  5 02:43:06.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.223322635s
Jan  5 02:43:08.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.223274184s
Jan  5 02:43:10.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.2232279s
Jan  5 02:43:12.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.224160265s
Jan  5 02:43:14.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.223339839s
Jan  5 02:43:16.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.224296422s
Jan  5 02:43:18.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.223501544s
Jan  5 02:43:20.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.223167397s
Jan  5 02:43:22.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.223754051s
Jan  5 02:43:24.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.223713343s
Jan  5 02:43:26.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.224017843s
Jan  5 02:43:28.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.223477843s
Jan  5 02:43:30.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.223596907s
Jan  5 02:43:32.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.223864039s
Jan  5 02:43:34.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.224028793s
Jan  5 02:43:36.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.223565364s
Jan  5 02:43:38.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.224069512s
Jan  5 02:43:40.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.223619017s
Jan  5 02:43:42.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.223588758s
Jan  5 02:43:44.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.223897902s
Jan  5 02:43:46.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.223631908s
Jan  5 02:43:48.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.223679664s
Jan  5 02:43:50.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.223143961s
Jan  5 02:43:52.993: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.22288067s
Jan  5 02:43:54.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.223801911s
Jan  5 02:43:56.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.223821142s
Jan  5 02:43:58.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.223998909s
Jan  5 02:44:00.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.223816147s
Jan  5 02:44:02.995: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.224687976s
Jan  5 02:44:04.994: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.224356806s
Jan  5 02:44:06.995: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.224622932s
Jan  5 02:44:07.106: INFO: Pod "external-client": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.336300312s
�[1mSTEP:�[0m Deleting pod external-client in namespace volume-1079 �[38;5;243m01/05/23 02:44:07.106�[0m
Jan  5 02:44:07.219: INFO: Waiting for pod external-client to disappear
Jan  5 02:44:07.331: INFO: Pod external-client still exists
Jan  5 02:44:09.332: INFO: Waiting for pod external-client to disappear
Jan  5 02:44:09.444: INFO: Pod external-client no longer exists
Jan  5 02:44:09.444: FAIL: Failed to create client pod: timed out while waiting for pod volume-1079/external-client to be running

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/volume.testVolumeClient(0xc000da5e00, {{0xc002fd05e0, 0xb}, {0x75c30d7, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...)
	test/e2e/framework/volume/fixtures.go:539 +0x148
k8s.io/kubernetes/test/e2e/framework/volume.TestVolumeClient(...)
	test/e2e/framework/volume/fixtures.go:523
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/volumes.go:187 +0x4ff
�[1mSTEP:�[0m cleaning the environment after external �[38;5;243m01/05/23 02:44:09.444�[0m
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/05/23 02:44:09.444�[0m
Jan  5 02:44:09.669: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comdz6nf"
Jan  5 02:44:09.782: INFO: Waiting up to 5m0s for PersistentVolume pvc-cdf31ea5-711e-4cb6-b8d0-8bfece8d8666 to get deleted
Jan  5 02:44:09.894: INFO: PersistentVolume pvc-cdf31ea5-711e-4cb6-b8d0-8bfece8d8666 found and phase=Released (111.975923ms)
Jan  5 02:44:15.008: INFO: PersistentVolume pvc-cdf31ea5-711e-4cb6-b8d0-8bfece8d8666 found and phase=Released (5.226162507s)
Jan  5 02:44:20.120: INFO: PersistentVolume pvc-cdf31ea5-711e-4cb6-b8d0-8bfece8d8666 found and phase=Released (10.337905453s)
Jan  5 02:44:25.233: INFO: PersistentVolume pvc-cdf31ea5-711e-4cb6-b8d0-8bfece8d8666 was removed
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/05/23 02:44:25.233�[0m
[AfterEach] [Testpattern: Dynamic PV (ext4)] volumes
  test/e2e/framework/node/init/init.go:32
Jan  5 02:44:25.346: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/05/23 02:44:25.459�[0m
�[1mSTEP:�[0m Collecting events from namespace "volume-1079". �[38;5;243m01/05/23 02:44:25.459�[0m
�[1mSTEP:�[0m Found 22 events. �[38;5;243m01/05/23 02:44:25.571�[0m
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:38:06 +0000 UTC - event for ebs.csi.aws.comdz6nf: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:38:06 +0000 UTC - event for ebs.csi.aws.comdz6nf: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:38:06 +0000 UTC - event for ebs.csi.aws.comdz6nf: {ebs.csi.aws.com_ebs-csi-controller-6b8d786cf8-2c9wj_d0ba6ade-b289-473e-80f8-50cc0f55ce2b } Provisioning: External provisioner is provisioning volume for claim "volume-1079/ebs.csi.aws.comdz6nf"
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:38:10 +0000 UTC - event for ebs.csi.aws.comdz6nf: {ebs.csi.aws.com_ebs-csi-controller-6b8d786cf8-2c9wj_d0ba6ade-b289-473e-80f8-50cc0f55ce2b } ProvisioningSucceeded: Successfully provisioned volume pvc-cdf31ea5-711e-4cb6-b8d0-8bfece8d8666
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:38:10 +0000 UTC - event for external-injector: {default-scheduler } Scheduled: Successfully assigned volume-1079/external-injector to i-029f31a6b034de1c6
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:38:15 +0000 UTC - event for external-injector: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-cdf31ea5-711e-4cb6-b8d0-8bfece8d8666" 
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:38:30 +0000 UTC - event for external-injector: {kubelet i-029f31a6b034de1c6} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:38:30 +0000 UTC - event for external-injector: {kubelet i-029f31a6b034de1c6} Created: Created container external-injector
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:38:31 +0000 UTC - event for external-injector: {kubelet i-029f31a6b034de1c6} Started: Started container external-injector
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:38:54 +0000 UTC - event for external-injector: {kubelet i-029f31a6b034de1c6} Killing: Stopping container external-injector
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:39:06 +0000 UTC - event for external-client: {default-scheduler } Scheduled: Successfully assigned volume-1079/external-client to i-01bd5bfa9703f3bd3
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:39:14 +0000 UTC - event for external-client: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-cdf31ea5-711e-4cb6-b8d0-8bfece8d8666" 
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:39:18 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a4ddee2a6ee3ac61e23dc20ac4fd814b8ea7b9889795095c4d0b33d6d061b770": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:39:28 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f28c7bcd229232939eb7bca9db77dbe08a967f7c5239bf19b7fffdf7b89c4f75": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:39:42 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e63466a495e432523ae9c1500a3c7baa9128c0aef1b63fa879bf78709b97b7c0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:39:55 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bf33b4342e4ce884994ef36f990d2a647d956db0970eeac252fdf447d3d80a60": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:40:07 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7cf0b5d1cc527b1126703b5de53c75dc0b0969e2ab88c423f819f52cdf538920": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:40:23 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ecf9f459995edda865ebb266c062ef8100d301c85126355547c38006a5bf32b5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:40:35 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c16e4cb0779a64398c4a564a0de6aed222e9b09d27da02fe8c58da982768b307": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:40:50 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6dc3685a8ca7213a5be287e2f14374653fc2e9693b97db04839d63ab9437dec7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:41:04 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7df18605f4393bb368235db1aa70b31260eb8a9277211cbd043fa5997754a5be": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:25.571: INFO: At 2023-01-05 02:41:15 +0000 UTC - event for external-client: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "784b1fa81bc5b1aceae024efa9e0b455bed29ab85e1ab47a477d59ce07fb3b76": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:25.683: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan  5 02:44:25.683: INFO: 
Jan  5 02:44:25.796: INFO: 
Logging node info for node i-01bd5bfa9703f3bd3
Jan  5 02:44:25.908: INFO: Node Info: &Node{ObjectMeta:{i-01bd5bfa9703f3bd3    69222d04-c2bf-45d2-98fb-9486844f5c9b 7181 0 2023-01-05 02:34:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01bd5bfa9703f3bd3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-01bd5bfa9703f3bd3 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.211 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01bd5bfa9703f3bd3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:44:22 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-05 02:44:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-01bd5bfa9703f3bd3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:44:22 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:44:22 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:44:22 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:44:22 +0000 UTC,LastTransitionTime:2023-01-05 02:34:21 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.211,},NodeAddress{Type:ExternalIP,Address:3.127.108.91,},NodeAddress{Type:InternalDNS,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-127-108-91.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c4f0d8dc84e5ae1e29667dae48eae,SystemUUID:ec2c4f0d-8dc8-4e5a-e1e2-9667dae48eae,BootID:b09c708e-7e9b-478b-a41e-54cca7d4cf91,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0fd62b8d38b0aae69],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0fd62b8d38b0aae69,DevicePath:,},},Config:nil,},}
Jan  5 02:44:25.908: INFO: 
Logging kubelet events for node i-01bd5bfa9703f3bd3
Jan  5 02:44:26.042: INFO: 
Logging pods the kubelet thinks is on node i-01bd5bfa9703f3bd3
Jan  5 02:44:26.277: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wppds started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.277: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:26.277: INFO: host-test-container-pod started at 2023-01-05 02:40:00 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.277: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:26.277: INFO: test-rs-hpvh8 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.277: INFO: 	Container httpd ready: true, restart count 0
Jan  5 02:44:26.277: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-n5tbp started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.277: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:26.277: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gb74d started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:26.278: INFO: pod-projected-configmaps-691cf090-de91-467f-95f8-8d0dcb9aeee7 started at 2023-01-05 02:40:06 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container projected-configmap-volume-test ready: false, restart count 0
Jan  5 02:44:26.278: INFO: hostexec-i-01bd5bfa9703f3bd3-lm4fl started at 2023-01-05 02:39:13 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:26.278: INFO: pod-subpath-test-inlinevolume-h59m started at 2023-01-05 02:39:49 +0000 UTC (2+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Init container init-volume-inlinevolume-h59m ready: false, restart count 0
Jan  5 02:44:26.278: INFO: 	Init container test-init-volume-inlinevolume-h59m ready: false, restart count 0
Jan  5 02:44:26.278: INFO: 	Container test-container-subpath-inlinevolume-h59m ready: false, restart count 0
Jan  5 02:44:26.278: INFO: hostexec-i-01bd5bfa9703f3bd3-6bn56 started at 2023-01-05 02:44:08 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:26.278: INFO: my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59 started at 2023-01-05 02:39:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2 ready: false, restart count 0
Jan  5 02:44:26.278: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tc8w7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:26.278: INFO: ebs-csi-node-gg6js started at 2023-01-05 02:34:09 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:26.278: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:26.278: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:26.278: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nz7dc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:26.278: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-v9t4w started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:44:26.278: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-h4jxc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:26.278: INFO: test-container-pod started at 2023-01-05 02:40:00 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:44:26.278: INFO: inline-volume-tester-h74xj started at 2023-01-05 02:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  5 02:44:26.278: INFO: cilium-fqg7v started at 2023-01-05 02:34:09 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:26.278: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:26.278: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-fj2vh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:26.278: INFO: csi-mockplugin-0 started at 2023-01-05 02:41:00 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:44:26.278: INFO: 	Container driver-registrar ready: false, restart count 0
Jan  5 02:44:26.278: INFO: 	Container mock ready: false, restart count 0
Jan  5 02:44:26.278: INFO: csi-mockplugin-attacher-0 started at 2023-01-05 02:41:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:44:26.278: INFO: hostexec-i-01bd5bfa9703f3bd3-n5wdm started at 2023-01-05 02:41:37 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:26.278: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-bd4zs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:26.278: INFO: netserver-0 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:26.278: INFO: termination-message-container58ca479c-b658-481b-b5b5-e074f05cff2c started at 2023-01-05 02:40:22 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container termination-message-container ready: false, restart count 0
Jan  5 02:44:26.278: INFO: local-injector started at 2023-01-05 02:44:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container local-injector ready: false, restart count 0
Jan  5 02:44:26.278: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-xjdj7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:26.278: INFO: pod-9c32868a-252f-484c-bb70-cade4aec0129 started at 2023-01-05 02:39:35 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:44:26.278: INFO: pod-subpath-test-preprovisionedpv-dprj started at 2023-01-05 02:41:49 +0000 UTC (2+2 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Init container init-volume-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:26.278: INFO: 	Init container test-init-subpath-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:26.278: INFO: 	Container test-container-subpath-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:26.278: INFO: 	Container test-container-volume-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:26.278: INFO: ss2-0 started at 2023-01-05 02:38:18 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:26.278: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:26.735: INFO: 
Latency metrics for node i-01bd5bfa9703f3bd3
Jan  5 02:44:26.735: INFO: 
Logging node info for node i-025e1f38135aff0cb
Jan  5 02:44:26.847: INFO: Node Info: &Node{ObjectMeta:{i-025e1f38135aff0cb    e077826c-bb74-41f6-aafe-d16d1e1a4e20 6075 0 2023-01-05 02:34:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-025e1f38135aff0cb kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-025e1f38135aff0cb topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.96 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-896":"csi-mock-csi-mock-volumes-896","ebs.csi.aws.com":"i-025e1f38135aff0cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:40:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-025e1f38135aff0cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.96,},NodeAddress{Type:ExternalIP,Address:18.195.60.12,},NodeAddress{Type:InternalDNS,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-195-60-12.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec223249b01164600b2958646dddca75,SystemUUID:ec223249-b011-6460-0b29-58646dddca75,BootID:7a5edf7e-21fb-482a-aeb0-e226be4da837,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:26.847: INFO: 
Logging kubelet events for node i-025e1f38135aff0cb
Jan  5 02:44:26.961: INFO: 
Logging pods the kubelet thinks is on node i-025e1f38135aff0cb
Jan  5 02:44:27.081: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lnv9l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.081: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-zkfhs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.081: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-mrk29 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.081: INFO: cilium-rjzq7 started at 2023-01-05 02:34:06 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:27.081: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:27.081: INFO: coredns-559769c974-7vlfn started at 2023-01-05 02:34:41 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:44:27.081: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-z8xgj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.081: INFO: pod-e30c2e03-515c-4253-8cda-dc355d03e809 started at 2023-01-05 02:39:35 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:44:27.081: INFO: csi-mockplugin-0 started at 2023-01-05 02:39:18 +0000 UTC (0+4 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container busybox ready: true, restart count 0
Jan  5 02:44:27.081: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:44:27.081: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  5 02:44:27.081: INFO: 	Container mock ready: true, restart count 0
Jan  5 02:44:27.081: INFO: netserver-1 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:27.081: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wq84l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.081: INFO: hostexec-i-025e1f38135aff0cb-vvrb4 started at 2023-01-05 02:39:17 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:27.081: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-b68nw started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.081: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tg6gz started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.081: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gg7zk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.081: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-p5wf4 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:44:27.081: INFO: ebs-csi-node-hqlnq started at 2023-01-05 02:34:06 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:27.081: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:27.081: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:27.081: INFO: pvc-volume-tester-jxcfl started at 2023-01-05 02:40:26 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container volume-tester ready: false, restart count 0
Jan  5 02:44:27.081: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-g4spn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.081: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.502: INFO: 
Latency metrics for node i-025e1f38135aff0cb
Jan  5 02:44:27.502: INFO: 
Logging node info for node i-029f31a6b034de1c6
Jan  5 02:44:27.614: INFO: Node Info: &Node{ObjectMeta:{i-029f31a6b034de1c6    6eaa3884-9088-400b-96bc-7fe0bc27f677 6319 0 2023-01-05 02:34:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-029f31a6b034de1c6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-029f31a6b034de1c6 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.206 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-029f31a6b034de1c6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:41:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-029f31a6b034de1c6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.206,},NodeAddress{Type:ExternalIP,Address:3.71.43.14,},NodeAddress{Type:InternalDNS,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-43-14.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be2b1604bcc2946df20723d761dd9,SystemUUID:ec2be2b1-604b-cc29-46df-20723d761dd9,BootID:998135dd-fb0c-441d-85ec-d92193042b65,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:27.614: INFO: 
Logging kubelet events for node i-029f31a6b034de1c6
Jan  5 02:44:27.729: INFO: 
Logging pods the kubelet thinks is on node i-029f31a6b034de1c6
Jan  5 02:44:27.851: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-vb4kg started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.851: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ccgnj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.851: INFO: netserver-2 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:27.851: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nqgmc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.851: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-khzwh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.851: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lzwd8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.851: INFO: busybox-readonly-true-b614b5dd-87ef-4d07-94e4-d3c79ca10590 started at 2023-01-05 02:41:11 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container busybox-readonly-true-b614b5dd-87ef-4d07-94e4-d3c79ca10590 ready: false, restart count 0
Jan  5 02:44:27.851: INFO: pod-af540b87-53cd-4665-bf39-2f3a5eed9100 started at 2023-01-05 02:40:44 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:44:27.851: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-sp7hv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.851: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-k6j85 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.851: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ht7lv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.851: INFO: hostexec-i-029f31a6b034de1c6-jhvjk started at 2023-01-05 02:40:40 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:27.851: INFO: test-rs-mvsf6 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container httpd ready: false, restart count 0
Jan  5 02:44:27.851: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-c45mb started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.851: INFO: ebs-csi-node-tb9gj started at 2023-01-05 02:34:17 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:27.851: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:27.851: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:27.851: INFO: cilium-v2frt started at 2023-01-05 02:34:17 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:27.851: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:27.851: INFO: ss2-1 started at 2023-01-05 02:38:28 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:27.851: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-54jfx started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:27.851: INFO: pod-configmaps-4c7c5cae-5dc1-4cf3-b2ef-98693ffaf50d started at 2023-01-05 02:44:26 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  5 02:44:27.851: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:40:04 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:44:27.851: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:44:27.851: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:44:27.851: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:44:27.851: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:44:27.851: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:44:27.851: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:44:27.851: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:44:28.252: INFO: 
Latency metrics for node i-029f31a6b034de1c6
Jan  5 02:44:28.252: INFO: 
Logging node info for node i-03e2b3d27125ad085
Jan  5 02:44:28.364: INFO: Node Info: &Node{ObjectMeta:{i-03e2b3d27125ad085    9cffc38a-f9d7-40cb-848c-a16086a32ac9 5785 0 2023-01-05 02:32:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e2b3d27125ad085 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.123 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03e2b3d27125ad085"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-05 02:32:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-05 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:33:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:40:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e2b3d27125ad085,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:33:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.123,},NodeAddress{Type:ExternalIP,Address:3.124.193.93,},NodeAddress{Type:InternalDNS,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-124-193-93.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2e40ce762960a4f05822e85e89a6d7,SystemUUID:ec2e40ce-7629-60a4-f058-22e85e89a6d7,BootID:e3c9a56f-3559-40b1-99e3-6055bc36443e,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.1],SizeBytes:42982336,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.1],SizeBytes:42804914,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.1],SizeBytes:4967337,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:28.364: INFO: 
Logging kubelet events for node i-03e2b3d27125ad085
Jan  5 02:44:28.478: INFO: 
Logging pods the kubelet thinks is on node i-03e2b3d27125ad085
Jan  5 02:44:28.597: INFO: etcd-manager-events-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:44:28.597: INFO: kube-apiserver-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+2 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Container healthcheck ready: true, restart count 0
Jan  5 02:44:28.597: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  5 02:44:28.597: INFO: aws-cloud-controller-manager-qmldf started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  5 02:44:28.597: INFO: ebs-csi-node-f7tgk started at 2023-01-05 02:33:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:28.597: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:28.597: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:28.597: INFO: ebs-csi-controller-6b8d786cf8-2c9wj started at 2023-01-05 02:33:04 +0000 UTC (0+5 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  5 02:44:28.597: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:44:28.597: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  5 02:44:28.597: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:28.597: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:28.597: INFO: cilium-operator-6f8d6c4bf-kdqfd started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  5 02:44:28.597: INFO: dns-controller-56cf649474-cnnkp started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Container dns-controller ready: true, restart count 0
Jan  5 02:44:28.597: INFO: etcd-manager-main-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:44:28.597: INFO: kube-controller-manager-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  5 02:44:28.597: INFO: kube-scheduler-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  5 02:44:28.597: INFO: cilium-pbccf started at 2023-01-05 02:33:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:28.597: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:28.597: INFO: kops-controller-6mxst started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:28.597: INFO: 	Container kops-controller ready: true, restart count 0
Jan  5 02:44:28.980: INFO: 
Latency metrics for node i-03e2b3d27125ad085
Jan  5 02:44:28.980: INFO: 
Logging node info for node i-03e466e3a84d9f004
Jan  5 02:44:29.092: INFO: Node Info: &Node{ObjectMeta:{i-03e466e3a84d9f004    eb024a0b-a711-42e7-8f3b-c92ac348ecd2 6961 0 2023-01-05 02:34:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e466e3a84d9f004 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-03e466e3a84d9f004 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.198 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03e466e3a84d9f004"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:43:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e466e3a84d9f004,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.198,},NodeAddress{Type:ExternalIP,Address:3.71.182.65,},NodeAddress{Type:InternalDNS,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-182-65.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2183d91500f4a0d14c0ffcaa6a62ca,SystemUUID:ec2183d9-1500-f4a0-d14c-0ffcaa6a62ca,BootID:54ae1a2e-030d-4aec-bab9-224c76049655,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:29.092: INFO: 
Logging kubelet events for node i-03e466e3a84d9f004
Jan  5 02:44:29.206: INFO: 
Logging pods the kubelet thinks is on node i-03e466e3a84d9f004
Jan  5 02:44:29.328: INFO: test-rs-lbcl5 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container httpd ready: false, restart count 0
Jan  5 02:44:29.328: INFO: ss2-2 started at 2023-01-05 02:38:51 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:44:29.328: INFO: ebs-csi-node-9smg4 started at 2023-01-05 02:34:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:29.328: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:29.328: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:29.328: INFO: coredns-559769c974-skw4s started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:44:29.328: INFO: csi-mockplugin-0 started at 2023-01-05 02:39:28 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:44:29.328: INFO: 	Container driver-registrar ready: false, restart count 0
Jan  5 02:44:29.328: INFO: 	Container mock ready: false, restart count 0
Jan  5 02:44:29.328: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gt2l8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:29.328: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-7zfwf started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:29.328: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-9qqj9 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:29.328: INFO: csi-mockplugin-attacher-0 started at 2023-01-05 02:39:28 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:44:29.328: INFO: coredns-autoscaler-7cb5c5b969-bh8d6 started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container autoscaler ready: true, restart count 0
Jan  5 02:44:29.328: INFO: pod-subpath-test-preprovisionedpv-qljw started at 2023-01-05 02:41:19 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Init container init-volume-preprovisionedpv-qljw ready: false, restart count 0
Jan  5 02:44:29.328: INFO: 	Container test-container-subpath-preprovisionedpv-qljw ready: false, restart count 0
Jan  5 02:44:29.328: INFO: pod-subpath-test-preprovisionedpv-h5s6 started at 2023-01-05 02:40:34 +0000 UTC (0+2 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container test-container-subpath-preprovisionedpv-h5s6 ready: false, restart count 0
Jan  5 02:44:29.328: INFO: 	Container test-container-volume-preprovisionedpv-h5s6 ready: false, restart count 0
Jan  5 02:44:29.328: INFO: hostexec-i-03e466e3a84d9f004-wfhss started at 2023-01-05 02:41:03 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:29.328: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-6jwx6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:29.328: INFO: hostexec-i-03e466e3a84d9f004-xgsbh started at 2023-01-05 02:40:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:29.328: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-md2kk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:29.328: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-s9zvl started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:29.328: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-dlzfn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:29.328: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gbdkt started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:29.328: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-67br6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:29.328: INFO: cilium-8rhhk started at 2023-01-05 02:34:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:29.328: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:29.328: INFO: netserver-3 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:29.328: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-2j7x6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:29.328: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:44:29.852: INFO: 
Latency metrics for node i-03e466e3a84d9f004
[DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "volume-1079" for this suite. �[38;5;243m01/05/23 02:44:29.852�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] should be able to convert a non homogeneous list of CRs [Conformance] 5m6s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourceConversionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sconvert\sa\snon\shomogeneous\slist\sof\sCRs\s\[Conformance\]$'

test/e2e/apimachinery/crd_conversion_webhook.go:327
k8s.io/kubernetes/test/e2e/apimachinery.deployCustomResourceWebhookAndService(0xc000bd2960, {0xc003293740, 0x2c}, 0xc00505ff90, 0x24e3, 0x24e4)
	test/e2e/apimachinery/crd_conversion_webhook.go:327 +0xe19
k8s.io/kubernetes/test/e2e/apimachinery.glob..func5.1()
	test/e2e/apimachinery/crd_conversion_webhook.go:136 +0x206
				[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/05/23 02:45:37.785�[0m
Jan  5 02:45:37.785: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename crd-webhook �[38;5;243m01/05/23 02:45:37.786�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/05/23 02:45:38.123�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/05/23 02:45:38.345�[0m
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/crd_conversion_webhook.go:128
�[1mSTEP:�[0m Setting up server cert �[38;5;243m01/05/23 02:45:38.567�[0m
�[1mSTEP:�[0m Create role binding to let cr conversion webhook read extension-apiserver-authentication �[38;5;243m01/05/23 02:45:38.959�[0m
�[1mSTEP:�[0m Deploying the custom resource conversion webhook pod �[38;5;243m01/05/23 02:45:39.073�[0m
�[1mSTEP:�[0m Wait for the deployment to be ready �[38;5;243m01/05/23 02:45:39.301�[0m
Jan  5 02:45:39.639: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:45:41.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:45:43.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:45:45.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:45:47.754: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:45:49.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:45:51.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:45:53.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:45:55.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:45:57.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:45:59.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:01.753: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:03.757: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:05.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:07.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:09.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:11.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:13.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:15.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:17.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:19.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:21.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:23.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:25.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:27.753: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:29.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:31.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:33.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:35.753: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:37.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:39.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:41.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:43.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:45.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:47.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:49.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:51.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:53.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:55.755: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:57.753: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:46:59.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:01.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:03.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:05.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:07.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:09.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:11.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:13.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:15.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:17.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:19.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:21.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:23.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:25.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:27.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:29.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:31.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:33.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:35.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:37.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:39.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:41.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:43.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:45.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:47.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:49.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:51.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:53.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:55.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:57.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:47:59.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:01.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:03.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:05.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:07.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:09.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:11.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:13.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:15.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:17.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:19.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:21.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:23.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:25.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:27.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:29.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:31.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:33.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:35.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:37.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:39.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:41.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:43.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:45.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:47.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:49.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:51.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:53.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:55.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:57.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:48:59.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:01.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:03.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:05.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:07.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:09.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:11.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:13.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:15.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:17.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:19.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:21.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:23.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:25.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:27.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:29.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:31.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:33.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:35.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:37.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:39.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:41.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:43.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:45.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:47.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:49.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:51.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:53.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:55.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:57.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:49:59.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:01.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:03.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:05.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:07.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:09.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:11.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:13.754: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:15.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:17.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:19.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:21.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:23.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:25.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:27.752: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:29.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:31.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:33.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:35.760: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:37.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:39.751: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:39.863: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan  5 02:50:39.863: INFO: Unexpected error: waiting for sample-crd-conversion-webhook-deployment deployment status valid: 
    <*errors.errorString | 0xc0051b9020>: {
        s: "error waiting for deployment \"sample-crd-conversion-webhook-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"sample-crd-conversion-webhook-deployment-74ff66dd47\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}",
    }
Jan  5 02:50:39.863: FAIL: waiting for sample-crd-conversion-webhook-deployment deployment status valid: error waiting for deployment "sample-crd-conversion-webhook-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 5, 2, 45, 39, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)}

Full Stack Trace
k8s.io/kubernetes/test/e2e/apimachinery.deployCustomResourceWebhookAndService(0xc000bd2960, {0xc003293740, 0x2c}, 0xc00505ff90, 0x24e3, 0x24e4)
	test/e2e/apimachinery/crd_conversion_webhook.go:327 +0xe19
k8s.io/kubernetes/test/e2e/apimachinery.glob..func5.1()
	test/e2e/apimachinery/crd_conversion_webhook.go:136 +0x206
[AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/node/init/init.go:32
Jan  5 02:50:39.864: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/apimachinery/crd_conversion_webhook.go:139
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/05/23 02:50:40.428�[0m
�[1mSTEP:�[0m Collecting events from namespace "crd-webhook-144". �[38;5;243m01/05/23 02:50:40.428�[0m
�[1mSTEP:�[0m Found 13 events. �[38;5;243m01/05/23 02:50:40.54�[0m
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:45:39 +0000 UTC - event for sample-crd-conversion-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-crd-conversion-webhook-deployment-74ff66dd47 to 1
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:45:39 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47: {replicaset-controller } SuccessfulCreate: Created pod: sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:45:39 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3fcb169a025171c50bbadbeb50451a7d8482d58dbf88f2b79c5c33f639981252": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:45:39 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x: {default-scheduler } Scheduled: Successfully assigned crd-webhook-144/sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x to i-01bd5bfa9703f3bd3
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:45:52 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "609c2cd06e6771bbbca95b84713838aa3fc460326bab76c3d51fa1fddeee34aa": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:46:03 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "55a5ed0af3f29c8314d37a15589da51418c3317328505426131ffbd652a3386d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:46:14 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "14cf60178afebb2872f3dfb424f0bdcc9f92877309c3eb1693940352ab60a543": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:46:28 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "53f39b1efc664b3077ce2287e92e5a87c9142536616f9c166f843c6fb323b540": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:46:43 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d2011aa5c67e75251468236a124d0163e71f5985f5b10e14d29739b0cc4f4637": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:46:58 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bef28c60605a80b59c462495b3537323b746fdb5d01255f625227294f6078189": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:47:12 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7da0fabdfce2624411ba66d93ae6d0faaf46b099f27f171cdf307b19ed9fb435": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:47:24 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cbbbbdb35d7673b71b0159a400793a4da892ff8a641708e3ee7676d771c70fcc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:40.540: INFO: At 2023-01-05 02:47:39 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9c06c53ffefcb3816b77947e156b4911b496784ba3405778bda8c98149e7a5eb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:50:40.652: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan  5 02:50:40.652: INFO: 
Jan  5 02:50:40.765: INFO: 
Logging node info for node i-01bd5bfa9703f3bd3
Jan  5 02:50:40.877: INFO: Node Info: &Node{ObjectMeta:{i-01bd5bfa9703f3bd3    69222d04-c2bf-45d2-98fb-9486844f5c9b 10478 0 2023-01-05 02:34:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01bd5bfa9703f3bd3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-01bd5bfa9703f3bd3 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.211 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-146":"i-01bd5bfa9703f3bd3","ebs.csi.aws.com":"i-01bd5bfa9703f3bd3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:50:09 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-05 02:50:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-01bd5bfa9703f3bd3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:09 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:09 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:09 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:50:09 +0000 UTC,LastTransitionTime:2023-01-05 02:34:21 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.211,},NodeAddress{Type:ExternalIP,Address:3.127.108.91,},NodeAddress{Type:InternalDNS,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-127-108-91.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c4f0d8dc84e5ae1e29667dae48eae,SystemUUID:ec2c4f0d-8dc8-4e5a-e1e2-9667dae48eae,BootID:b09c708e-7e9b-478b-a41e-54cca7d4cf91,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-146^30f69951-8ca3-11ed-a871-f256e7dbdb77 kubernetes.io/csi/ebs.csi.aws.com^vol-0e6bc0e2cf2e0bf4c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e6bc0e2cf2e0bf4c,DevicePath:,},},Config:nil,},}
Jan  5 02:50:40.877: INFO: 
Logging kubelet events for node i-01bd5bfa9703f3bd3
Jan  5 02:50:40.995: INFO: 
Logging pods the kubelet thinks is on node i-01bd5bfa9703f3bd3
Jan  5 02:50:41.116: INFO: ebs-csi-node-gg6js started at 2023-01-05 02:34:09 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:41.116: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:41.116: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:50:41.116: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nz7dc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.116: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-v9t4w started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.116: INFO: pvc-volume-tester-zm48w started at 2023-01-05 02:46:45 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container volume-tester ready: false, restart count 0
Jan  5 02:50:41.116: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-h4jxc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.116: INFO: cilium-fqg7v started at 2023-01-05 02:34:09 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:50:41.116: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:50:41.116: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-fj2vh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.116: INFO: csi-mockplugin-0 started at 2023-01-05 02:41:00 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:50:41.116: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  5 02:50:41.116: INFO: 	Container mock ready: true, restart count 0
Jan  5 02:50:41.116: INFO: csi-mockplugin-attacher-0 started at 2023-01-05 02:41:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:50:41.116: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-bd4zs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.116: INFO: test-pod-1 started at 2023-01-05 02:48:48 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container token-test ready: false, restart count 0
Jan  5 02:50:41.116: INFO: test-pod-2 started at 2023-01-05 02:48:48 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container token-test ready: false, restart count 0
Jan  5 02:50:41.116: INFO: inline-volume-tester-7ddfs started at 2023-01-05 02:44:45 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  5 02:50:41.116: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-xjdj7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.116: INFO: netserver-0 started at 2023-01-05 02:47:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:41.116: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wppds started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.116: INFO: dns-test-5e174570-82af-4b4c-98b3-8be4084efa2e started at 2023-01-05 02:46:38 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  5 02:50:41.116: INFO: 	Container querier ready: false, restart count 0
Jan  5 02:50:41.116: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:41.116: INFO: netserver-0 started at 2023-01-05 02:50:09 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:41.116: INFO: affinity-clusterip-transition-7hz95 started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container affinity-clusterip-transition ready: true, restart count 0
Jan  5 02:50:41.116: INFO: externalname-service-55bx4 started at 2023-01-05 02:49:35 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container externalname-service ready: false, restart count 0
Jan  5 02:50:41.116: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-n5tbp started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.116: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gb74d started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.116: INFO: dns-test-3b53ba68-c445-4758-b5cc-0ab0531d8eea started at 2023-01-05 02:45:51 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  5 02:50:41.116: INFO: 	Container querier ready: false, restart count 0
Jan  5 02:50:41.116: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:41.116: INFO: hostexec-i-01bd5bfa9703f3bd3-6bn56 started at 2023-01-05 02:44:08 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:50:41.116: INFO: local-client started at 2023-01-05 02:49:03 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container local-client ready: false, restart count 0
Jan  5 02:50:41.116: INFO: execpod-affinityk6fqz started at 2023-01-05 02:49:05 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  5 02:50:41.116: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tc8w7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.116: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.514: INFO: 
Latency metrics for node i-01bd5bfa9703f3bd3
Jan  5 02:50:41.514: INFO: 
Logging node info for node i-025e1f38135aff0cb
Jan  5 02:50:41.632: INFO: Node Info: &Node{ObjectMeta:{i-025e1f38135aff0cb    e077826c-bb74-41f6-aafe-d16d1e1a4e20 8465 0 2023-01-05 02:34:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-025e1f38135aff0cb kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-025e1f38135aff0cb topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.96 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-025e1f38135aff0cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:46:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-025e1f38135aff0cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.96,},NodeAddress{Type:ExternalIP,Address:18.195.60.12,},NodeAddress{Type:InternalDNS,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-195-60-12.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec223249b01164600b2958646dddca75,SystemUUID:ec223249-b011-6460-0b29-58646dddca75,BootID:7a5edf7e-21fb-482a-aeb0-e226be4da837,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:50:41.632: INFO: 
Logging kubelet events for node i-025e1f38135aff0cb
Jan  5 02:50:41.747: INFO: 
Logging pods the kubelet thinks is on node i-025e1f38135aff0cb
Jan  5 02:50:41.868: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:46:55 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:50:41.868: INFO: cilium-rjzq7 started at 2023-01-05 02:34:06 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:50:41.868: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:50:41.868: INFO: coredns-559769c974-7vlfn started at 2023-01-05 02:34:41 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:50:41.868: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-z8xgj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.868: INFO: hostexec-i-025e1f38135aff0cb-ft52q started at 2023-01-05 02:50:05 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:50:41.868: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tg6gz started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.868: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:48:41 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:50:41.868: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:50:41.868: INFO: netserver-1 started at 2023-01-05 02:47:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:41.868: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wq84l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.868: INFO: affinity-clusterip-transition-5275l started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container affinity-clusterip-transition ready: true, restart count 0
Jan  5 02:50:41.868: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-b68nw started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.868: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-g4spn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.868: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gg7zk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.868: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-p5wf4 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.868: INFO: ebs-csi-node-hqlnq started at 2023-01-05 02:34:06 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:41.868: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:41.868: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:50:41.868: INFO: pod-04f917a0-2305-4c6a-8f90-9db335e1d12e started at 2023-01-05 02:50:10 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:50:41.868: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lnv9l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.868: INFO: netserver-1 started at 2023-01-05 02:50:09 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:41.868: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-zkfhs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:41.868: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-mrk29 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:41.868: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:42.296: INFO: 
Latency metrics for node i-025e1f38135aff0cb
Jan  5 02:50:42.296: INFO: 
Logging node info for node i-029f31a6b034de1c6
Jan  5 02:50:42.408: INFO: Node Info: &Node{ObjectMeta:{i-029f31a6b034de1c6    6eaa3884-9088-400b-96bc-7fe0bc27f677 10658 0 2023-01-05 02:34:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-029f31a6b034de1c6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-029f31a6b034de1c6 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.206 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-029f31a6b034de1c6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:50:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-05 02:50:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-029f31a6b034de1c6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:50:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.206,},NodeAddress{Type:ExternalIP,Address:3.71.43.14,},NodeAddress{Type:InternalDNS,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-43-14.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be2b1604bcc2946df20723d761dd9,SystemUUID:ec2be2b1-604b-cc29-46df-20723d761dd9,BootID:998135dd-fb0c-441d-85ec-d92193042b65,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-07ee2017c73ff4d6e kubernetes.io/csi/ebs.csi.aws.com^vol-0ac9e65b8e974a254],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ac9e65b8e974a254,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-07ee2017c73ff4d6e,DevicePath:,},},Config:nil,},}
Jan  5 02:50:42.408: INFO: 
Logging kubelet events for node i-029f31a6b034de1c6
Jan  5 02:50:42.523: INFO: 
Logging pods the kubelet thinks is on node i-029f31a6b034de1c6
Jan  5 02:50:42.644: INFO: externalname-service-s92dl started at 2023-01-05 02:49:35 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container externalname-service ready: false, restart count 0
Jan  5 02:50:42.644: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ccgnj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:42.644: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:46:07 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:50:42.644: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:50:42.644: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:50:42.644: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:50:42.644: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:50:42.644: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:50:42.644: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:50:42.644: INFO: test-pod-3 started at 2023-01-05 02:48:48 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container token-test ready: false, restart count 0
Jan  5 02:50:42.644: INFO: hostexec-i-029f31a6b034de1c6-g7jck started at 2023-01-05 02:48:51 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:50:42.644: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nqgmc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:42.644: INFO: netserver-2 started at 2023-01-05 02:50:09 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:42.644: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-khzwh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:42.644: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lzwd8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:42.644: INFO: inline-volume-tester-m8c6f started at 2023-01-05 02:50:32 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  5 02:50:42.644: INFO: netserver-2 started at 2023-01-05 02:47:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:50:42.644: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-sp7hv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:42.644: INFO: affinity-clusterip-transition-8v8lg started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container affinity-clusterip-transition ready: true, restart count 0
Jan  5 02:50:42.644: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-k6j85 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:42.644: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ht7lv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:42.644: INFO: hostexec-i-029f31a6b034de1c6-bz949 started at 2023-01-05 02:49:37 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:50:42.644: INFO: pod-subpath-test-preprovisionedpv-vmmx started at 2023-01-05 02:49:49 +0000 UTC (2+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Init container init-volume-preprovisionedpv-vmmx ready: false, restart count 0
Jan  5 02:50:42.644: INFO: 	Init container test-init-subpath-preprovisionedpv-vmmx ready: false, restart count 0
Jan  5 02:50:42.644: INFO: 	Container test-container-subpath-preprovisionedpv-vmmx ready: false, restart count 0
Jan  5 02:50:42.644: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-54jfx started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:42.644: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-c45mb started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:42.644: INFO: ebs-csi-node-tb9gj started at 2023-01-05 02:34:17 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:42.644: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:42.644: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:50:42.644: INFO: cilium-v2frt started at 2023-01-05 02:34:17 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:50:42.644: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:50:42.644: INFO: pod-19cfa542-8ad7-424f-86ab-9b51935574b0 started at 2023-01-05 02:48:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:50:42.644: INFO: implicit-nonroot-uid started at 2023-01-05 02:47:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container implicit-nonroot-uid ready: false, restart count 0
Jan  5 02:50:42.644: INFO: pod-8ffe8f57-8965-48ef-85a1-bf788f766275 started at 2023-01-05 02:48:45 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:50:42.644: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-vb4kg started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:42.644: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:43.039: INFO: 
Latency metrics for node i-029f31a6b034de1c6
Jan  5 02:50:43.039: INFO: 
Logging node info for node i-03e2b3d27125ad085
Jan  5 02:50:43.151: INFO: Node Info: &Node{ObjectMeta:{i-03e2b3d27125ad085    9cffc38a-f9d7-40cb-848c-a16086a32ac9 10538 0 2023-01-05 02:32:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e2b3d27125ad085 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.123 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03e2b3d27125ad085"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-05 02:32:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-05 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:33:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:50:20 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e2b3d27125ad085,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:20 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:20 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:50:20 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:50:20 +0000 UTC,LastTransitionTime:2023-01-05 02:33:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.123,},NodeAddress{Type:ExternalIP,Address:3.124.193.93,},NodeAddress{Type:InternalDNS,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-124-193-93.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2e40ce762960a4f05822e85e89a6d7,SystemUUID:ec2e40ce-7629-60a4-f058-22e85e89a6d7,BootID:e3c9a56f-3559-40b1-99e3-6055bc36443e,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.1],SizeBytes:42982336,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.1],SizeBytes:42804914,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.1],SizeBytes:4967337,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:50:43.152: INFO: 
Logging kubelet events for node i-03e2b3d27125ad085
Jan  5 02:50:43.267: INFO: 
Logging pods the kubelet thinks is on node i-03e2b3d27125ad085
Jan  5 02:50:43.386: INFO: etcd-manager-events-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:50:43.386: INFO: kube-apiserver-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+2 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Container healthcheck ready: true, restart count 0
Jan  5 02:50:43.386: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  5 02:50:43.386: INFO: aws-cloud-controller-manager-qmldf started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  5 02:50:43.386: INFO: ebs-csi-node-f7tgk started at 2023-01-05 02:33:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:43.386: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:43.386: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:50:43.386: INFO: dns-controller-56cf649474-cnnkp started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Container dns-controller ready: true, restart count 0
Jan  5 02:50:43.386: INFO: etcd-manager-main-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:50:43.386: INFO: kube-controller-manager-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  5 02:50:43.386: INFO: kube-scheduler-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  5 02:50:43.386: INFO: cilium-pbccf started at 2023-01-05 02:33:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:50:43.386: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:50:43.386: INFO: kops-controller-6mxst started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Container kops-controller ready: true, restart count 0
Jan  5 02:50:43.386: INFO: ebs-csi-controller-6b8d786cf8-2c9wj started at 2023-01-05 02:33:04 +0000 UTC (0+5 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  5 02:50:43.386: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:50:43.386: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  5 02:50:43.386: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:43.386: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:43.386: INFO: cilium-operator-6f8d6c4bf-kdqfd started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:43.386: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  5 02:50:43.776: INFO: 
Latency metrics for node i-03e2b3d27125ad085
Jan  5 02:50:43.776: INFO: 
Logging node info for node i-03e466e3a84d9f004
Jan  5 02:50:43.889: INFO: Node Info: &Node{ObjectMeta:{i-03e466e3a84d9f004    eb024a0b-a711-42e7-8f3b-c92ac348ecd2 10430 0 2023-01-05 02:34:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e466e3a84d9f004 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-03e466e3a84d9f004 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.198 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-401":"i-03e466e3a84d9f004","ebs.csi.aws.com":"i-03e466e3a84d9f004"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:50:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e466e3a84d9f004,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:49:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:49:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:49:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:49:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.198,},NodeAddress{Type:ExternalIP,Address:3.71.182.65,},NodeAddress{Type:InternalDNS,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-182-65.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2183d91500f4a0d14c0ffcaa6a62ca,SystemUUID:ec2183d9-1500-f4a0-d14c-0ffcaa6a62ca,BootID:54ae1a2e-030d-4aec-bab9-224c76049655,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:50:43.889: INFO: 
Logging kubelet events for node i-03e466e3a84d9f004
Jan  5 02:50:44.003: INFO: 
Logging pods the kubelet thinks is on node i-03e466e3a84d9f004
Jan  5 02:50:44.123: INFO: ebs-csi-node-9smg4 started at 2023-01-05 02:34:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:50:44.123: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:50:44.123: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:50:44.123: INFO: csi-mockplugin-0 started at 2023-01-05 02:45:44 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:50:44.123: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  5 02:50:44.123: INFO: 	Container mock ready: true, restart count 0
Jan  5 02:50:44.123: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gt2l8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:44.123: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-7zfwf started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:44.123: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-9qqj9 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:44.123: INFO: coredns-autoscaler-7cb5c5b969-bh8d6 started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container autoscaler ready: true, restart count 0
Jan  5 02:50:44.123: INFO: coredns-559769c974-skw4s started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:50:44.123: INFO: netserver-3 started at 2023-01-05 02:50:10 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:44.123: INFO: hostexec-i-03e466e3a84d9f004-vbxzx started at 2023-01-05 02:46:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:50:44.123: INFO: pod-d23ae6e2-6e2b-4da4-9428-7b75348dbb12 started at 2023-01-05 02:46:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:50:44.123: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-6jwx6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:44.123: INFO: netserver-3 started at 2023-01-05 02:47:02 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:50:44.123: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-dlzfn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:44.123: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gbdkt started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:44.123: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-67br6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:44.123: INFO: cilium-8rhhk started at 2023-01-05 02:34:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:50:44.123: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:50:44.123: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-md2kk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:44.123: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-s9zvl started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:50:44.123: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-2j7x6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:50:44.123: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:50:44.520: INFO: 
Latency metrics for node i-03e466e3a84d9f004
[DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin]
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "crd-webhook-144" for this suite. �[38;5;243m01/05/23 02:50:44.52�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-apps] ReplicaSet should list and delete a collection of ReplicaSets [Conformance] 5m6s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sReplicaSet\sshould\slist\sand\sdelete\sa\scollection\sof\sReplicaSets\s\[Conformance\]$'

test/e2e/apps/replica_set.go:585
k8s.io/kubernetes/test/e2e/apps.listRSDeleteCollection(0xc000013548?)
	test/e2e/apps/replica_set.go:585 +0x51a
k8s.io/kubernetes/test/e2e/apps.glob..func9.7()
	test/e2e/apps/replica_set.go:166 +0x1d
				[BeforeEach] [sig-apps] ReplicaSet
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/05/23 02:40:55.878�[0m
Jan  5 02:40:55.878: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename replicaset �[38;5;243m01/05/23 02:40:55.879�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/05/23 02:40:56.221�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/05/23 02:40:56.445�[0m
[BeforeEach] [sig-apps] ReplicaSet
  test/e2e/framework/metrics/init/init.go:31
[It] should list and delete a collection of ReplicaSets [Conformance]
  test/e2e/apps/replica_set.go:165
�[1mSTEP:�[0m Create a ReplicaSet �[38;5;243m01/05/23 02:40:56.67�[0m
�[1mSTEP:�[0m Verify that the required pods have come up �[38;5;243m01/05/23 02:40:56.785�[0m
Jan  5 02:40:56.898: INFO: Pod name sample-pod: Found 3 pods out of 3
�[1mSTEP:�[0m ensuring each pod is running �[38;5;243m01/05/23 02:40:56.898�[0m
Jan  5 02:40:56.898: INFO: Waiting up to 5m0s for pod "test-rs-mvsf6" in namespace "replicaset-7262" to be "running"
Jan  5 02:40:56.898: INFO: Waiting up to 5m0s for pod "test-rs-hpvh8" in namespace "replicaset-7262" to be "running"
Jan  5 02:40:56.898: INFO: Waiting up to 5m0s for pod "test-rs-lbcl5" in namespace "replicaset-7262" to be "running"
Jan  5 02:40:57.011: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 113.048551ms
Jan  5 02:40:57.012: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 113.041139ms
Jan  5 02:40:57.012: INFO: Pod "test-rs-hpvh8": Phase="Pending", Reason="", readiness=false. Elapsed: 113.517745ms
Jan  5 02:40:59.127: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.228366316s
Jan  5 02:40:59.127: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2.228460333s
Jan  5 02:40:59.127: INFO: Pod "test-rs-hpvh8": Phase="Pending", Reason="", readiness=false. Elapsed: 2.228487805s
Jan  5 02:41:01.124: INFO: Pod "test-rs-hpvh8": Phase="Running", Reason="", readiness=true. Elapsed: 4.226037324s
Jan  5 02:41:01.124: INFO: Pod "test-rs-hpvh8" satisfied condition "running"
Jan  5 02:41:01.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.226474703s
Jan  5 02:41:01.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4.226760483s
Jan  5 02:41:03.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 6.226342242s
Jan  5 02:41:03.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.226272048s
Jan  5 02:41:05.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 8.227009862s
Jan  5 02:41:05.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 8.227107887s
Jan  5 02:41:07.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 10.227369768s
Jan  5 02:41:07.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 10.22739119s
Jan  5 02:41:09.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 12.22747471s
Jan  5 02:41:09.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 12.227373092s
Jan  5 02:41:11.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 14.225943932s
Jan  5 02:41:11.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 14.225874518s
Jan  5 02:41:13.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 16.227608759s
Jan  5 02:41:13.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 16.227703966s
Jan  5 02:41:15.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 18.227054356s
Jan  5 02:41:15.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 18.226974643s
Jan  5 02:41:17.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 20.225867074s
Jan  5 02:41:17.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 20.225987906s
Jan  5 02:41:19.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 22.226688858s
Jan  5 02:41:19.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 22.226996673s
Jan  5 02:41:21.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 24.226256978s
Jan  5 02:41:21.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 24.226525167s
Jan  5 02:41:23.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 26.226481778s
Jan  5 02:41:23.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 26.226597781s
Jan  5 02:41:25.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 28.227104037s
Jan  5 02:41:25.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 28.227011601s
Jan  5 02:41:27.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 30.22679964s
Jan  5 02:41:27.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 30.226818159s
Jan  5 02:41:29.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 32.226935322s
Jan  5 02:41:29.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 32.226851836s
Jan  5 02:41:31.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 34.226241024s
Jan  5 02:41:31.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 34.22614703s
Jan  5 02:41:33.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 36.226657204s
Jan  5 02:41:33.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 36.22675091s
Jan  5 02:41:35.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 38.226211748s
Jan  5 02:41:35.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 38.22630224s
Jan  5 02:41:37.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 40.226092278s
Jan  5 02:41:37.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 40.226056254s
Jan  5 02:41:39.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 42.226888941s
Jan  5 02:41:39.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 42.226989352s
Jan  5 02:41:41.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 44.226900448s
Jan  5 02:41:41.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 44.226834588s
Jan  5 02:41:43.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 46.225879359s
Jan  5 02:41:43.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 46.226069379s
Jan  5 02:41:45.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 48.226658659s
Jan  5 02:41:45.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 48.226767177s
Jan  5 02:41:47.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 50.22668515s
Jan  5 02:41:47.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 50.227034731s
Jan  5 02:41:49.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 52.227380135s
Jan  5 02:41:49.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 52.227338432s
Jan  5 02:41:51.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 54.226559623s
Jan  5 02:41:51.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 54.22646982s
Jan  5 02:41:53.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 56.226945195s
Jan  5 02:41:53.129: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 56.230086686s
Jan  5 02:41:55.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 58.225688374s
Jan  5 02:41:55.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 58.225796785s
Jan  5 02:41:57.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.226776166s
Jan  5 02:41:57.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.226953397s
Jan  5 02:41:59.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.22691487s
Jan  5 02:41:59.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.227014725s
Jan  5 02:42:01.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.226781513s
Jan  5 02:42:01.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.226936421s
Jan  5 02:42:03.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.227071583s
Jan  5 02:42:03.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.227413847s
Jan  5 02:42:05.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.226463566s
Jan  5 02:42:05.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.226571573s
Jan  5 02:42:07.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.225987806s
Jan  5 02:42:07.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.226080483s
Jan  5 02:42:09.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.227377478s
Jan  5 02:42:09.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.227574652s
Jan  5 02:42:11.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.226522601s
Jan  5 02:42:11.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.226765544s
Jan  5 02:42:13.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.227146492s
Jan  5 02:42:13.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.227532592s
Jan  5 02:42:15.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.226275295s
Jan  5 02:42:15.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.226181123s
Jan  5 02:42:17.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.226459421s
Jan  5 02:42:17.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.226392266s
Jan  5 02:42:19.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.227313978s
Jan  5 02:42:19.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.227432915s
Jan  5 02:42:21.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.226914354s
Jan  5 02:42:21.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.226829443s
Jan  5 02:42:23.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.225982027s
Jan  5 02:42:23.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.226182999s
Jan  5 02:42:25.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.22579743s
Jan  5 02:42:25.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.226000707s
Jan  5 02:42:27.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.226165447s
Jan  5 02:42:27.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.22631859s
Jan  5 02:42:29.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.227160564s
Jan  5 02:42:29.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.227250433s
Jan  5 02:42:31.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.225936006s
Jan  5 02:42:31.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.226162893s
Jan  5 02:42:33.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.225697121s
Jan  5 02:42:33.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.226189838s
Jan  5 02:42:35.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.226005269s
Jan  5 02:42:35.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.226108476s
Jan  5 02:42:37.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.226409486s
Jan  5 02:42:37.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.226323283s
Jan  5 02:42:39.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.226197534s
Jan  5 02:42:39.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.226287024s
Jan  5 02:42:41.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.225791193s
Jan  5 02:42:41.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.225983605s
Jan  5 02:42:43.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.226326169s
Jan  5 02:42:43.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.226244169s
Jan  5 02:42:45.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.227191778s
Jan  5 02:42:45.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.22709969s
Jan  5 02:42:47.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.226537666s
Jan  5 02:42:47.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.226484201s
Jan  5 02:42:49.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.226563452s
Jan  5 02:42:49.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.226469315s
Jan  5 02:42:51.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.2261348s
Jan  5 02:42:51.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.226081118s
Jan  5 02:42:53.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.226020266s
Jan  5 02:42:53.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.226004154s
Jan  5 02:42:55.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.226808783s
Jan  5 02:42:55.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.227181251s
Jan  5 02:42:57.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.226817472s
Jan  5 02:42:57.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.226961888s
Jan  5 02:42:59.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.22634993s
Jan  5 02:42:59.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.226344799s
Jan  5 02:43:01.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.226201248s
Jan  5 02:43:01.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.226430091s
Jan  5 02:43:03.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.226940685s
Jan  5 02:43:03.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.227077804s
Jan  5 02:43:05.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.22603264s
Jan  5 02:43:05.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.225938489s
Jan  5 02:43:07.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.227086067s
Jan  5 02:43:07.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.226992103s
Jan  5 02:43:09.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.225762345s
Jan  5 02:43:09.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.22586365s
Jan  5 02:43:11.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.227342479s
Jan  5 02:43:11.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.227251925s
Jan  5 02:43:13.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.22675573s
Jan  5 02:43:13.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.226849792s
Jan  5 02:43:15.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.226228812s
Jan  5 02:43:15.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.226134851s
Jan  5 02:43:17.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.226700267s
Jan  5 02:43:17.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.226893062s
Jan  5 02:43:19.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.226333643s
Jan  5 02:43:19.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.226246148s
Jan  5 02:43:21.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.226189331s
Jan  5 02:43:21.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.226122785s
Jan  5 02:43:23.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.226757806s
Jan  5 02:43:23.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.226879913s
Jan  5 02:43:25.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.226181292s
Jan  5 02:43:25.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.227174588s
Jan  5 02:43:27.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.226249905s
Jan  5 02:43:27.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.226212185s
Jan  5 02:43:29.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.226867354s
Jan  5 02:43:29.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.227125074s
Jan  5 02:43:31.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.226049733s
Jan  5 02:43:31.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.226188246s
Jan  5 02:43:33.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.226051309s
Jan  5 02:43:33.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.226193164s
Jan  5 02:43:35.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.226931511s
Jan  5 02:43:35.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.226854156s
Jan  5 02:43:37.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.226349872s
Jan  5 02:43:37.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.226443926s
Jan  5 02:43:39.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.226354836s
Jan  5 02:43:39.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.226427671s
Jan  5 02:43:41.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.22673703s
Jan  5 02:43:41.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.226831183s
Jan  5 02:43:43.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.227523542s
Jan  5 02:43:43.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.227436917s
Jan  5 02:43:45.128: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.22997071s
Jan  5 02:43:45.129: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.230127319s
Jan  5 02:43:47.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.226598602s
Jan  5 02:43:47.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.226696922s
Jan  5 02:43:49.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.226920352s
Jan  5 02:43:49.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.227021517s
Jan  5 02:43:51.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.226355864s
Jan  5 02:43:51.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.226462824s
Jan  5 02:43:53.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.225961202s
Jan  5 02:43:53.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.225883364s
Jan  5 02:43:55.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.226021895s
Jan  5 02:43:55.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.226185599s
Jan  5 02:43:57.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.226115967s
Jan  5 02:43:57.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.226026197s
Jan  5 02:43:59.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.226789897s
Jan  5 02:43:59.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.226884259s
Jan  5 02:44:01.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.226646807s
Jan  5 02:44:01.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.226777067s
Jan  5 02:44:03.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.226885083s
Jan  5 02:44:03.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.226786535s
Jan  5 02:44:05.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.226748477s
Jan  5 02:44:05.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.226654224s
Jan  5 02:44:07.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.227020905s
Jan  5 02:44:07.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.227122225s
Jan  5 02:44:09.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.226921516s
Jan  5 02:44:09.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.227041332s
Jan  5 02:44:11.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.226487905s
Jan  5 02:44:11.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.22645321s
Jan  5 02:44:13.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.226259943s
Jan  5 02:44:13.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.226495682s
Jan  5 02:44:15.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.226823577s
Jan  5 02:44:15.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.226819116s
Jan  5 02:44:17.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.226665771s
Jan  5 02:44:17.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.226679971s
Jan  5 02:44:19.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.226457617s
Jan  5 02:44:19.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.226370394s
Jan  5 02:44:21.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.22610908s
Jan  5 02:44:21.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.22620248s
Jan  5 02:44:23.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.22648113s
Jan  5 02:44:23.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.226396141s
Jan  5 02:44:25.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.226489513s
Jan  5 02:44:25.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.22665052s
Jan  5 02:44:27.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.225943121s
Jan  5 02:44:27.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.226053299s
Jan  5 02:44:29.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.227081945s
Jan  5 02:44:29.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.227052789s
Jan  5 02:44:31.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.226922426s
Jan  5 02:44:31.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.226841293s
Jan  5 02:44:33.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.226835047s
Jan  5 02:44:33.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.226998001s
Jan  5 02:44:35.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.226948881s
Jan  5 02:44:35.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.22724155s
Jan  5 02:44:37.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.227602406s
Jan  5 02:44:37.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.227527831s
Jan  5 02:44:39.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.227301605s
Jan  5 02:44:39.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.227396316s
Jan  5 02:44:41.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.226318238s
Jan  5 02:44:41.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.226462269s
Jan  5 02:44:43.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.22616762s
Jan  5 02:44:43.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.226088669s
Jan  5 02:44:45.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.22592572s
Jan  5 02:44:45.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.225845117s
Jan  5 02:44:47.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.226052467s
Jan  5 02:44:47.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.226018429s
Jan  5 02:44:49.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.226157832s
Jan  5 02:44:49.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.226261792s
Jan  5 02:44:51.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.226043435s
Jan  5 02:44:51.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.226245543s
Jan  5 02:44:53.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.22691107s
Jan  5 02:44:53.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.226857228s
Jan  5 02:44:55.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.227136232s
Jan  5 02:44:55.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.227230303s
Jan  5 02:44:57.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.227226035s
Jan  5 02:44:57.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.227469113s
Jan  5 02:44:59.131: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.2322072s
Jan  5 02:44:59.131: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.232148087s
Jan  5 02:45:01.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.228032024s
Jan  5 02:45:01.127: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.228164366s
Jan  5 02:45:03.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.227402533s
Jan  5 02:45:03.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.227504277s
Jan  5 02:45:05.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.226343501s
Jan  5 02:45:05.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.227924344s
Jan  5 02:45:07.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.225505321s
Jan  5 02:45:07.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.225709471s
Jan  5 02:45:09.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.226409448s
Jan  5 02:45:09.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.226320214s
Jan  5 02:45:11.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.22630266s
Jan  5 02:45:11.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.226377914s
Jan  5 02:45:13.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.226152557s
Jan  5 02:45:13.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.226074237s
Jan  5 02:45:15.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.226769514s
Jan  5 02:45:15.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.226699323s
Jan  5 02:45:17.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.2261672s
Jan  5 02:45:17.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.226101758s
Jan  5 02:45:19.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.22626314s
Jan  5 02:45:19.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.226169739s
Jan  5 02:45:21.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.226523134s
Jan  5 02:45:21.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.226556597s
Jan  5 02:45:23.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.22623696s
Jan  5 02:45:23.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.226703513s
Jan  5 02:45:25.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.226713197s
Jan  5 02:45:25.128: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.229188167s
Jan  5 02:45:27.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.22704367s
Jan  5 02:45:27.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.22695519s
Jan  5 02:45:29.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.225911208s
Jan  5 02:45:29.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.225978649s
Jan  5 02:45:31.129: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.230537062s
Jan  5 02:45:31.129: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.230694279s
Jan  5 02:45:33.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.225987095s
Jan  5 02:45:33.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.226182194s
Jan  5 02:45:35.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.226221249s
Jan  5 02:45:35.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.226179997s
Jan  5 02:45:37.126: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.227200119s
Jan  5 02:45:37.126: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.227356208s
Jan  5 02:45:39.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.226744549s
Jan  5 02:45:39.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.226810138s
Jan  5 02:45:41.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.226161353s
Jan  5 02:45:41.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.226523569s
Jan  5 02:45:43.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.225736676s
Jan  5 02:45:43.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.225842389s
Jan  5 02:45:45.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.226356781s
Jan  5 02:45:45.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.226450859s
Jan  5 02:45:47.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.225781821s
Jan  5 02:45:47.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.225875892s
Jan  5 02:45:49.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.226750415s
Jan  5 02:45:49.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.226761045s
Jan  5 02:45:51.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.226487001s
Jan  5 02:45:51.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.226875832s
Jan  5 02:45:53.124: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.22598374s
Jan  5 02:45:53.124: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.225889434s
Jan  5 02:45:55.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.22635997s
Jan  5 02:45:55.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.226509188s
Jan  5 02:45:57.125: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.226229816s
Jan  5 02:45:57.125: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.226144766s
Jan  5 02:45:57.237: INFO: Pod "test-rs-mvsf6": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.339066818s
Jan  5 02:45:57.238: INFO: Pod "test-rs-lbcl5": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.339036964s
Jan  5 02:45:57.238: INFO: Unexpected error: Failed to create pods: failed to wait for pods running: [timed out while waiting for pod replicaset-7262/test-rs-mvsf6 to be running timed out while waiting for pod replicaset-7262/test-rs-lbcl5 to be running]: 
    <*errors.errorString | 0xc001312a60>: {
        s: "failed to wait for pods running: [timed out while waiting for pod replicaset-7262/test-rs-mvsf6 to be running timed out while waiting for pod replicaset-7262/test-rs-lbcl5 to be running]",
    }
Jan  5 02:45:57.238: FAIL: Failed to create pods: failed to wait for pods running: [timed out while waiting for pod replicaset-7262/test-rs-mvsf6 to be running timed out while waiting for pod replicaset-7262/test-rs-lbcl5 to be running]: failed to wait for pods running: [timed out while waiting for pod replicaset-7262/test-rs-mvsf6 to be running timed out while waiting for pod replicaset-7262/test-rs-lbcl5 to be running]

Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.listRSDeleteCollection(0xc000013548?)
	test/e2e/apps/replica_set.go:585 +0x51a
k8s.io/kubernetes/test/e2e/apps.glob..func9.7()
	test/e2e/apps/replica_set.go:166 +0x1d
[AfterEach] [sig-apps] ReplicaSet
  test/e2e/framework/node/init/init.go:32
Jan  5 02:45:57.238: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] ReplicaSet
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] ReplicaSet
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/05/23 02:45:57.352�[0m
�[1mSTEP:�[0m Collecting events from namespace "replicaset-7262". �[38;5;243m01/05/23 02:45:57.352�[0m
�[1mSTEP:�[0m Found 29 events. �[38;5;243m01/05/23 02:45:57.466�[0m
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:40:56 +0000 UTC - event for test-rs: {replicaset-controller } SuccessfulCreate: Created pod: test-rs-lbcl5
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:40:56 +0000 UTC - event for test-rs: {replicaset-controller } SuccessfulCreate: Created pod: test-rs-hpvh8
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:40:56 +0000 UTC - event for test-rs: {replicaset-controller } SuccessfulCreate: Created pod: test-rs-mvsf6
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:40:56 +0000 UTC - event for test-rs-hpvh8: {default-scheduler } Scheduled: Successfully assigned replicaset-7262/test-rs-hpvh8 to i-01bd5bfa9703f3bd3
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:40:56 +0000 UTC - event for test-rs-lbcl5: {default-scheduler } Scheduled: Successfully assigned replicaset-7262/test-rs-lbcl5 to i-03e466e3a84d9f004
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:40:56 +0000 UTC - event for test-rs-mvsf6: {default-scheduler } Scheduled: Successfully assigned replicaset-7262/test-rs-mvsf6 to i-029f31a6b034de1c6
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:40:57 +0000 UTC - event for test-rs-lbcl5: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7c4091317603ee5b65f45b04d161935f526ce0bd12144f8026e1e7d452674b52": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:40:57 +0000 UTC - event for test-rs-mvsf6: {kubelet i-029f31a6b034de1c6} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ef5db69464dc1e689929addf92906bdb45f0fe88173a74228b40f25c4288ab5a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:40:58 +0000 UTC - event for test-rs-hpvh8: {kubelet i-01bd5bfa9703f3bd3} Started: Started container httpd
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:40:58 +0000 UTC - event for test-rs-hpvh8: {kubelet i-01bd5bfa9703f3bd3} Created: Created container httpd
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:40:58 +0000 UTC - event for test-rs-hpvh8: {kubelet i-01bd5bfa9703f3bd3} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:41:08 +0000 UTC - event for test-rs-lbcl5: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ec40fd87cae32eea38336eea8f9f3fd3a0785f8b3d1d47a6246125ec03ac5fae": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:41:08 +0000 UTC - event for test-rs-mvsf6: {kubelet i-029f31a6b034de1c6} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "06bb7389d10731449a94679bebd87fd272695a98ef47aaa6ab62a7937281d890": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:41:19 +0000 UTC - event for test-rs-mvsf6: {kubelet i-029f31a6b034de1c6} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "94ea9ddb3aebf6f970e9fff24b43bfd7423180373b57086f43104fc26fd9b944": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:41:22 +0000 UTC - event for test-rs-lbcl5: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8d3e775e45dd058c6437f65cd0af0a5473f2a7376db16acbb2be56e3aeba117c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:41:34 +0000 UTC - event for test-rs-mvsf6: {kubelet i-029f31a6b034de1c6} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1c768bf05b931b915c4b56e20e09a6b31e2e684f5bbdf491dcf2c3eb033fe03f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:41:37 +0000 UTC - event for test-rs-lbcl5: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "695e8b1f49a8053a0a4e0d33887fe08a88053588cc8dc0c0a52f90595efc74dc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:41:48 +0000 UTC - event for test-rs-mvsf6: {kubelet i-029f31a6b034de1c6} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4ffb671a355526162856c30928ba0cea07a82246777897f144248f82d1f72116": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:41:49 +0000 UTC - event for test-rs-lbcl5: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a947dd2ffe222c4a4b45c5d2dac9abf36a18a45ad6efb0a93f93a0b3e6a7c47c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:42:02 +0000 UTC - event for test-rs-lbcl5: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "26633fda49047022c866dcce93b1b7a2394b81f6d62ef5157387d6837b61dbf2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:42:03 +0000 UTC - event for test-rs-mvsf6: {kubelet i-029f31a6b034de1c6} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7a3427b547902a898118fef8d0123f9cb4e27acfb8e3f42a4ca0164d8268d244": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:42:14 +0000 UTC - event for test-rs-mvsf6: {kubelet i-029f31a6b034de1c6} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ea6d9b768f25e561b3b795ab8121fd35d47899e5212f114c729f5556eea6222a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:42:15 +0000 UTC - event for test-rs-lbcl5: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "783cbd03e134a62777c413abd235c80ee3afc8c3948614cbac16e424256c9e99": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:42:27 +0000 UTC - event for test-rs-mvsf6: {kubelet i-029f31a6b034de1c6} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e73ec15a77257c10343fd8fdaed1b888e27fa17d095e14fb9e91dea9100acf31": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:42:28 +0000 UTC - event for test-rs-lbcl5: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "252f816a3244b5022eefa0dbbbb8b9daf94c58feb41e1eb7df682e93e27653d6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:42:41 +0000 UTC - event for test-rs-mvsf6: {kubelet i-029f31a6b034de1c6} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f2a97af63b0112b4607474a165110aa07dc87a4c47e416c272523fbd30cbc678": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:42:43 +0000 UTC - event for test-rs-lbcl5: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8165a83914df2b4966f1b829ecb26163e3e8db057d132498f716951744d81f84": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:42:56 +0000 UTC - event for test-rs-mvsf6: {kubelet i-029f31a6b034de1c6} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a5059393576a82b9608c5eb1c820571b549fc2f7cbc430f61df31b94d4007320": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.466: INFO: At 2023-01-05 02:42:57 +0000 UTC - event for test-rs-lbcl5: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dd58058bdb07bb10f4a725739d5fe4d64216afbc2d7869320f1ab374950dcc2e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:45:57.579: INFO: POD            NODE                 PHASE    GRACE  CONDITIONS
Jan  5 02:45:57.579: INFO: test-rs-hpvh8  i-01bd5bfa9703f3bd3  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:56 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:59 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:59 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:56 +0000 UTC  }]
Jan  5 02:45:57.579: INFO: test-rs-lbcl5  i-03e466e3a84d9f004  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:56 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:56 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:56 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:56 +0000 UTC  }]
Jan  5 02:45:57.579: INFO: test-rs-mvsf6  i-029f31a6b034de1c6  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:56 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:56 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:56 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:40:56 +0000 UTC  }]
Jan  5 02:45:57.579: INFO: 
Jan  5 02:45:57.817: INFO: Unable to fetch replicaset-7262/test-rs-lbcl5/httpd logs: the server rejected our request for an unknown reason (get pods test-rs-lbcl5)
Jan  5 02:45:57.931: INFO: Unable to fetch replicaset-7262/test-rs-mvsf6/httpd logs: the server rejected our request for an unknown reason (get pods test-rs-mvsf6)
Jan  5 02:45:58.046: INFO: 
Logging node info for node i-01bd5bfa9703f3bd3
Jan  5 02:45:58.158: INFO: Node Info: &Node{ObjectMeta:{i-01bd5bfa9703f3bd3    69222d04-c2bf-45d2-98fb-9486844f5c9b 8364 0 2023-01-05 02:34:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01bd5bfa9703f3bd3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-01bd5bfa9703f3bd3 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.211 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-146":"i-01bd5bfa9703f3bd3","ebs.csi.aws.com":"i-01bd5bfa9703f3bd3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:45:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-05 02:45:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-01bd5bfa9703f3bd3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:45:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:21 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.211,},NodeAddress{Type:ExternalIP,Address:3.127.108.91,},NodeAddress{Type:InternalDNS,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-127-108-91.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c4f0d8dc84e5ae1e29667dae48eae,SystemUUID:ec2c4f0d-8dc8-4e5a-e1e2-9667dae48eae,BootID:b09c708e-7e9b-478b-a41e-54cca7d4cf91,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0cf11112deb2eeb36 kubernetes.io/csi/ebs.csi.aws.com^vol-0e6bc0e2cf2e0bf4c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e6bc0e2cf2e0bf4c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0cf11112deb2eeb36,DevicePath:,},},Config:nil,},}
Jan  5 02:45:58.159: INFO: 
Logging kubelet events for node i-01bd5bfa9703f3bd3
Jan  5 02:45:58.274: INFO: 
Logging pods the kubelet thinks is on node i-01bd5bfa9703f3bd3
Jan  5 02:45:58.508: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tc8w7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:58.508: INFO: cilium-fqg7v started at 2023-01-05 02:34:09 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:45:58.508: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:45:58.508: INFO: ebs-csi-node-gg6js started at 2023-01-05 02:34:09 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:45:58.508: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:45:58.508: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:45:58.508: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nz7dc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:58.508: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-v9t4w started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:45:58.508: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-h4jxc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:58.508: INFO: hostexec-i-01bd5bfa9703f3bd3-n5wdm started at 2023-01-05 02:41:37 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:45:58.508: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-bd4zs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:58.508: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-fj2vh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:58.508: INFO: csi-mockplugin-0 started at 2023-01-05 02:41:00 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:45:58.508: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  5 02:45:58.508: INFO: 	Container mock ready: true, restart count 0
Jan  5 02:45:58.508: INFO: csi-mockplugin-attacher-0 started at 2023-01-05 02:41:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:45:58.508: INFO: local-injector started at 2023-01-05 02:44:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container local-injector ready: false, restart count 0
Jan  5 02:45:58.508: INFO: inline-volume-tester-7ddfs started at 2023-01-05 02:44:45 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  5 02:45:58.508: INFO: pod-subpath-test-dynamicpv-rdf9 started at 2023-01-05 02:45:11 +0000 UTC (2+1 container statuses recorded)
Jan  5 02:45:58.508: INFO: 	Init container init-volume-dynamicpv-rdf9 ready: false, restart count 0
Jan  5 02:45:58.508: INFO: 	Init container test-init-subpath-dynamicpv-rdf9 ready: false, restart count 0
Jan  5 02:45:58.509: INFO: 	Container test-container-subpath-dynamicpv-rdf9 ready: false, restart count 0
Jan  5 02:45:58.509: INFO: ss2-0 started at 2023-01-05 02:38:18 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.509: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:45:58.509: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-xjdj7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.509: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:58.509: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x started at 2023-01-05 02:45:39 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.509: INFO: 	Container sample-crd-conversion-webhook ready: false, restart count 0
Jan  5 02:45:58.509: INFO: pod-subpath-test-preprovisionedpv-dprj started at 2023-01-05 02:41:49 +0000 UTC (2+2 container statuses recorded)
Jan  5 02:45:58.509: INFO: 	Init container init-volume-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:45:58.509: INFO: 	Init container test-init-subpath-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:45:58.509: INFO: 	Container test-container-subpath-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:45:58.509: INFO: 	Container test-container-volume-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:45:58.509: INFO: affinity-clusterip-transition-7hz95 started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.509: INFO: 	Container affinity-clusterip-transition ready: false, restart count 0
Jan  5 02:45:58.509: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wppds started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.509: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:58.509: INFO: test-rs-hpvh8 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.509: INFO: 	Container httpd ready: true, restart count 0
Jan  5 02:45:58.509: INFO: dns-test-3b53ba68-c445-4758-b5cc-0ab0531d8eea started at 2023-01-05 02:45:51 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:45:58.509: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  5 02:45:58.509: INFO: 	Container querier ready: false, restart count 0
Jan  5 02:45:58.509: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:45:58.509: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-n5tbp started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.509: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:58.509: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gb74d started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.509: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:58.509: INFO: hostexec-i-01bd5bfa9703f3bd3-6bn56 started at 2023-01-05 02:44:08 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:58.509: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:45:58.919: INFO: 
Latency metrics for node i-01bd5bfa9703f3bd3
Jan  5 02:45:58.919: INFO: 
Logging node info for node i-025e1f38135aff0cb
Jan  5 02:45:59.032: INFO: Node Info: &Node{ObjectMeta:{i-025e1f38135aff0cb    e077826c-bb74-41f6-aafe-d16d1e1a4e20 8332 0 2023-01-05 02:34:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-025e1f38135aff0cb kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-025e1f38135aff0cb topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.96 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-896":"csi-mock-csi-mock-volumes-896","ebs.csi.aws.com":"i-025e1f38135aff0cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:45:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-025e1f38135aff0cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.96,},NodeAddress{Type:ExternalIP,Address:18.195.60.12,},NodeAddress{Type:InternalDNS,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-195-60-12.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec223249b01164600b2958646dddca75,SystemUUID:ec223249-b011-6460-0b29-58646dddca75,BootID:7a5edf7e-21fb-482a-aeb0-e226be4da837,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:45:59.032: INFO: 
Logging kubelet events for node i-025e1f38135aff0cb
Jan  5 02:45:59.148: INFO: 
Logging pods the kubelet thinks is on node i-025e1f38135aff0cb
Jan  5 02:45:59.272: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tg6gz started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:59.272: INFO: csi-mockplugin-0 started at 2023-01-05 02:39:18 +0000 UTC (0+4 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container busybox ready: true, restart count 0
Jan  5 02:45:59.272: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:45:59.272: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  5 02:45:59.272: INFO: 	Container mock ready: true, restart count 0
Jan  5 02:45:59.272: INFO: test-pod started at 2023-01-05 02:45:15 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:45:59.272: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wq84l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:59.272: INFO: affinity-clusterip-transition-5275l started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container affinity-clusterip-transition ready: true, restart count 0
Jan  5 02:45:59.272: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-b68nw started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:59.272: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-g4spn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:59.272: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gg7zk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:59.272: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-p5wf4 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:45:59.272: INFO: ebs-csi-node-hqlnq started at 2023-01-05 02:34:06 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:45:59.272: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:45:59.272: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:45:59.272: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lnv9l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:59.272: INFO: hostexec-i-025e1f38135aff0cb-tcjfd started at 2023-01-05 02:44:45 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:45:59.272: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-zkfhs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:59.272: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-mrk29 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:59.272: INFO: cilium-rjzq7 started at 2023-01-05 02:34:06 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:45:59.272: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:45:59.272: INFO: coredns-559769c974-7vlfn started at 2023-01-05 02:34:41 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:45:59.272: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-z8xgj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:45:59.272: INFO: pod-subpath-test-preprovisionedpv-5wqf started at 2023-01-05 02:44:49 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:45:59.272: INFO: 	Init container init-volume-preprovisionedpv-5wqf ready: false, restart count 0
Jan  5 02:45:59.272: INFO: 	Container test-container-subpath-preprovisionedpv-5wqf ready: false, restart count 0
Jan  5 02:45:59.683: INFO: 
Latency metrics for node i-025e1f38135aff0cb
Jan  5 02:45:59.683: INFO: 
Logging node info for node i-029f31a6b034de1c6
Jan  5 02:45:59.795: INFO: Node Info: &Node{ObjectMeta:{i-029f31a6b034de1c6    6eaa3884-9088-400b-96bc-7fe0bc27f677 6319 0 2023-01-05 02:34:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-029f31a6b034de1c6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-029f31a6b034de1c6 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.206 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-029f31a6b034de1c6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:41:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-029f31a6b034de1c6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.206,},NodeAddress{Type:ExternalIP,Address:3.71.43.14,},NodeAddress{Type:InternalDNS,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-43-14.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be2b1604bcc2946df20723d761dd9,SystemUUID:ec2be2b1-604b-cc29-46df-20723d761dd9,BootID:998135dd-fb0c-441d-85ec-d92193042b65,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:45:59.796: INFO: 
Logging kubelet events for node i-029f31a6b034de1c6
Jan  5 02:45:59.911: INFO: 
Logging pods the kubelet thinks is on node i-029f31a6b034de1c6
Jan  5 02:46:00.033: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-khzwh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:00.033: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lzwd8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:00.033: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-sp7hv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:00.033: INFO: affinity-clusterip-transition-8v8lg started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container affinity-clusterip-transition ready: true, restart count 0
Jan  5 02:46:00.033: INFO: pod-subpath-test-preprovisionedpv-czk5 started at 2023-01-05 02:45:50 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Init container init-volume-preprovisionedpv-czk5 ready: false, restart count 0
Jan  5 02:46:00.033: INFO: 	Container test-container-subpath-preprovisionedpv-czk5 ready: false, restart count 0
Jan  5 02:46:00.033: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-k6j85 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:00.033: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ht7lv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:00.033: INFO: test-rs-mvsf6 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container httpd ready: false, restart count 0
Jan  5 02:46:00.033: INFO: ss2-1 started at 2023-01-05 02:38:28 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:46:00.033: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-54jfx started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:00.033: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-c45mb started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:00.033: INFO: ebs-csi-node-tb9gj started at 2023-01-05 02:34:17 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:46:00.033: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:46:00.033: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:46:00.033: INFO: cilium-v2frt started at 2023-01-05 02:34:17 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:46:00.033: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:46:00.033: INFO: pod2 started at 2023-01-05 02:45:29 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container container1 ready: false, restart count 0
Jan  5 02:46:00.033: INFO: hostexec-i-029f31a6b034de1c6-j7mfb started at 2023-01-05 02:45:44 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:46:00.033: INFO: pod-configmaps-4c7c5cae-5dc1-4cf3-b2ef-98693ffaf50d started at 2023-01-05 02:44:26 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  5 02:46:00.033: INFO: replace-27881445-8bmlf started at 2023-01-05 02:45:00 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container c ready: false, restart count 0
Jan  5 02:46:00.033: INFO: pod-24d14a31-2cf4-4c8d-bb75-9d7fd895bf4b started at 2023-01-05 02:45:26 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:46:00.033: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-vb4kg started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:00.033: INFO: pod1 started at 2023-01-05 02:45:29 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container container1 ready: false, restart count 0
Jan  5 02:46:00.033: INFO: pod-secrets-6ab0c9d1-ce7d-4547-9044-0162e6ad2809 started at 2023-01-05 02:44:31 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container secret-test ready: false, restart count 0
Jan  5 02:46:00.033: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ccgnj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:00.033: INFO: hostexec-i-029f31a6b034de1c6-p84w4 started at 2023-01-05 02:45:22 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:46:00.033: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nqgmc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.033: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:00.534: INFO: 
Latency metrics for node i-029f31a6b034de1c6
Jan  5 02:46:00.534: INFO: 
Logging node info for node i-03e2b3d27125ad085
Jan  5 02:46:00.647: INFO: Node Info: &Node{ObjectMeta:{i-03e2b3d27125ad085    9cffc38a-f9d7-40cb-848c-a16086a32ac9 7736 0 2023-01-05 02:32:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e2b3d27125ad085 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.123 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03e2b3d27125ad085"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-05 02:32:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-05 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:33:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:45:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e2b3d27125ad085,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:14 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:14 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:14 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:45:14 +0000 UTC,LastTransitionTime:2023-01-05 02:33:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.123,},NodeAddress{Type:ExternalIP,Address:3.124.193.93,},NodeAddress{Type:InternalDNS,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-124-193-93.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2e40ce762960a4f05822e85e89a6d7,SystemUUID:ec2e40ce-7629-60a4-f058-22e85e89a6d7,BootID:e3c9a56f-3559-40b1-99e3-6055bc36443e,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.1],SizeBytes:42982336,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.1],SizeBytes:42804914,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.1],SizeBytes:4967337,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:46:00.647: INFO: 
Logging kubelet events for node i-03e2b3d27125ad085
Jan  5 02:46:00.762: INFO: 
Logging pods the kubelet thinks is on node i-03e2b3d27125ad085
Jan  5 02:46:00.882: INFO: aws-cloud-controller-manager-qmldf started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  5 02:46:00.882: INFO: ebs-csi-node-f7tgk started at 2023-01-05 02:33:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:46:00.882: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:46:00.882: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:46:00.882: INFO: etcd-manager-events-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:46:00.882: INFO: kube-apiserver-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+2 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Container healthcheck ready: true, restart count 0
Jan  5 02:46:00.882: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  5 02:46:00.882: INFO: kube-scheduler-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  5 02:46:00.882: INFO: cilium-pbccf started at 2023-01-05 02:33:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:46:00.882: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:46:00.882: INFO: kops-controller-6mxst started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Container kops-controller ready: true, restart count 0
Jan  5 02:46:00.882: INFO: ebs-csi-controller-6b8d786cf8-2c9wj started at 2023-01-05 02:33:04 +0000 UTC (0+5 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  5 02:46:00.882: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:46:00.882: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  5 02:46:00.882: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:46:00.882: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:46:00.882: INFO: cilium-operator-6f8d6c4bf-kdqfd started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  5 02:46:00.882: INFO: dns-controller-56cf649474-cnnkp started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Container dns-controller ready: true, restart count 0
Jan  5 02:46:00.882: INFO: etcd-manager-main-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:46:00.882: INFO: kube-controller-manager-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:00.882: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  5 02:46:01.283: INFO: 
Latency metrics for node i-03e2b3d27125ad085
Jan  5 02:46:01.283: INFO: 
Logging node info for node i-03e466e3a84d9f004
Jan  5 02:46:01.395: INFO: Node Info: &Node{ObjectMeta:{i-03e466e3a84d9f004    eb024a0b-a711-42e7-8f3b-c92ac348ecd2 8155 0 2023-01-05 02:34:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e466e3a84d9f004 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-03e466e3a84d9f004 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.198 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-345":"i-03e466e3a84d9f004","ebs.csi.aws.com":"i-03e466e3a84d9f004"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:45:31 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-05 02:45:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e466e3a84d9f004,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:45:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.198,},NodeAddress{Type:ExternalIP,Address:3.71.182.65,},NodeAddress{Type:InternalDNS,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-182-65.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2183d91500f4a0d14c0ffcaa6a62ca,SystemUUID:ec2183d9-1500-f4a0-d14c-0ffcaa6a62ca,BootID:54ae1a2e-030d-4aec-bab9-224c76049655,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-345^047be1aa-8ca3-11ed-99f4-ca22fe77c460],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-345^047be1aa-8ca3-11ed-99f4-ca22fe77c460,DevicePath:,},},Config:nil,},}
Jan  5 02:46:01.396: INFO: 
Logging kubelet events for node i-03e466e3a84d9f004
Jan  5 02:46:01.511: INFO: 
Logging pods the kubelet thinks is on node i-03e466e3a84d9f004
Jan  5 02:46:01.636: INFO: coredns-559769c974-skw4s started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:46:01.636: INFO: pod-subpath-test-preprovisionedpv-5t7r started at 2023-01-05 02:45:18 +0000 UTC (2+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Init container init-volume-preprovisionedpv-5t7r ready: false, restart count 0
Jan  5 02:46:01.636: INFO: 	Init container test-init-volume-preprovisionedpv-5t7r ready: false, restart count 0
Jan  5 02:46:01.636: INFO: 	Container test-container-subpath-preprovisionedpv-5t7r ready: false, restart count 0
Jan  5 02:46:01.636: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gt2l8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:01.636: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-7zfwf started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:01.636: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-9qqj9 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:01.636: INFO: coredns-autoscaler-7cb5c5b969-bh8d6 started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container autoscaler ready: true, restart count 0
Jan  5 02:46:01.636: INFO: pod-subpath-test-preprovisionedpv-qljw started at 2023-01-05 02:41:19 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Init container init-volume-preprovisionedpv-qljw ready: false, restart count 0
Jan  5 02:46:01.636: INFO: 	Container test-container-subpath-preprovisionedpv-qljw ready: false, restart count 0
Jan  5 02:46:01.636: INFO: hostexec-i-03e466e3a84d9f004-wfhss started at 2023-01-05 02:41:03 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:46:01.636: INFO: hostexec-i-03e466e3a84d9f004-vv7jg started at 2023-01-05 02:45:06 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:46:01.636: INFO: pod-3f374fe2-1c8e-4317-b89b-d2c981586d9d started at 2023-01-05 02:45:30 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:46:01.636: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-6jwx6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:01.636: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-md2kk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:01.636: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-s9zvl started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:01.636: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-dlzfn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:01.636: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:44:32 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  5 02:46:01.636: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:46:01.636: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  5 02:46:01.636: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan  5 02:46:01.636: INFO: 	Container hostpath ready: true, restart count 0
Jan  5 02:46:01.636: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:46:01.636: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:46:01.636: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gbdkt started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:01.636: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-67br6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:46:01.636: INFO: cilium-8rhhk started at 2023-01-05 02:34:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:46:01.636: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:46:01.636: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-2j7x6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:46:01.636: INFO: test-rs-lbcl5 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container httpd ready: false, restart count 0
Jan  5 02:46:01.636: INFO: csi-mockplugin-0 started at 2023-01-05 02:45:44 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:46:01.636: INFO: 	Container driver-registrar ready: false, restart count 0
Jan  5 02:46:01.636: INFO: 	Container mock ready: false, restart count 0
Jan  5 02:46:01.636: INFO: ss2-2 started at 2023-01-05 02:38:51 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:46:01.636: INFO: ebs-csi-node-9smg4 started at 2023-01-05 02:34:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:46:01.636: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:46:01.636: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:46:01.636: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:46:02.065: INFO: 
Latency metrics for node i-03e466e3a84d9f004
[DeferCleanup (Each)] [sig-apps] ReplicaSet
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "replicaset-7262" for this suite. �[38;5;243m01/05/23 02:46:02.065�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-apps] ReplicationController should serve a basic image on each replica with a public image [Conformance] 5m5s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sReplicationController\sshould\sserve\sa\sbasic\simage\son\seach\sreplica\swith\sa\spublic\simage\s\s\[Conformance\]$'

test/e2e/apps/rc.go:499
k8s.io/kubernetes/test/e2e/apps.TestReplicationControllerServeImageOrFail(0xc00097e000, {0x75b8d9b, 0x5}, {0xc000428f60, 0x2c})
	test/e2e/apps/rc.go:499 +0xb85
k8s.io/kubernetes/test/e2e/apps.glob..func8.2()
	test/e2e/apps/rc.go:68 +0x37
				[BeforeEach] [sig-apps] ReplicationController
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/05/23 02:39:19.743�[0m
Jan  5 02:39:19.743: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename replication-controller �[38;5;243m01/05/23 02:39:19.744�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/05/23 02:39:20.083�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/05/23 02:39:20.302�[0m
[BeforeEach] [sig-apps] ReplicationController
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] ReplicationController
  test/e2e/apps/rc.go:57
[It] should serve a basic image on each replica with a public image  [Conformance]
  test/e2e/apps/rc.go:67
�[1mSTEP:�[0m Creating replication controller my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2 �[38;5;243m01/05/23 02:39:20.522�[0m
Jan  5 02:39:20.748: INFO: Pod name my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2: Found 1 pods out of 1
Jan  5 02:39:20.748: INFO: Ensuring all pods for ReplicationController "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2" are running
Jan  5 02:39:20.748: INFO: Waiting up to 5m0s for pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59" in namespace "replication-controller-5684" to be "running"
Jan  5 02:39:20.859: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 110.426318ms
Jan  5 02:39:22.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2.222119475s
Jan  5 02:39:24.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4.221167284s
Jan  5 02:39:26.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 6.222139003s
Jan  5 02:39:28.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 8.221940714s
Jan  5 02:39:30.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 10.22159618s
Jan  5 02:39:32.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 12.22175023s
Jan  5 02:39:34.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 14.22203929s
Jan  5 02:39:36.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 16.221202071s
Jan  5 02:39:38.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 18.221808362s
Jan  5 02:39:40.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 20.221363617s
Jan  5 02:39:42.979: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 22.230849075s
Jan  5 02:39:44.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 24.221432021s
Jan  5 02:39:46.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 26.221600275s
Jan  5 02:39:48.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 28.221553417s
Jan  5 02:39:50.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 30.221014436s
Jan  5 02:39:52.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 32.221551868s
Jan  5 02:39:54.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 34.221774602s
Jan  5 02:39:56.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 36.221395453s
Jan  5 02:39:58.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 38.221547598s
Jan  5 02:40:00.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 40.220966149s
Jan  5 02:40:02.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 42.221297883s
Jan  5 02:40:04.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 44.221231973s
Jan  5 02:40:06.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 46.221354587s
Jan  5 02:40:08.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 48.221311071s
Jan  5 02:40:10.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 50.222193234s
Jan  5 02:40:12.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 52.22233708s
Jan  5 02:40:14.973: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 54.224131192s
Jan  5 02:40:16.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 56.221434341s
Jan  5 02:40:18.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 58.221362551s
Jan  5 02:40:20.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.221224935s
Jan  5 02:40:22.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.222258342s
Jan  5 02:40:24.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.22268569s
Jan  5 02:40:26.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.221421878s
Jan  5 02:40:28.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.221225653s
Jan  5 02:40:30.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.220940769s
Jan  5 02:40:32.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.221564526s
Jan  5 02:40:34.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.221592609s
Jan  5 02:40:36.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.22152642s
Jan  5 02:40:38.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.221799489s
Jan  5 02:40:40.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.222120849s
Jan  5 02:40:42.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.221683009s
Jan  5 02:40:44.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.221870382s
Jan  5 02:40:46.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.221703125s
Jan  5 02:40:48.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.221551811s
Jan  5 02:40:50.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.220974384s
Jan  5 02:40:52.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.220992348s
Jan  5 02:40:54.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.221976042s
Jan  5 02:40:56.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.220901769s
Jan  5 02:40:58.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.221577677s
Jan  5 02:41:00.972: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.223456602s
Jan  5 02:41:02.972: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.223101774s
Jan  5 02:41:04.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.221245486s
Jan  5 02:41:06.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.221534337s
Jan  5 02:41:08.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.221196522s
Jan  5 02:41:10.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.220805874s
Jan  5 02:41:12.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.220575541s
Jan  5 02:41:14.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.221483339s
Jan  5 02:41:16.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.221417382s
Jan  5 02:41:18.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.221346519s
Jan  5 02:41:20.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.220990533s
Jan  5 02:41:22.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.221776607s
Jan  5 02:41:24.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.221521747s
Jan  5 02:41:26.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.221310334s
Jan  5 02:41:28.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.220974291s
Jan  5 02:41:30.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.221057876s
Jan  5 02:41:32.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.221552988s
Jan  5 02:41:34.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.221428461s
Jan  5 02:41:36.972: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.223674125s
Jan  5 02:41:38.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.221535448s
Jan  5 02:41:40.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.221186243s
Jan  5 02:41:42.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.221548649s
Jan  5 02:41:44.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.221325339s
Jan  5 02:41:46.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.221545532s
Jan  5 02:41:48.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.221500544s
Jan  5 02:41:50.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.220537118s
Jan  5 02:41:52.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.220983019s
Jan  5 02:41:54.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.221398441s
Jan  5 02:41:56.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.221339838s
Jan  5 02:41:58.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.221474815s
Jan  5 02:42:00.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.220825597s
Jan  5 02:42:02.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.221415059s
Jan  5 02:42:04.973: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.224466717s
Jan  5 02:42:06.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.221731846s
Jan  5 02:42:08.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.222174132s
Jan  5 02:42:10.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.221046984s
Jan  5 02:42:12.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.22218909s
Jan  5 02:42:14.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.221477479s
Jan  5 02:42:16.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.221509806s
Jan  5 02:42:18.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.222089533s
Jan  5 02:42:20.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.221766904s
Jan  5 02:42:22.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.221579922s
Jan  5 02:42:24.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.221521931s
Jan  5 02:42:26.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.221441191s
Jan  5 02:42:28.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.221102018s
Jan  5 02:42:30.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.220933163s
Jan  5 02:42:32.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.22160467s
Jan  5 02:42:34.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.221508915s
Jan  5 02:42:36.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.221793854s
Jan  5 02:42:38.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.221569575s
Jan  5 02:42:40.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.220680425s
Jan  5 02:42:42.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.222247638s
Jan  5 02:42:44.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.221642148s
Jan  5 02:42:46.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.220956013s
Jan  5 02:42:48.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.220593057s
Jan  5 02:42:50.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.220984605s
Jan  5 02:42:52.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.22104738s
Jan  5 02:42:54.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.220796154s
Jan  5 02:42:56.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.2212519s
Jan  5 02:42:58.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.221470656s
Jan  5 02:43:00.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.220880864s
Jan  5 02:43:02.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.221805276s
Jan  5 02:43:04.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.221454665s
Jan  5 02:43:06.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.221557758s
Jan  5 02:43:08.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.22119496s
Jan  5 02:43:10.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.22167103s
Jan  5 02:43:12.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.22141351s
Jan  5 02:43:14.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.221589101s
Jan  5 02:43:16.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.221998179s
Jan  5 02:43:18.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.220897508s
Jan  5 02:43:20.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.221095165s
Jan  5 02:43:22.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.221656484s
Jan  5 02:43:24.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.221361068s
Jan  5 02:43:26.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.220812339s
Jan  5 02:43:28.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.221270047s
Jan  5 02:43:30.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.220797471s
Jan  5 02:43:32.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.221622423s
Jan  5 02:43:34.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.221746599s
Jan  5 02:43:36.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.221660877s
Jan  5 02:43:38.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.221467271s
Jan  5 02:43:40.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.221314096s
Jan  5 02:43:42.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.221277354s
Jan  5 02:43:44.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.222810164s
Jan  5 02:43:46.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.221021892s
Jan  5 02:43:48.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.221298278s
Jan  5 02:43:50.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.221174905s
Jan  5 02:43:52.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.22058829s
Jan  5 02:43:54.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.221902899s
Jan  5 02:43:56.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.221572257s
Jan  5 02:43:58.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.221494858s
Jan  5 02:44:00.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.220809636s
Jan  5 02:44:02.971: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.22199729s
Jan  5 02:44:04.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.221172851s
Jan  5 02:44:06.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.221085175s
Jan  5 02:44:08.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.221695716s
Jan  5 02:44:10.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.221555923s
Jan  5 02:44:12.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.221724897s
Jan  5 02:44:14.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.22149978s
Jan  5 02:44:16.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.221436413s
Jan  5 02:44:18.970: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.221136116s
Jan  5 02:44:20.969: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.220683786s
Jan  5 02:44:21.079: INFO: Pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.330638203s
Jan  5 02:44:21.189: INFO: Unexpected error: 
    <*errors.errorString | 0xc0015973f0>: {
        s: "pod \"my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59\" never run (phase: Pending, conditions: [{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-05 02:39:20 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-05 02:39:20 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-05 02:39:20 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-05 02:39:20 +0000 UTC Reason: Message:}]): timed out while waiting for pod replication-controller-5684/my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59 to be running",
    }
Jan  5 02:44:21.190: FAIL: pod "my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59" never run (phase: Pending, conditions: [{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-05 02:39:20 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-05 02:39:20 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-05 02:39:20 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-05 02:39:20 +0000 UTC Reason: Message:}]): timed out while waiting for pod replication-controller-5684/my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59 to be running

Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.TestReplicationControllerServeImageOrFail(0xc00097e000, {0x75b8d9b, 0x5}, {0xc000428f60, 0x2c})
	test/e2e/apps/rc.go:499 +0xb85
k8s.io/kubernetes/test/e2e/apps.glob..func8.2()
	test/e2e/apps/rc.go:68 +0x37
[AfterEach] [sig-apps] ReplicationController
  test/e2e/framework/node/init/init.go:32
Jan  5 02:44:21.190: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] ReplicationController
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] ReplicationController
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/05/23 02:44:21.301�[0m
�[1mSTEP:�[0m Collecting events from namespace "replication-controller-5684". �[38;5;243m01/05/23 02:44:21.301�[0m
�[1mSTEP:�[0m Found 12 events. �[38;5;243m01/05/23 02:44:21.412�[0m
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:39:20 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2: {replication-controller } SuccessfulCreate: Created pod: my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:39:20 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59: {default-scheduler } Scheduled: Successfully assigned replication-controller-5684/my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59 to i-01bd5bfa9703f3bd3
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:39:21 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "86c2cb510925d183e047d346710248fdc75f0abc5796ddb9e7922e6b0ce16e3c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:39:32 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dfca8bf9cb0f2c6079dab4a76bceeb6f13bb2348f9293dec0f5714f5a83693f6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:39:47 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "97d16ea0d636be9cbf566a346b7b65d0db137454b19dd46b1e9bdd400dc2fe26": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:40:01 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9fbb37117a268d4e8492ae80dcf43b03f075dd7e7599865093c79c3be7f5c000": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:40:16 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b6da48b77d97b5b3d1507841a6e05ff1b6657a9267fbe5208d42a0d1ce46ad3f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:40:29 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "900253fdf0e6ca4e2ffe03cdf7d4df1c76a910d49a740365c01d09b2e3f54b08": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:40:44 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "48deaa5c26b2d8db67dac1fff11419cba13beea5c84a5038e85c7c8585230e76": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:40:55 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "55f1e767cfb70ef418ffd0cf41f8856d12f6d1152eae75d4542559db0611f923": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:41:06 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cbece497197065b6efb675375159b8911ad9063b7b295f81f1525db2bf6e266f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:21.412: INFO: At 2023-01-05 02:41:17 +0000 UTC - event for my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59: {kubelet i-01bd5bfa9703f3bd3} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "340d8df85da0d92b6597b142051605485b42c3079455d23e1b6ebe21ac9b399d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:44:21.522: INFO: POD                                                           NODE                 PHASE    GRACE  CONDITIONS
Jan  5 02:44:21.522: INFO: my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59  i-01bd5bfa9703f3bd3  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:39:20 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:39:20 +0000 UTC ContainersNotReady containers with unready status: [my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:39:20 +0000 UTC ContainersNotReady containers with unready status: [my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-05 02:39:20 +0000 UTC  }]
Jan  5 02:44:21.523: INFO: 
Jan  5 02:44:21.634: INFO: Unable to fetch replication-controller-5684/my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59/my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2 logs: the server rejected our request for an unknown reason (get pods my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59)
Jan  5 02:44:21.746: INFO: 
Logging node info for node i-01bd5bfa9703f3bd3
Jan  5 02:44:21.856: INFO: Node Info: &Node{ObjectMeta:{i-01bd5bfa9703f3bd3    69222d04-c2bf-45d2-98fb-9486844f5c9b 7116 0 2023-01-05 02:34:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01bd5bfa9703f3bd3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-01bd5bfa9703f3bd3 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.211 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01bd5bfa9703f3bd3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:44:12 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-05 02:44:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-01bd5bfa9703f3bd3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:44:12 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:44:12 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:44:12 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:44:12 +0000 UTC,LastTransitionTime:2023-01-05 02:34:21 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.211,},NodeAddress{Type:ExternalIP,Address:3.127.108.91,},NodeAddress{Type:InternalDNS,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-127-108-91.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c4f0d8dc84e5ae1e29667dae48eae,SystemUUID:ec2c4f0d-8dc8-4e5a-e1e2-9667dae48eae,BootID:b09c708e-7e9b-478b-a41e-54cca7d4cf91,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0b68e97c1fa57a2da kubernetes.io/csi/ebs.csi.aws.com^vol-0fd62b8d38b0aae69],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0fd62b8d38b0aae69,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0b68e97c1fa57a2da,DevicePath:,},},Config:nil,},}
Jan  5 02:44:21.856: INFO: 
Logging kubelet events for node i-01bd5bfa9703f3bd3
Jan  5 02:44:21.968: INFO: 
Logging pods the kubelet thinks is on node i-01bd5bfa9703f3bd3
Jan  5 02:44:22.197: INFO: my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2-zmr59 started at 2023-01-05 02:39:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container my-hostname-basic-eb5b41ab-8ab8-493f-b654-28d49a01e3f2 ready: false, restart count 0
Jan  5 02:44:22.197: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tc8w7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.197: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nz7dc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.197: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-v9t4w started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:44:22.197: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-h4jxc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.197: INFO: test-container-pod started at 2023-01-05 02:40:00 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:44:22.197: INFO: inline-volume-tester-h74xj started at 2023-01-05 02:40:03 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  5 02:44:22.197: INFO: cilium-fqg7v started at 2023-01-05 02:34:09 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:22.197: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:22.197: INFO: ebs-csi-node-gg6js started at 2023-01-05 02:34:09 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:22.197: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:22.197: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:22.197: INFO: csi-mockplugin-0 started at 2023-01-05 02:41:00 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:44:22.197: INFO: 	Container driver-registrar ready: false, restart count 0
Jan  5 02:44:22.197: INFO: 	Container mock ready: false, restart count 0
Jan  5 02:44:22.197: INFO: csi-mockplugin-attacher-0 started at 2023-01-05 02:41:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:44:22.197: INFO: hostexec-i-01bd5bfa9703f3bd3-n5wdm started at 2023-01-05 02:41:37 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:22.197: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-bd4zs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.197: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-fj2vh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.197: INFO: termination-message-container58ca479c-b658-481b-b5b5-e074f05cff2c started at 2023-01-05 02:40:22 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container termination-message-container ready: false, restart count 0
Jan  5 02:44:22.197: INFO: local-injector started at 2023-01-05 02:44:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container local-injector ready: false, restart count 0
Jan  5 02:44:22.197: INFO: netserver-0 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:22.197: INFO: pod-9c32868a-252f-484c-bb70-cade4aec0129 started at 2023-01-05 02:39:35 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:44:22.197: INFO: pod-subpath-test-preprovisionedpv-dprj started at 2023-01-05 02:41:49 +0000 UTC (2+2 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Init container init-volume-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:22.197: INFO: 	Init container test-init-subpath-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:22.197: INFO: 	Container test-container-subpath-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:22.197: INFO: 	Container test-container-volume-preprovisionedpv-dprj ready: false, restart count 0
Jan  5 02:44:22.197: INFO: ss2-0 started at 2023-01-05 02:38:18 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:22.197: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-xjdj7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.197: INFO: host-test-container-pod started at 2023-01-05 02:40:00 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:22.197: INFO: test-rs-hpvh8 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container httpd ready: true, restart count 0
Jan  5 02:44:22.197: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wppds started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.197: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-n5tbp started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.197: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gb74d started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.197: INFO: pod-projected-configmaps-691cf090-de91-467f-95f8-8d0dcb9aeee7 started at 2023-01-05 02:40:06 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container projected-configmap-volume-test ready: false, restart count 0
Jan  5 02:44:22.197: INFO: pod-subpath-test-inlinevolume-h59m started at 2023-01-05 02:39:49 +0000 UTC (2+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Init container init-volume-inlinevolume-h59m ready: false, restart count 0
Jan  5 02:44:22.197: INFO: 	Init container test-init-volume-inlinevolume-h59m ready: false, restart count 0
Jan  5 02:44:22.197: INFO: 	Container test-container-subpath-inlinevolume-h59m ready: false, restart count 0
Jan  5 02:44:22.197: INFO: hostexec-i-01bd5bfa9703f3bd3-6bn56 started at 2023-01-05 02:44:08 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:22.197: INFO: hostexec-i-01bd5bfa9703f3bd3-lm4fl started at 2023-01-05 02:39:13 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.197: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:22.588: INFO: 
Latency metrics for node i-01bd5bfa9703f3bd3
Jan  5 02:44:22.588: INFO: 
Logging node info for node i-025e1f38135aff0cb
Jan  5 02:44:22.699: INFO: Node Info: &Node{ObjectMeta:{i-025e1f38135aff0cb    e077826c-bb74-41f6-aafe-d16d1e1a4e20 6075 0 2023-01-05 02:34:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-025e1f38135aff0cb kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-025e1f38135aff0cb topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.96 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-896":"csi-mock-csi-mock-volumes-896","ebs.csi.aws.com":"i-025e1f38135aff0cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:40:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-025e1f38135aff0cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:40:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.96,},NodeAddress{Type:ExternalIP,Address:18.195.60.12,},NodeAddress{Type:InternalDNS,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-195-60-12.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec223249b01164600b2958646dddca75,SystemUUID:ec223249-b011-6460-0b29-58646dddca75,BootID:7a5edf7e-21fb-482a-aeb0-e226be4da837,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:22.699: INFO: 
Logging kubelet events for node i-025e1f38135aff0cb
Jan  5 02:44:22.812: INFO: 
Logging pods the kubelet thinks is on node i-025e1f38135aff0cb
Jan  5 02:44:22.929: INFO: pvc-volume-tester-jxcfl started at 2023-01-05 02:40:26 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.929: INFO: 	Container volume-tester ready: false, restart count 0
Jan  5 02:44:22.929: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-g4spn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.929: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.929: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gg7zk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.929: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.929: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-p5wf4 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.929: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:44:22.929: INFO: ebs-csi-node-hqlnq started at 2023-01-05 02:34:06 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:22.929: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:22.929: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:22.929: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:22.929: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-zkfhs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.929: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.929: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-mrk29 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.930: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lnv9l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.930: INFO: coredns-559769c974-7vlfn started at 2023-01-05 02:34:41 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:44:22.930: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-z8xgj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.930: INFO: pod-e30c2e03-515c-4253-8cda-dc355d03e809 started at 2023-01-05 02:39:35 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:44:22.930: INFO: cilium-rjzq7 started at 2023-01-05 02:34:06 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:22.930: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:22.930: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wq84l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.930: INFO: hostexec-i-025e1f38135aff0cb-vvrb4 started at 2023-01-05 02:39:17 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:22.930: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-b68nw started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.930: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tg6gz started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:22.930: INFO: csi-mockplugin-0 started at 2023-01-05 02:39:18 +0000 UTC (0+4 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Container busybox ready: true, restart count 0
Jan  5 02:44:22.930: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:44:22.930: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  5 02:44:22.930: INFO: 	Container mock ready: true, restart count 0
Jan  5 02:44:22.930: INFO: netserver-1 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:22.930: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:23.349: INFO: 
Latency metrics for node i-025e1f38135aff0cb
Jan  5 02:44:23.349: INFO: 
Logging node info for node i-029f31a6b034de1c6
Jan  5 02:44:23.461: INFO: Node Info: &Node{ObjectMeta:{i-029f31a6b034de1c6    6eaa3884-9088-400b-96bc-7fe0bc27f677 6319 0 2023-01-05 02:34:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-029f31a6b034de1c6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-029f31a6b034de1c6 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.206 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-029f31a6b034de1c6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:41:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-029f31a6b034de1c6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:40:54 +0000 UTC,LastTransitionTime:2023-01-05 02:34:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.206,},NodeAddress{Type:ExternalIP,Address:3.71.43.14,},NodeAddress{Type:InternalDNS,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-43-14.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be2b1604bcc2946df20723d761dd9,SystemUUID:ec2be2b1-604b-cc29-46df-20723d761dd9,BootID:998135dd-fb0c-441d-85ec-d92193042b65,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:23.461: INFO: 
Logging kubelet events for node i-029f31a6b034de1c6
Jan  5 02:44:23.574: INFO: 
Logging pods the kubelet thinks is on node i-029f31a6b034de1c6
Jan  5 02:44:23.692: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-k6j85 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:23.692: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ht7lv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:23.692: INFO: hostexec-i-029f31a6b034de1c6-jhvjk started at 2023-01-05 02:40:40 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:23.692: INFO: test-rs-mvsf6 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container httpd ready: false, restart count 0
Jan  5 02:44:23.692: INFO: ss2-1 started at 2023-01-05 02:38:28 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:23.692: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-54jfx started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:23.692: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-c45mb started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:23.692: INFO: ebs-csi-node-tb9gj started at 2023-01-05 02:34:17 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:23.692: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:23.692: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:23.692: INFO: cilium-v2frt started at 2023-01-05 02:34:17 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:23.692: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:23.692: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:40:04 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:44:23.692: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:44:23.692: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:44:23.692: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:44:23.692: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:44:23.692: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:44:23.692: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:44:23.692: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-vb4kg started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:23.692: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ccgnj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:23.692: INFO: netserver-2 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:23.692: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nqgmc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:23.692: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-khzwh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:23.692: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lzwd8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:23.692: INFO: busybox-readonly-true-b614b5dd-87ef-4d07-94e4-d3c79ca10590 started at 2023-01-05 02:41:11 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container busybox-readonly-true-b614b5dd-87ef-4d07-94e4-d3c79ca10590 ready: false, restart count 0
Jan  5 02:44:23.692: INFO: pod-af540b87-53cd-4665-bf39-2f3a5eed9100 started at 2023-01-05 02:40:44 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:44:23.692: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-sp7hv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:23.692: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:24.088: INFO: 
Latency metrics for node i-029f31a6b034de1c6
Jan  5 02:44:24.088: INFO: 
Logging node info for node i-03e2b3d27125ad085
Jan  5 02:44:24.199: INFO: Node Info: &Node{ObjectMeta:{i-03e2b3d27125ad085    9cffc38a-f9d7-40cb-848c-a16086a32ac9 5785 0 2023-01-05 02:32:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e2b3d27125ad085 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.123 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03e2b3d27125ad085"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-05 02:32:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-05 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:33:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:40:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e2b3d27125ad085,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:40:08 +0000 UTC,LastTransitionTime:2023-01-05 02:33:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.123,},NodeAddress{Type:ExternalIP,Address:3.124.193.93,},NodeAddress{Type:InternalDNS,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-124-193-93.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2e40ce762960a4f05822e85e89a6d7,SystemUUID:ec2e40ce-7629-60a4-f058-22e85e89a6d7,BootID:e3c9a56f-3559-40b1-99e3-6055bc36443e,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.1],SizeBytes:42982336,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.1],SizeBytes:42804914,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.1],SizeBytes:4967337,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:24.199: INFO: 
Logging kubelet events for node i-03e2b3d27125ad085
Jan  5 02:44:24.312: INFO: 
Logging pods the kubelet thinks is on node i-03e2b3d27125ad085
Jan  5 02:44:24.434: INFO: kops-controller-6mxst started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Container kops-controller ready: true, restart count 0
Jan  5 02:44:24.434: INFO: ebs-csi-controller-6b8d786cf8-2c9wj started at 2023-01-05 02:33:04 +0000 UTC (0+5 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  5 02:44:24.434: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:44:24.434: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  5 02:44:24.434: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:24.434: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:24.434: INFO: cilium-operator-6f8d6c4bf-kdqfd started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  5 02:44:24.434: INFO: dns-controller-56cf649474-cnnkp started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Container dns-controller ready: true, restart count 0
Jan  5 02:44:24.434: INFO: etcd-manager-main-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:44:24.434: INFO: kube-controller-manager-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  5 02:44:24.434: INFO: kube-scheduler-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  5 02:44:24.434: INFO: cilium-pbccf started at 2023-01-05 02:33:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:24.434: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:24.434: INFO: etcd-manager-events-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:44:24.434: INFO: kube-apiserver-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+2 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Container healthcheck ready: true, restart count 0
Jan  5 02:44:24.434: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  5 02:44:24.434: INFO: aws-cloud-controller-manager-qmldf started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  5 02:44:24.434: INFO: ebs-csi-node-f7tgk started at 2023-01-05 02:33:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:24.434: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:24.434: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:24.434: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:24.810: INFO: 
Latency metrics for node i-03e2b3d27125ad085
Jan  5 02:44:24.810: INFO: 
Logging node info for node i-03e466e3a84d9f004
Jan  5 02:44:24.921: INFO: Node Info: &Node{ObjectMeta:{i-03e466e3a84d9f004    eb024a0b-a711-42e7-8f3b-c92ac348ecd2 6961 0 2023-01-05 02:34:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e466e3a84d9f004 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-03e466e3a84d9f004 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.198 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03e466e3a84d9f004"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:43:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e466e3a84d9f004,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:43:44 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.198,},NodeAddress{Type:ExternalIP,Address:3.71.182.65,},NodeAddress{Type:InternalDNS,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-182-65.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2183d91500f4a0d14c0ffcaa6a62ca,SystemUUID:ec2183d9-1500-f4a0-d14c-0ffcaa6a62ca,BootID:54ae1a2e-030d-4aec-bab9-224c76049655,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:44:24.921: INFO: 
Logging kubelet events for node i-03e466e3a84d9f004
Jan  5 02:44:25.035: INFO: 
Logging pods the kubelet thinks is on node i-03e466e3a84d9f004
Jan  5 02:44:25.154: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gt2l8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:25.154: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-7zfwf started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:25.154: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-9qqj9 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:25.154: INFO: csi-mockplugin-attacher-0 started at 2023-01-05 02:39:28 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:44:25.154: INFO: coredns-autoscaler-7cb5c5b969-bh8d6 started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container autoscaler ready: true, restart count 0
Jan  5 02:44:25.154: INFO: coredns-559769c974-skw4s started at 2023-01-05 02:34:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:44:25.154: INFO: csi-mockplugin-0 started at 2023-01-05 02:39:28 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:44:25.154: INFO: 	Container driver-registrar ready: false, restart count 0
Jan  5 02:44:25.154: INFO: 	Container mock ready: false, restart count 0
Jan  5 02:44:25.154: INFO: pod-subpath-test-preprovisionedpv-h5s6 started at 2023-01-05 02:40:34 +0000 UTC (0+2 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container test-container-subpath-preprovisionedpv-h5s6 ready: false, restart count 0
Jan  5 02:44:25.154: INFO: 	Container test-container-volume-preprovisionedpv-h5s6 ready: false, restart count 0
Jan  5 02:44:25.154: INFO: pod-subpath-test-preprovisionedpv-qljw started at 2023-01-05 02:41:19 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Init container init-volume-preprovisionedpv-qljw ready: false, restart count 0
Jan  5 02:44:25.154: INFO: 	Container test-container-subpath-preprovisionedpv-qljw ready: false, restart count 0
Jan  5 02:44:25.154: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-6jwx6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:25.154: INFO: hostexec-i-03e466e3a84d9f004-wfhss started at 2023-01-05 02:41:03 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:25.154: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-dlzfn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:25.154: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gbdkt started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:25.154: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-67br6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:25.154: INFO: cilium-8rhhk started at 2023-01-05 02:34:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:44:25.154: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:44:25.154: INFO: hostexec-i-03e466e3a84d9f004-xgsbh started at 2023-01-05 02:40:16 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:44:25.154: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-md2kk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:25.154: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-s9zvl started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:44:25.154: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-2j7x6 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: false, restart count 0
Jan  5 02:44:25.154: INFO: netserver-3 started at 2023-01-05 02:38:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container webserver ready: true, restart count 0
Jan  5 02:44:25.154: INFO: ebs-csi-node-9smg4 started at 2023-01-05 02:34:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:44:25.154: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:44:25.154: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:44:25.154: INFO: test-rs-lbcl5 started at 2023-01-05 02:40:56 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container httpd ready: false, restart count 0
Jan  5 02:44:25.154: INFO: ss2-2 started at 2023-01-05 02:38:51 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:44:25.154: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:44:25.534: INFO: 
Latency metrics for node i-03e466e3a84d9f004
[DeferCleanup (Each)] [sig-apps] ReplicationController
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "replication-controller-5684" for this suite. �[38;5;243m01/05/23 02:44:25.535�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-apps] StatefulSet Basic StatefulSet functionality [StatefulSetBasic] should implement legacy replacement when the update strategy is OnDelete 11m11s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sStatefulSet\sBasic\sStatefulSet\sfunctionality\s\[StatefulSetBasic\]\sshould\simplement\slegacy\sreplacement\swhen\sthe\supdate\sstrategy\sis\sOnDelete$'

test/e2e/framework/statefulset/wait.go:58
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunning({0x801e128?, 0xc0043ad380}, 0x3, 0x3, 0xc001000a00)
	test/e2e/framework/statefulset/wait.go:58 +0xf9
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunningAndReady(...)
	test/e2e/framework/statefulset/wait.go:80
k8s.io/kubernetes/test/e2e/apps.glob..func10.2.9()
	test/e2e/apps/statefulset.go:536 +0x7b4
				[BeforeEach] [sig-apps] StatefulSet
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/05/23 02:37:26.472�[0m
Jan  5 02:37:26.472: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename statefulset �[38;5;243m01/05/23 02:37:26.474�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/05/23 02:37:26.838�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/05/23 02:37:27.063�[0m
[BeforeEach] [sig-apps] StatefulSet
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] StatefulSet
  test/e2e/apps/statefulset.go:98
[BeforeEach] Basic StatefulSet functionality [StatefulSetBasic]
  test/e2e/apps/statefulset.go:113
�[1mSTEP:�[0m Creating service test in namespace statefulset-3082 �[38;5;243m01/05/23 02:37:27.288�[0m
[It] should implement legacy replacement when the update strategy is OnDelete
  test/e2e/apps/statefulset.go:509
�[1mSTEP:�[0m Creating a new StatefulSet �[38;5;243m01/05/23 02:37:27.414�[0m
Jan  5 02:37:27.654: INFO: Found 1 stateful pods, waiting for 3
Jan  5 02:37:37.767: INFO: Found 1 stateful pods, waiting for 3
Jan  5 02:37:47.768: INFO: Found 2 stateful pods, waiting for 3
Jan  5 02:37:57.769: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:37:57.769: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:37:57.769: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:38:07.769: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:38:07.769: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:38:07.769: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:38:17.768: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:38:17.768: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:38:17.768: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Running - Ready=true
�[1mSTEP:�[0m Restoring Pods to the current revision �[38;5;243m01/05/23 02:38:18.107�[0m
Jan  5 02:38:18.611: INFO: Found 1 stateful pods, waiting for 3
Jan  5 02:38:28.724: INFO: Found 1 stateful pods, waiting for 3
Jan  5 02:38:38.728: INFO: Found 2 stateful pods, waiting for 3
Jan  5 02:38:48.725: INFO: Found 2 stateful pods, waiting for 3
Jan  5 02:38:58.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:38:58.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:38:58.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:39:08.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:08.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:08.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:39:18.726: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:18.726: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:18.726: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:39:28.726: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:28.726: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:28.726: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:39:38.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:38.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:38.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:39:48.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:48.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:48.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:39:58.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:58.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:39:58.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:40:08.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:08.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:08.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:40:18.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:18.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:18.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:40:28.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:28.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:28.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:40:38.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:38.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:38.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:40:48.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:48.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:48.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:40:58.726: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:58.726: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:40:58.726: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:41:08.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:08.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:08.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:41:18.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:18.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:18.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:41:28.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:28.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:28.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:41:38.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:38.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:38.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:41:48.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:48.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:48.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:41:58.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:58.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:41:58.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:42:08.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:08.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:08.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:42:18.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:18.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:18.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:42:28.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:28.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:28.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:42:38.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:38.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:38.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:42:48.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:48.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:48.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:42:58.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:58.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:42:58.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:43:08.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:08.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:08.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:43:18.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:18.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:18.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:43:28.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:28.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:28.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:43:38.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:38.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:38.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:43:48.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:48.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:48.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:43:58.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:58.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:43:58.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:44:08.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:08.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:08.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:44:18.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:18.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:18.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:44:28.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:28.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:28.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:44:38.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:38.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:38.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:44:48.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:48.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:48.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:44:58.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:58.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:44:58.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:45:08.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:08.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:08.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:45:18.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:18.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:18.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:45:28.726: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:28.726: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:28.726: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:45:38.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:38.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:38.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:45:48.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:48.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:48.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:45:58.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:58.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:45:58.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:46:08.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:08.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:08.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:46:18.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:18.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:18.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:46:28.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:28.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:28.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:46:38.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:38.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:38.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:46:48.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:48.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:48.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:46:58.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:58.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:46:58.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:47:08.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:08.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:08.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:47:18.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:18.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:18.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:47:28.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:28.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:28.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:47:38.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:38.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:38.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:47:48.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:48.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:48.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:47:58.724: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:58.724: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:47:58.724: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:48:08.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:48:08.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:48:08.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:48:18.725: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:48:18.725: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:48:18.725: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:48:18.838: INFO: Waiting for pod ss2-0 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:48:18.838: INFO: Waiting for pod ss2-1 to enter Running - Ready=true, currently Running - Ready=true
Jan  5 02:48:18.838: INFO: Waiting for pod ss2-2 to enter Running - Ready=true, currently Pending - Ready=false
Jan  5 02:48:18.838: FAIL: Failed waiting for pods to enter running: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunning({0x801e128?, 0xc0043ad380}, 0x3, 0x3, 0xc001000a00)
	test/e2e/framework/statefulset/wait.go:58 +0xf9
k8s.io/kubernetes/test/e2e/framework/statefulset.WaitForRunningAndReady(...)
	test/e2e/framework/statefulset/wait.go:80
k8s.io/kubernetes/test/e2e/apps.glob..func10.2.9()
	test/e2e/apps/statefulset.go:536 +0x7b4
[AfterEach] Basic StatefulSet functionality [StatefulSetBasic]
  test/e2e/apps/statefulset.go:124
Jan  5 02:48:18.950: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9d8036e7-8ca0-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-3082 describe po ss2-0'
Jan  5 02:48:19.624: INFO: stderr: ""
Jan  5 02:48:19.625: INFO: stdout: "Name:             ss2-0\nNamespace:        statefulset-3082\nPriority:         0\nService Account:  default\nNode:             i-01bd5bfa9703f3bd3/172.20.48.211\nStart Time:       Thu, 05 Jan 2023 02:38:18 +0000\nLabels:           baz=blah\n                  controller-revision-hash=ss2-7b6c9599d5\n                  foo=bar\n                  statefulset.kubernetes.io/pod-name=ss2-0\nAnnotations:      <none>\nStatus:           Running\nIP:               172.20.43.169\nIPs:\n  IP:           172.20.43.169\nControlled By:  StatefulSet/ss2\nContainers:\n  webserver:\n    Container ID:   containerd://64b4410a079f4c258bd4eb6b51e33b06366ebf959639a0448f4a08556f7ff015\n    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4\n    Image ID:       registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22\n    Port:           <none>\n    Host Port:      <none>\n    State:          Running\n      Started:      Thu, 05 Jan 2023 02:38:25 +0000\n    Ready:          True\n    Restart Count:  0\n    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n    Environment:    <none>\n    Mounts:\n      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-s279f (ro)\nConditions:\n  Type              Status\n  Initialized       True \n  Ready             True \n  ContainersReady   True \n  PodScheduled      True \nVolumes:\n  kube-api-access-s279f:\n    Type:                    Projected (a volume that contains injected data from multiple sources)\n    TokenExpirationSeconds:  3607\n    ConfigMapName:           kube-root-ca.crt\n    ConfigMapOptional:       <nil>\n    DownwardAPI:             true\nQoS Class:                   BestEffort\nNode-Selectors:              <none>\nTolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n  Type    Reason     Age    From               Message\n  ----    ------     ----   ----               -------\n  Normal  Scheduled  10m    default-scheduler  Successfully assigned statefulset-3082/ss2-0 to i-01bd5bfa9703f3bd3\n  Normal  Pulling    9m59s  kubelet            Pulling image \"registry.k8s.io/e2e-test-images/httpd:2.4.38-4\"\n  Normal  Pulled     9m54s  kubelet            Successfully pulled image \"registry.k8s.io/e2e-test-images/httpd:2.4.38-4\" in 4.875108046s (4.875113165s including waiting)\n  Normal  Created    9m54s  kubelet            Created container webserver\n  Normal  Started    9m54s  kubelet            Started container webserver\n"
Jan  5 02:48:19.625: INFO: 
Output of kubectl describe ss2-0:
Name:             ss2-0
Namespace:        statefulset-3082
Priority:         0
Service Account:  default
Node:             i-01bd5bfa9703f3bd3/172.20.48.211
Start Time:       Thu, 05 Jan 2023 02:38:18 +0000
Labels:           baz=blah
                  controller-revision-hash=ss2-7b6c9599d5
                  foo=bar
                  statefulset.kubernetes.io/pod-name=ss2-0
Annotations:      <none>
Status:           Running
IP:               172.20.43.169
IPs:
  IP:           172.20.43.169
Controlled By:  StatefulSet/ss2
Containers:
  webserver:
    Container ID:   containerd://64b4410a079f4c258bd4eb6b51e33b06366ebf959639a0448f4a08556f7ff015
    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4
    Image ID:       registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22
    Port:           <none>
    Host Port:      <none>
    State:          Running
      Started:      Thu, 05 Jan 2023 02:38:25 +0000
    Ready:          True
    Restart Count:  0
    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-s279f (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  kube-api-access-s279f:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type    Reason     Age    From               Message
  ----    ------     ----   ----               -------
  Normal  Scheduled  10m    default-scheduler  Successfully assigned statefulset-3082/ss2-0 to i-01bd5bfa9703f3bd3
  Normal  Pulling    9m59s  kubelet            Pulling image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4"
  Normal  Pulled     9m54s  kubelet            Successfully pulled image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" in 4.875108046s (4.875113165s including waiting)
  Normal  Created    9m54s  kubelet            Created container webserver
  Normal  Started    9m54s  kubelet            Started container webserver

Jan  5 02:48:19.625: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9d8036e7-8ca0-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-3082 logs ss2-0 --tail=100'
Jan  5 02:48:20.181: INFO: stderr: ""
Jan  5 02:48:20.181: INFO: stdout: "172.20.48.211 - - [05/Jan/2023:02:46:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:46:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:47:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.48.211 - - [05/Jan/2023:02:48:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n"
Jan  5 02:48:20.181: INFO: 
Last 100 log lines of ss2-0:
172.20.48.211 - - [05/Jan/2023:02:46:40 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:41 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:42 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:43 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:44 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:45 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:46 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:47 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:48 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:49 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:50 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:51 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:52 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:53 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:54 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:55 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:56 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:57 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:58 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:46:59 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:00 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:01 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:02 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:03 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:04 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:05 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:06 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:07 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:08 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:09 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:10 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:11 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:12 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:13 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:14 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:15 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:16 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:17 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:18 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:19 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:20 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:21 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:22 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:23 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:24 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:25 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:26 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:27 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:28 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:29 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:30 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:31 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:32 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:33 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:34 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:35 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:36 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:37 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:38 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:39 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:40 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:41 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:42 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:43 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:44 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:45 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:46 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:47 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:48 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:49 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:50 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:51 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:52 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:53 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:54 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:55 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:56 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:57 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:58 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:47:59 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:00 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:01 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:02 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:03 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:04 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:05 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:06 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:07 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:08 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:09 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:10 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:11 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:12 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:13 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:14 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:15 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:16 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:17 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:18 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.48.211 - - [05/Jan/2023:02:48:19 +0000] "GET /index.html HTTP/1.1" 200 45

Jan  5 02:48:20.181: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9d8036e7-8ca0-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-3082 describe po ss2-1'
Jan  5 02:48:20.844: INFO: stderr: ""
Jan  5 02:48:20.844: INFO: stdout: "Name:             ss2-1\nNamespace:        statefulset-3082\nPriority:         0\nService Account:  default\nNode:             i-029f31a6b034de1c6/172.20.35.206\nStart Time:       Thu, 05 Jan 2023 02:38:28 +0000\nLabels:           baz=blah\n                  controller-revision-hash=ss2-7b6c9599d5\n                  foo=bar\n                  statefulset.kubernetes.io/pod-name=ss2-1\nAnnotations:      <none>\nStatus:           Running\nIP:               172.20.40.218\nIPs:\n  IP:           172.20.40.218\nControlled By:  StatefulSet/ss2\nContainers:\n  webserver:\n    Container ID:   containerd://5f98bd5efbaefca3047d47166d664661774e877bde0e435f1bb078953513abcd\n    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4\n    Image ID:       registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22\n    Port:           <none>\n    Host Port:      <none>\n    State:          Running\n      Started:      Thu, 05 Jan 2023 02:38:31 +0000\n    Ready:          True\n    Restart Count:  0\n    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n    Environment:    <none>\n    Mounts:\n      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bpxk9 (ro)\nConditions:\n  Type              Status\n  Initialized       True \n  Ready             True \n  ContainersReady   True \n  PodScheduled      True \nVolumes:\n  kube-api-access-bpxk9:\n    Type:                    Projected (a volume that contains injected data from multiple sources)\n    TokenExpirationSeconds:  3607\n    ConfigMapName:           kube-root-ca.crt\n    ConfigMapOptional:       <nil>\n    DownwardAPI:             true\nQoS Class:                   BestEffort\nNode-Selectors:              <none>\nTolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n  Type    Reason     Age    From               Message\n  ----    ------     ----   ----               -------\n  Normal  Scheduled  9m52s  default-scheduler  Successfully assigned statefulset-3082/ss2-1 to i-029f31a6b034de1c6\n  Normal  Pulled     9m49s  kubelet            Container image \"registry.k8s.io/e2e-test-images/httpd:2.4.38-4\" already present on machine\n  Normal  Created    9m49s  kubelet            Created container webserver\n  Normal  Started    9m49s  kubelet            Started container webserver\n"
Jan  5 02:48:20.844: INFO: 
Output of kubectl describe ss2-1:
Name:             ss2-1
Namespace:        statefulset-3082
Priority:         0
Service Account:  default
Node:             i-029f31a6b034de1c6/172.20.35.206
Start Time:       Thu, 05 Jan 2023 02:38:28 +0000
Labels:           baz=blah
                  controller-revision-hash=ss2-7b6c9599d5
                  foo=bar
                  statefulset.kubernetes.io/pod-name=ss2-1
Annotations:      <none>
Status:           Running
IP:               172.20.40.218
IPs:
  IP:           172.20.40.218
Controlled By:  StatefulSet/ss2
Containers:
  webserver:
    Container ID:   containerd://5f98bd5efbaefca3047d47166d664661774e877bde0e435f1bb078953513abcd
    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4
    Image ID:       registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22
    Port:           <none>
    Host Port:      <none>
    State:          Running
      Started:      Thu, 05 Jan 2023 02:38:31 +0000
    Ready:          True
    Restart Count:  0
    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-bpxk9 (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             True 
  ContainersReady   True 
  PodScheduled      True 
Volumes:
  kube-api-access-bpxk9:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type    Reason     Age    From               Message
  ----    ------     ----   ----               -------
  Normal  Scheduled  9m52s  default-scheduler  Successfully assigned statefulset-3082/ss2-1 to i-029f31a6b034de1c6
  Normal  Pulled     9m49s  kubelet            Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
  Normal  Created    9m49s  kubelet            Created container webserver
  Normal  Started    9m49s  kubelet            Started container webserver

Jan  5 02:48:20.844: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9d8036e7-8ca0-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-3082 logs ss2-1 --tail=100'
Jan  5 02:48:21.462: INFO: stderr: ""
Jan  5 02:48:21.462: INFO: stdout: "172.20.35.206 - - [05/Jan/2023:02:46:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:46:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:21 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:22 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:23 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:24 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:25 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:26 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:27 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:28 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:29 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:30 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:31 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:32 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:33 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:34 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:35 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:36 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:37 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:38 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:39 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:40 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:41 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:42 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:43 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:44 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:45 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:46 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:47 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:48 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:49 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:50 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:51 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:52 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:53 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:54 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:55 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:56 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:57 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:58 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:47:59 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:00 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:01 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:02 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:03 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:04 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:05 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:06 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:07 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:08 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:09 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:10 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:11 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:12 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:13 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:14 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:15 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:16 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:17 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:18 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:19 +0000] \"GET /index.html HTTP/1.1\" 200 45\n172.20.35.206 - - [05/Jan/2023:02:48:20 +0000] \"GET /index.html HTTP/1.1\" 200 45\n"
Jan  5 02:48:21.462: INFO: 
Last 100 log lines of ss2-1:
172.20.35.206 - - [05/Jan/2023:02:46:41 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:42 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:43 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:44 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:45 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:46 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:47 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:48 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:49 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:50 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:51 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:52 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:53 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:54 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:55 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:56 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:57 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:58 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:46:59 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:00 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:01 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:02 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:03 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:04 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:05 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:06 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:07 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:08 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:09 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:10 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:11 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:12 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:13 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:14 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:15 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:16 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:17 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:18 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:19 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:20 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:21 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:22 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:23 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:24 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:25 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:26 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:27 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:28 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:29 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:30 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:31 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:32 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:33 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:34 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:35 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:36 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:37 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:38 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:39 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:40 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:41 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:42 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:43 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:44 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:45 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:46 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:47 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:48 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:49 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:50 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:51 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:52 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:53 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:54 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:55 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:56 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:57 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:58 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:47:59 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:00 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:01 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:02 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:03 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:04 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:05 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:06 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:07 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:08 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:09 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:10 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:11 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:12 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:13 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:14 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:15 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:16 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:17 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:18 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:19 +0000] "GET /index.html HTTP/1.1" 200 45
172.20.35.206 - - [05/Jan/2023:02:48:20 +0000] "GET /index.html HTTP/1.1" 200 45

Jan  5 02:48:21.462: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9d8036e7-8ca0-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-3082 describe po ss2-2'
Jan  5 02:48:22.202: INFO: stderr: ""
Jan  5 02:48:22.202: INFO: stdout: "Name:             ss2-2\nNamespace:        statefulset-3082\nPriority:         0\nService Account:  default\nNode:             i-03e466e3a84d9f004/172.20.59.198\nStart Time:       Thu, 05 Jan 2023 02:38:51 +0000\nLabels:           baz=blah\n                  controller-revision-hash=ss2-7b6c9599d5\n                  foo=bar\n                  statefulset.kubernetes.io/pod-name=ss2-2\nAnnotations:      <none>\nStatus:           Pending\nIP:               \nIPs:              <none>\nControlled By:    StatefulSet/ss2\nContainers:\n  webserver:\n    Container ID:   \n    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4\n    Image ID:       \n    Port:           <none>\n    Host Port:      <none>\n    State:          Waiting\n      Reason:       ContainerCreating\n    Ready:          False\n    Restart Count:  0\n    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1\n    Environment:    <none>\n    Mounts:\n      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-5jqpl (ro)\nConditions:\n  Type              Status\n  Initialized       True \n  Ready             False \n  ContainersReady   False \n  PodScheduled      True \nVolumes:\n  kube-api-access-5jqpl:\n    Type:                    Projected (a volume that contains injected data from multiple sources)\n    TokenExpirationSeconds:  3607\n    ConfigMapName:           kube-root-ca.crt\n    ConfigMapOptional:       <nil>\n    DownwardAPI:             true\nQoS Class:                   BestEffort\nNode-Selectors:              <none>\nTolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s\n                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s\nEvents:\n  Type     Reason                  Age                    From               Message\n  ----     ------                  ----                   ----               -------\n  Normal   Scheduled               9m31s                  default-scheduler  Successfully assigned statefulset-3082/ss2-2 to i-03e466e3a84d9f004\n  Warning  FailedCreatePodSandBox  9m30s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"a80f9b864d0dc70cf6c9aaadfb8f93f9dc8a20b663856a66792701235f325f82\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  9m18s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"29cc0cde67772b193bddedef47d2dbf196fd8209e1d98d8a4c35464201e531f0\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  9m3s                   kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"49bcd43b3d0e22aeb3d7001db888cd5d390e0633904822df5fa52b733050595e\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  8m48s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"1dbbe2dd73a659202ee12027861e0eeec13cc811ac125a8789bb32fa6d7e9fb2\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  8m34s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"3daea7849588e5d1436e0288e9d2ac55d1b477d6713c9472432f0d7fdb4ba9fc\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  8m19s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"6c6875d391e8b49b159a73f14b30f41cbc8140fe60bef56e1de0f68f8ba07048\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  8m6s                   kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"d4c76e7530c3bc02e9fc60c5e217a9a53510b78247d26e5d6d364203d49400b4\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  7m51s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"0ed188b96a08fb9c15e5b5a3cdf63015385136e6d62d53687cc68759aa0b19a4\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  7m36s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"143d6ef5465cb0487d4c936ee6048c70c00d07ad9ba03b0a23b687c027b2c920\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n  Warning  FailedCreatePodSandBox  4m1s (x17 over 7m24s)  kubelet            (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox \"624120e15c14473809c9a83c8000fa4e1b74a75514b83e368fc50c36a8be529b\": plugin type=\"cilium-cni\" name=\"cilium\" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available\n"
Jan  5 02:48:22.202: INFO: 
Output of kubectl describe ss2-2:
Name:             ss2-2
Namespace:        statefulset-3082
Priority:         0
Service Account:  default
Node:             i-03e466e3a84d9f004/172.20.59.198
Start Time:       Thu, 05 Jan 2023 02:38:51 +0000
Labels:           baz=blah
                  controller-revision-hash=ss2-7b6c9599d5
                  foo=bar
                  statefulset.kubernetes.io/pod-name=ss2-2
Annotations:      <none>
Status:           Pending
IP:               
IPs:              <none>
Controlled By:    StatefulSet/ss2
Containers:
  webserver:
    Container ID:   
    Image:          registry.k8s.io/e2e-test-images/httpd:2.4.38-4
    Image ID:       
    Port:           <none>
    Host Port:      <none>
    State:          Waiting
      Reason:       ContainerCreating
    Ready:          False
    Restart Count:  0
    Readiness:      http-get http://:80/index.html delay=0s timeout=1s period=1s #success=1 #failure=1
    Environment:    <none>
    Mounts:
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-5jqpl (ro)
Conditions:
  Type              Status
  Initialized       True 
  Ready             False 
  ContainersReady   False 
  PodScheduled      True 
Volumes:
  kube-api-access-5jqpl:
    Type:                    Projected (a volume that contains injected data from multiple sources)
    TokenExpirationSeconds:  3607
    ConfigMapName:           kube-root-ca.crt
    ConfigMapOptional:       <nil>
    DownwardAPI:             true
QoS Class:                   BestEffort
Node-Selectors:              <none>
Tolerations:                 node.kubernetes.io/not-ready:NoExecute op=Exists for 300s
                             node.kubernetes.io/unreachable:NoExecute op=Exists for 300s
Events:
  Type     Reason                  Age                    From               Message
  ----     ------                  ----                   ----               -------
  Normal   Scheduled               9m31s                  default-scheduler  Successfully assigned statefulset-3082/ss2-2 to i-03e466e3a84d9f004
  Warning  FailedCreatePodSandBox  9m30s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a80f9b864d0dc70cf6c9aaadfb8f93f9dc8a20b663856a66792701235f325f82": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  9m18s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "29cc0cde67772b193bddedef47d2dbf196fd8209e1d98d8a4c35464201e531f0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  9m3s                   kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "49bcd43b3d0e22aeb3d7001db888cd5d390e0633904822df5fa52b733050595e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  8m48s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1dbbe2dd73a659202ee12027861e0eeec13cc811ac125a8789bb32fa6d7e9fb2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  8m34s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3daea7849588e5d1436e0288e9d2ac55d1b477d6713c9472432f0d7fdb4ba9fc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  8m19s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6c6875d391e8b49b159a73f14b30f41cbc8140fe60bef56e1de0f68f8ba07048": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  8m6s                   kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d4c76e7530c3bc02e9fc60c5e217a9a53510b78247d26e5d6d364203d49400b4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  7m51s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0ed188b96a08fb9c15e5b5a3cdf63015385136e6d62d53687cc68759aa0b19a4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  7m36s                  kubelet            Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "143d6ef5465cb0487d4c936ee6048c70c00d07ad9ba03b0a23b687c027b2c920": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
  Warning  FailedCreatePodSandBox  4m1s (x17 over 7m24s)  kubelet            (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "624120e15c14473809c9a83c8000fa4e1b74a75514b83e368fc50c36a8be529b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available

Jan  5 02:48:22.202: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/9d8036e7-8ca0-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=statefulset-3082 logs ss2-2 --tail=100'
Jan  5 02:48:22.767: INFO: rc: 1
Jan  5 02:48:22.767: INFO: 
Last 100 log lines of ss2-2:

Jan  5 02:48:22.767: INFO: Deleting all statefulset in ns statefulset-3082
Jan  5 02:48:22.878: INFO: Scaling statefulset ss2 to 0
Jan  5 02:48:33.329: INFO: Waiting for statefulset status.replicas updated to 0
Jan  5 02:48:33.441: INFO: Deleting statefulset ss2
[AfterEach] [sig-apps] StatefulSet
  test/e2e/framework/node/init/init.go:32
Jan  5 02:48:33.779: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] StatefulSet
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] StatefulSet
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/05/23 02:48:34.004�[0m
�[1mSTEP:�[0m Collecting events from namespace "statefulset-3082". �[38;5;243m01/05/23 02:48:34.004�[0m
�[1mSTEP:�[0m Found 50 events. �[38;5;243m01/05/23 02:48:34.118�[0m
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:27 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-0 in StatefulSet ss2 successful
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:27 +0000 UTC - event for ss2-0: {default-scheduler } Scheduled: Successfully assigned statefulset-3082/ss2-0 to i-025e1f38135aff0cb
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:32 +0000 UTC - event for ss2-0: {kubelet i-025e1f38135aff0cb} Pulling: Pulling image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4"
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:41 +0000 UTC - event for ss2-0: {kubelet i-025e1f38135aff0cb} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" in 4.467823665s (8.310560898s including waiting)
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:41 +0000 UTC - event for ss2-0: {kubelet i-025e1f38135aff0cb} Created: Created container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:41 +0000 UTC - event for ss2-0: {kubelet i-025e1f38135aff0cb} Started: Started container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:42 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-1 in StatefulSet ss2 successful
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:42 +0000 UTC - event for ss2-1: {default-scheduler } Scheduled: Successfully assigned statefulset-3082/ss2-1 to i-029f31a6b034de1c6
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:47 +0000 UTC - event for ss2-1: {kubelet i-029f31a6b034de1c6} Created: Created container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:47 +0000 UTC - event for ss2-1: {kubelet i-029f31a6b034de1c6} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:47 +0000 UTC - event for ss2-1: {kubelet i-029f31a6b034de1c6} Started: Started container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:52 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulCreate: create Pod ss2-2 in StatefulSet ss2 successful
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:52 +0000 UTC - event for ss2-2: {default-scheduler } Scheduled: Successfully assigned statefulset-3082/ss2-2 to i-03e466e3a84d9f004
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:37:53 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0425db2837d04ac0be9a5b5ccf2372e6eadad561d661c063555b8fdcc5ead31f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:09 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} Pulling: Pulling image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4"
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:13 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} Created: Created container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:13 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" in 4.430843691s (4.841239239s including waiting)
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:14 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} Started: Started container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:18 +0000 UTC - event for ss2-0: {kubelet i-025e1f38135aff0cb} Killing: Stopping container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:18 +0000 UTC - event for ss2-0: {kubelet i-025e1f38135aff0cb} Unhealthy: Readiness probe failed: Get "http://172.20.41.81:80/index.html": dial tcp 172.20.41.81:80: connect: connection refused
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:18 +0000 UTC - event for ss2-0: {default-scheduler } Scheduled: Successfully assigned statefulset-3082/ss2-0 to i-01bd5bfa9703f3bd3
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:18 +0000 UTC - event for ss2-1: {kubelet i-029f31a6b034de1c6} Killing: Stopping container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:18 +0000 UTC - event for ss2-1: {kubelet i-029f31a6b034de1c6} Unhealthy: Readiness probe failed: Get "http://172.20.57.249:80/index.html": dial tcp 172.20.57.249:80: connect: connection refused
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:18 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} Killing: Stopping container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:20 +0000 UTC - event for ss2-0: {kubelet i-01bd5bfa9703f3bd3} Pulling: Pulling image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4"
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:25 +0000 UTC - event for ss2-0: {kubelet i-01bd5bfa9703f3bd3} Pulled: Successfully pulled image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" in 4.875108046s (4.875113165s including waiting)
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:25 +0000 UTC - event for ss2-0: {kubelet i-01bd5bfa9703f3bd3} Started: Started container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:25 +0000 UTC - event for ss2-0: {kubelet i-01bd5bfa9703f3bd3} Created: Created container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:28 +0000 UTC - event for ss2-1: {default-scheduler } Scheduled: Successfully assigned statefulset-3082/ss2-1 to i-029f31a6b034de1c6
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:31 +0000 UTC - event for ss2-1: {kubelet i-029f31a6b034de1c6} Started: Started container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:31 +0000 UTC - event for ss2-1: {kubelet i-029f31a6b034de1c6} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:31 +0000 UTC - event for ss2-1: {kubelet i-029f31a6b034de1c6} Created: Created container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:51 +0000 UTC - event for ss2-2: {default-scheduler } Scheduled: Successfully assigned statefulset-3082/ss2-2 to i-03e466e3a84d9f004
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:38:52 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a80f9b864d0dc70cf6c9aaadfb8f93f9dc8a20b663856a66792701235f325f82": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:39:04 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "29cc0cde67772b193bddedef47d2dbf196fd8209e1d98d8a4c35464201e531f0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:39:19 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "49bcd43b3d0e22aeb3d7001db888cd5d390e0633904822df5fa52b733050595e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:39:34 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1dbbe2dd73a659202ee12027861e0eeec13cc811ac125a8789bb32fa6d7e9fb2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:39:48 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3daea7849588e5d1436e0288e9d2ac55d1b477d6713c9472432f0d7fdb4ba9fc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:40:03 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6c6875d391e8b49b159a73f14b30f41cbc8140fe60bef56e1de0f68f8ba07048": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:40:16 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d4c76e7530c3bc02e9fc60c5e217a9a53510b78247d26e5d6d364203d49400b4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:40:31 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0ed188b96a08fb9c15e5b5a3cdf63015385136e6d62d53687cc68759aa0b19a4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:40:46 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "143d6ef5465cb0487d4c936ee6048c70c00d07ad9ba03b0a23b687c027b2c920": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:40:58 +0000 UTC - event for ss2-2: {kubelet i-03e466e3a84d9f004} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "624120e15c14473809c9a83c8000fa4e1b74a75514b83e368fc50c36a8be529b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:48:23 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-2 in StatefulSet ss2 successful
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:48:23 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-1 in StatefulSet ss2 successful
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:48:23 +0000 UTC - event for ss2-1: {kubelet i-029f31a6b034de1c6} Killing: Stopping container webserver
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:48:23 +0000 UTC - event for ss2-1: {kubelet i-029f31a6b034de1c6} Unhealthy: Readiness probe failed: Get "http://172.20.40.218:80/index.html": dial tcp 172.20.40.218:80: connect: connection refused
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:48:24 +0000 UTC - event for ss2: {statefulset-controller } SuccessfulDelete: delete Pod ss2-0 in StatefulSet ss2 successful
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:48:24 +0000 UTC - event for ss2-0: {kubelet i-01bd5bfa9703f3bd3} Unhealthy: Readiness probe failed: Get "http://172.20.43.169:80/index.html": read tcp 172.20.48.211:36238->172.20.43.169:80: read: connection reset by peer
Jan  5 02:48:34.118: INFO: At 2023-01-05 02:48:24 +0000 UTC - event for ss2-0: {kubelet i-01bd5bfa9703f3bd3} Killing: Stopping container webserver
Jan  5 02:48:34.230: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan  5 02:48:34.230: INFO: 
Jan  5 02:48:34.343: INFO: 
Logging node info for node i-01bd5bfa9703f3bd3
Jan  5 02:48:34.462: INFO: Node Info: &Node{ObjectMeta:{i-01bd5bfa9703f3bd3    69222d04-c2bf-45d2-98fb-9486844f5c9b 8849 0 2023-01-05 02:34:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01bd5bfa9703f3bd3 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-01bd5bfa9703f3bd3 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.211 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-146":"i-01bd5bfa9703f3bd3","ebs.csi.aws.com":"i-01bd5bfa9703f3bd3"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:09 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:45:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-05 02:46:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-01bd5bfa9703f3bd3,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:46:46 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:46:46 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:46:46 +0000 UTC,LastTransitionTime:2023-01-05 02:34:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:46:46 +0000 UTC,LastTransitionTime:2023-01-05 02:34:21 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.211,},NodeAddress{Type:ExternalIP,Address:3.127.108.91,},NodeAddress{Type:InternalDNS,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01bd5bfa9703f3bd3.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-127-108-91.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2c4f0d8dc84e5ae1e29667dae48eae,SystemUUID:ec2c4f0d-8dc8-4e5a-e1e2-9667dae48eae,BootID:b09c708e-7e9b-478b-a41e-54cca7d4cf91,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-146^30f69951-8ca3-11ed-a871-f256e7dbdb77 kubernetes.io/csi/ebs.csi.aws.com^vol-0cf11112deb2eeb36 kubernetes.io/csi/ebs.csi.aws.com^vol-0e6bc0e2cf2e0bf4c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0e6bc0e2cf2e0bf4c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0cf11112deb2eeb36,DevicePath:,},},Config:nil,},}
Jan  5 02:48:34.462: INFO: 
Logging kubelet events for node i-01bd5bfa9703f3bd3
Jan  5 02:48:34.577: INFO: 
Logging pods the kubelet thinks is on node i-01bd5bfa9703f3bd3
Jan  5 02:48:34.810: INFO: affinity-clusterip-transition-7hz95 started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container affinity-clusterip-transition ready: false, restart count 0
Jan  5 02:48:34.810: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wppds started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:34.810: INFO: dns-test-5e174570-82af-4b4c-98b3-8be4084efa2e started at 2023-01-05 02:46:38 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  5 02:48:34.810: INFO: 	Container querier ready: false, restart count 0
Jan  5 02:48:34.810: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:48:34.810: INFO: dns-test-3b53ba68-c445-4758-b5cc-0ab0531d8eea started at 2023-01-05 02:45:51 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container jessie-querier ready: false, restart count 0
Jan  5 02:48:34.810: INFO: 	Container querier ready: false, restart count 0
Jan  5 02:48:34.810: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:48:34.810: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-n5tbp started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:34.810: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gb74d started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:34.810: INFO: hostexec-i-01bd5bfa9703f3bd3-6bn56 started at 2023-01-05 02:44:08 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:48:34.810: INFO: test-webserver-dd56b1f9-687a-4d98-bf34-791806eacc55 started at 2023-01-05 02:47:47 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container test-webserver ready: false, restart count 0
Jan  5 02:48:34.810: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tc8w7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:34.810: INFO: cilium-fqg7v started at 2023-01-05 02:34:09 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:48:34.810: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:48:34.810: INFO: ebs-csi-node-gg6js started at 2023-01-05 02:34:09 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:48:34.810: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:48:34.810: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:48:34.810: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nz7dc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:34.810: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-v9t4w started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:34.810: INFO: pvc-volume-tester-zm48w started at 2023-01-05 02:46:45 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container volume-tester ready: false, restart count 0
Jan  5 02:48:34.810: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-h4jxc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:34.810: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-bd4zs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:34.810: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-fj2vh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:34.810: INFO: csi-mockplugin-0 started at 2023-01-05 02:41:00 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:48:34.810: INFO: 	Container driver-registrar ready: true, restart count 0
Jan  5 02:48:34.810: INFO: 	Container mock ready: true, restart count 0
Jan  5 02:48:34.810: INFO: csi-mockplugin-attacher-0 started at 2023-01-05 02:41:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:48:34.810: INFO: local-injector started at 2023-01-05 02:44:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container local-injector ready: false, restart count 0
Jan  5 02:48:34.810: INFO: inline-volume-tester-7ddfs started at 2023-01-05 02:44:45 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan  5 02:48:34.810: INFO: pod-subpath-test-dynamicpv-rdf9 started at 2023-01-05 02:45:11 +0000 UTC (2+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Init container init-volume-dynamicpv-rdf9 ready: false, restart count 0
Jan  5 02:48:34.810: INFO: 	Init container test-init-subpath-dynamicpv-rdf9 ready: false, restart count 0
Jan  5 02:48:34.810: INFO: 	Container test-container-subpath-dynamicpv-rdf9 ready: false, restart count 0
Jan  5 02:48:34.810: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-xjdj7 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:34.810: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-bzd5x started at 2023-01-05 02:45:39 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container sample-crd-conversion-webhook ready: false, restart count 0
Jan  5 02:48:34.810: INFO: netserver-0 started at 2023-01-05 02:47:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:34.810: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:48:35.216: INFO: 
Latency metrics for node i-01bd5bfa9703f3bd3
Jan  5 02:48:35.216: INFO: 
Logging node info for node i-025e1f38135aff0cb
Jan  5 02:48:35.329: INFO: Node Info: &Node{ObjectMeta:{i-025e1f38135aff0cb    e077826c-bb74-41f6-aafe-d16d1e1a4e20 8465 0 2023-01-05 02:34:05 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-025e1f38135aff0cb kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-025e1f38135aff0cb topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.96 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-025e1f38135aff0cb"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-05 02:34:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:46:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-025e1f38135aff0cb,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:05 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:45:51 +0000 UTC,LastTransitionTime:2023-01-05 02:34:18 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.96,},NodeAddress{Type:ExternalIP,Address:18.195.60.12,},NodeAddress{Type:InternalDNS,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-025e1f38135aff0cb.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-195-60-12.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec223249b01164600b2958646dddca75,SystemUUID:ec223249-b011-6460-0b29-58646dddca75,BootID:7a5edf7e-21fb-482a-aeb0-e226be4da837,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:48:35.329: INFO: 
Logging kubelet events for node i-025e1f38135aff0cb
Jan  5 02:48:35.447: INFO: 
Logging pods the kubelet thinks is on node i-025e1f38135aff0cb
Jan  5 02:48:35.568: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lnv9l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:35.568: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-zkfhs started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:35.568: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-mrk29 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:35.568: INFO: cilium-rjzq7 started at 2023-01-05 02:34:06 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:48:35.568: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:48:35.568: INFO: coredns-559769c974-7vlfn started at 2023-01-05 02:34:41 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container coredns ready: true, restart count 0
Jan  5 02:48:35.568: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-z8xgj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:35.568: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:46:55 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:48:35.568: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:48:35.568: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:48:35.568: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:48:35.568: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:48:35.568: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:48:35.568: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:48:35.568: INFO: netserver-1 started at 2023-01-05 02:47:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:48:35.568: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-wq84l started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:35.568: INFO: affinity-clusterip-transition-5275l started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container affinity-clusterip-transition ready: true, restart count 0
Jan  5 02:48:35.568: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-b68nw started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:35.568: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-tg6gz started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:35.568: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-g4spn started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:35.568: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-gg7zk started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:35.568: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-p5wf4 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:35.568: INFO: ebs-csi-node-hqlnq started at 2023-01-05 02:34:06 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:48:35.568: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:48:35.568: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:48:35.568: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:48:35.981: INFO: 
Latency metrics for node i-025e1f38135aff0cb
Jan  5 02:48:35.981: INFO: 
Logging node info for node i-029f31a6b034de1c6
Jan  5 02:48:36.093: INFO: Node Info: &Node{ObjectMeta:{i-029f31a6b034de1c6    6eaa3884-9088-400b-96bc-7fe0bc27f677 8442 0 2023-01-05 02:34:16 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-029f31a6b034de1c6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-029f31a6b034de1c6 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.35.206 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-029f31a6b034de1c6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-05 02:34:17 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.5.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-05 02:46:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.5.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-029f31a6b034de1c6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.5.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:46:01 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:46:01 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:46:01 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:46:01 +0000 UTC,LastTransitionTime:2023-01-05 02:34:29 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.35.206,},NodeAddress{Type:ExternalIP,Address:3.71.43.14,},NodeAddress{Type:InternalDNS,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-029f31a6b034de1c6.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-43-14.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be2b1604bcc2946df20723d761dd9,SystemUUID:ec2be2b1-604b-cc29-46df-20723d761dd9,BootID:998135dd-fb0c-441d-85ec-d92193042b65,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:48:36.094: INFO: 
Logging kubelet events for node i-029f31a6b034de1c6
Jan  5 02:48:36.209: INFO: 
Logging pods the kubelet thinks is on node i-029f31a6b034de1c6
Jan  5 02:48:36.331: INFO: pod-secrets-6ab0c9d1-ce7d-4547-9044-0162e6ad2809 started at 2023-01-05 02:44:31 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container secret-test ready: false, restart count 0
Jan  5 02:48:36.331: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ccgnj started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:36.331: INFO: hostexec-i-029f31a6b034de1c6-p84w4 started at 2023-01-05 02:45:22 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:48:36.331: INFO: csi-hostpathplugin-0 started at 2023-01-05 02:46:07 +0000 UTC (0+7 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container csi-attacher ready: false, restart count 0
Jan  5 02:48:36.331: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan  5 02:48:36.331: INFO: 	Container csi-resizer ready: false, restart count 0
Jan  5 02:48:36.331: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan  5 02:48:36.331: INFO: 	Container hostpath ready: false, restart count 0
Jan  5 02:48:36.331: INFO: 	Container liveness-probe ready: false, restart count 0
Jan  5 02:48:36.331: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan  5 02:48:36.331: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-nqgmc started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:36.331: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-khzwh started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:36.331: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-lzwd8 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:36.331: INFO: netserver-2 started at 2023-01-05 02:47:01 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container webserver ready: false, restart count 0
Jan  5 02:48:36.331: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-sp7hv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:36.331: INFO: affinity-clusterip-transition-8v8lg started at 2023-01-05 02:45:25 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container affinity-clusterip-transition ready: true, restart count 0
Jan  5 02:48:36.331: INFO: pod-subpath-test-preprovisionedpv-czk5 started at 2023-01-05 02:45:50 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Init container init-volume-preprovisionedpv-czk5 ready: false, restart count 0
Jan  5 02:48:36.331: INFO: 	Container test-container-subpath-preprovisionedpv-czk5 ready: false, restart count 0
Jan  5 02:48:36.331: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-k6j85 started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:36.331: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-ht7lv started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:36.331: INFO: implicit-nonroot-uid started at 2023-01-05 02:47:20 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container implicit-nonroot-uid ready: false, restart count 0
Jan  5 02:48:36.331: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-54jfx started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:36.331: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-c45mb started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:36.331: INFO: ebs-csi-node-tb9gj started at 2023-01-05 02:34:17 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:48:36.331: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:48:36.331: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:48:36.331: INFO: cilium-v2frt started at 2023-01-05 02:34:17 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:48:36.331: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:48:36.331: INFO: pod2 started at 2023-01-05 02:45:29 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container container1 ready: true, restart count 0
Jan  5 02:48:36.331: INFO: hostexec-i-029f31a6b034de1c6-j7mfb started at 2023-01-05 02:45:44 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container agnhost-container ready: true, restart count 0
Jan  5 02:48:36.331: INFO: pod-configmaps-4c7c5cae-5dc1-4cf3-b2ef-98693ffaf50d started at 2023-01-05 02:44:26 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container agnhost-container ready: false, restart count 0
Jan  5 02:48:36.331: INFO: pod-24d14a31-2cf4-4c8d-bb75-9d7fd895bf4b started at 2023-01-05 02:45:26 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container write-pod ready: false, restart count 0
Jan  5 02:48:36.331: INFO: cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e-vb4kg started at 2023-01-05 02:38:33 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container cleanup40-baf923c6-2a49-4f63-b043-e9f46c9cbc5e ready: true, restart count 0
Jan  5 02:48:36.331: INFO: pod1 started at 2023-01-05 02:45:29 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:36.331: INFO: 	Container container1 ready: false, restart count 0
Jan  5 02:48:36.739: INFO: 
Latency metrics for node i-029f31a6b034de1c6
Jan  5 02:48:36.739: INFO: 
Logging node info for node i-03e2b3d27125ad085
Jan  5 02:48:36.851: INFO: Node Info: &Node{ObjectMeta:{i-03e2b3d27125ad085    9cffc38a-f9d7-40cb-848c-a16086a32ac9 7736 0 2023-01-05 02:32:28 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e2b3d27125ad085 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-central-1a topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.123 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03e2b3d27125ad085"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-05 02:32:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-05 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:33:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:33:15 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-05 02:45:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e2b3d27125ad085,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:14 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:14 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:14 +0000 UTC,LastTransitionTime:2023-01-05 02:32:22 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:45:14 +0000 UTC,LastTransitionTime:2023-01-05 02:33:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.123,},NodeAddress{Type:ExternalIP,Address:3.124.193.93,},NodeAddress{Type:InternalDNS,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e2b3d27125ad085.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-124-193-93.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2e40ce762960a4f05822e85e89a6d7,SystemUUID:ec2e40ce-7629-60a4-f058-22e85e89a6d7,BootID:e3c9a56f-3559-40b1-99e3-6055bc36443e,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.1],SizeBytes:42982336,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.1],SizeBytes:42804914,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.1],SizeBytes:4967337,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan  5 02:48:36.852: INFO: 
Logging kubelet events for node i-03e2b3d27125ad085
Jan  5 02:48:36.966: INFO: 
Logging pods the kubelet thinks is on node i-03e2b3d27125ad085
Jan  5 02:48:37.085: INFO: etcd-manager-events-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:48:37.085: INFO: kube-apiserver-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+2 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Container healthcheck ready: true, restart count 0
Jan  5 02:48:37.085: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan  5 02:48:37.085: INFO: aws-cloud-controller-manager-qmldf started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan  5 02:48:37.085: INFO: ebs-csi-node-f7tgk started at 2023-01-05 02:33:04 +0000 UTC (0+3 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:48:37.085: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:48:37.085: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan  5 02:48:37.085: INFO: cilium-operator-6f8d6c4bf-kdqfd started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Container cilium-operator ready: true, restart count 0
Jan  5 02:48:37.085: INFO: dns-controller-56cf649474-cnnkp started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Container dns-controller ready: true, restart count 0
Jan  5 02:48:37.085: INFO: etcd-manager-main-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Container etcd-manager ready: true, restart count 0
Jan  5 02:48:37.085: INFO: kube-controller-manager-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan  5 02:48:37.085: INFO: kube-scheduler-i-03e2b3d27125ad085 started at 2023-01-05 02:31:53 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan  5 02:48:37.085: INFO: cilium-pbccf started at 2023-01-05 02:33:04 +0000 UTC (1+1 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan  5 02:48:37.085: INFO: 	Container cilium-agent ready: true, restart count 0
Jan  5 02:48:37.085: INFO: kops-controller-6mxst started at 2023-01-05 02:33:04 +0000 UTC (0+1 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Container kops-controller ready: true, restart count 0
Jan  5 02:48:37.085: INFO: ebs-csi-controller-6b8d786cf8-2c9wj started at 2023-01-05 02:33:04 +0000 UTC (0+5 container statuses recorded)
Jan  5 02:48:37.085: INFO: 	Container csi-attacher ready: true, restart count 0
Jan  5 02:48:37.085: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan  5 02:48:37.085: INFO: 	Container csi-resizer ready: true, restart count 0
Jan  5 02:48:37.085: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan  5 02:48:37.085: INFO: 	Container liveness-probe ready: true, restart count 0
Jan  5 02:48:37.470: INFO: 
Latency metrics for node i-03e2b3d27125ad085
Jan  5 02:48:37.470: INFO: 
Logging node info for node i-03e466e3a84d9f004
Jan  5 02:48:37.582: INFO: Node Info: &Node{ObjectMeta:{i-03e466e3a84d9f004    eb024a0b-a711-42e7-8f3b-c92ac348ecd2 8155 0 2023-01-05 02:34:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-central-1 failure-domain.beta.kubernetes.io/zone:eu-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03e466e3a84d9f004 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-central-1a topology.hostpath.csi/node:i-03e466e3a84d9f004 topology.kubernetes.io/region:eu-central-1 topology.kubernetes.io/zone:eu-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.59.198 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-345":"i-03e466e3a84d9f004","ebs.csi.aws.com":"i-03e466e3a84d9f004"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-05 02:34:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:34:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-05 02:38:32 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-05 02:45:31 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-05 02:45:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-central-1a/i-03e466e3a84d9f004,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-05 02:45:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-05 02:45:36 +0000 UTC,LastTransitionTime:2023-01-05 02:34:16 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.59.198,},NodeAddress{Type:ExternalIP,Address:3.71.182.65,},NodeAddress{Type:InternalDNS,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03e466e3a84d9f004.eu-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-71-182-65.eu-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2183d91500f4a0d14c0ffcaa6a62ca,SystemUUID:ec2183d9-1500-f4a0-d14c-0ffcaa6a62ca,BootID:54ae1a2e-030d-4aec-bab9-224c76049655,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-345^047be1aa-8ca3-11ed-99f4-ca22fe77c460],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-345^047be1aa-8ca3-11ed-99f4-ca22fe77c460,DevicePath:,},},Config:nil,},}
Jan  5 02:48:37.582: INFO: 
Logging kubelet events for node i-03e466e3a84d9f004
Jan  5 02:48:37.696: INFO: 
Logging pods the kubelet thinks

Result	FAILURE
Tests	34 failed / 853 succeeded
Started	2023-01-05 02:29
Elapsed	46m7s
Revision	master