e2e-kops-grid-cilium-eni-deb10-k26-ko26 #1615898902936948736
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 43 failed / 844 succeeded |
| Started | |
| Elapsed | 46m31s |
| Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(OnRootMismatch\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\snew\spod\sfsgroup\sapplied\sto\svolume\scontents$'
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc001776f00, 0xc005207e10, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 02:46:41.96�[0m
Jan 19 02:46:41.960: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename fsgroupchangepolicy �[38;5;243m01/19/23 02:46:41.961�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 02:46:42.155�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 02:46:42.283�[0m
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/metrics/init/init.go:31
[It] (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
test/e2e/storage/testsuites/fsgroupchangepolicy.go:210
Jan 19 02:46:42.411: INFO: Creating resource for dynamic PV
Jan 19 02:46:42.411: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass fsgroupchangepolicy-8904-e2e-scc5gb6 �[38;5;243m01/19/23 02:46:42.412�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/19/23 02:46:42.477�[0m
Jan 19 02:46:42.477: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-8904 with fsgroup 1000 �[38;5;243m01/19/23 02:46:42.608�[0m
Jan 19 02:46:42.677: INFO: Waiting up to 5m0s for pod "pod-87600900-ab09-4695-a4b1-f510a9918667" in namespace "fsgroupchangepolicy-8904" to be "running"
Jan 19 02:46:42.742: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 64.619979ms
Jan 19 02:46:44.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2.130419001s
Jan 19 02:46:46.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4.129966587s
Jan 19 02:46:48.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 6.130477195s
Jan 19 02:46:50.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 8.129539336s
Jan 19 02:46:52.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 10.129417258s
Jan 19 02:46:54.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 12.130547787s
Jan 19 02:46:56.809: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 14.131323005s
Jan 19 02:46:58.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 16.129966364s
Jan 19 02:47:00.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 18.131099508s
Jan 19 02:47:02.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 20.130067435s
Jan 19 02:47:04.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 22.130275515s
Jan 19 02:47:06.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 24.129567657s
Jan 19 02:47:08.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 26.129381471s
Jan 19 02:47:10.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 28.129304457s
Jan 19 02:47:12.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 30.129478555s
Jan 19 02:47:14.810: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 32.132217468s
Jan 19 02:47:16.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 34.129753715s
Jan 19 02:47:18.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 36.130740795s
Jan 19 02:47:20.809: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 38.131406183s
Jan 19 02:47:22.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 40.129421467s
Jan 19 02:47:24.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 42.129612906s
Jan 19 02:47:26.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 44.129626893s
Jan 19 02:47:28.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 46.129402955s
Jan 19 02:47:30.806: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 48.129173514s
Jan 19 02:47:32.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 50.129497263s
Jan 19 02:47:34.806: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 52.12910814s
Jan 19 02:47:36.810: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 54.132268113s
Jan 19 02:47:38.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 56.130025862s
Jan 19 02:47:40.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 58.130286647s
Jan 19 02:47:42.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.130154169s
Jan 19 02:47:44.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.129234683s
Jan 19 02:47:46.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.130984748s
Jan 19 02:47:48.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.129501858s
Jan 19 02:47:50.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.130685566s
Jan 19 02:47:52.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.129735101s
Jan 19 02:47:54.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.130181886s
Jan 19 02:47:56.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.129916394s
Jan 19 02:47:58.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.129362708s
Jan 19 02:48:00.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.129379189s
Jan 19 02:48:02.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.129816253s
Jan 19 02:48:04.809: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.131534666s
Jan 19 02:48:06.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.130698695s
Jan 19 02:48:08.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.130016556s
Jan 19 02:48:10.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.130203984s
Jan 19 02:48:12.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.129799707s
Jan 19 02:48:14.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.130119382s
Jan 19 02:48:16.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.130545906s
Jan 19 02:48:18.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.130703863s
Jan 19 02:48:20.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.130350936s
Jan 19 02:48:22.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.129757248s
Jan 19 02:48:24.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.130111722s
Jan 19 02:48:26.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.130394115s
Jan 19 02:48:28.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.130149642s
Jan 19 02:48:30.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.130122916s
Jan 19 02:48:32.809: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.132178065s
Jan 19 02:48:34.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.130395749s
Jan 19 02:48:36.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.129780664s
Jan 19 02:48:38.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.129519872s
Jan 19 02:48:40.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.130042934s
Jan 19 02:48:42.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.129624234s
Jan 19 02:48:44.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.129998798s
Jan 19 02:48:46.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.130345999s
Jan 19 02:48:48.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.129777576s
Jan 19 02:48:50.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.129830765s
Jan 19 02:48:52.809: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.131467498s
Jan 19 02:48:54.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.13060743s
Jan 19 02:48:56.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.130000506s
Jan 19 02:48:58.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.129595392s
Jan 19 02:49:00.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.130325053s
Jan 19 02:49:02.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.130082369s
Jan 19 02:49:04.809: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.131631799s
Jan 19 02:49:06.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.129774782s
Jan 19 02:49:08.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.130391178s
Jan 19 02:49:10.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.13096914s
Jan 19 02:49:12.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.130217515s
Jan 19 02:49:14.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.130354477s
Jan 19 02:49:16.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.130085722s
Jan 19 02:49:18.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.129549035s
Jan 19 02:49:20.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.129569632s
Jan 19 02:49:22.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.130251001s
Jan 19 02:49:24.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.129788798s
Jan 19 02:49:26.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.129492874s
Jan 19 02:49:28.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.129833498s
Jan 19 02:49:30.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.129395735s
Jan 19 02:49:32.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.130059641s
Jan 19 02:49:34.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.130247007s
Jan 19 02:49:36.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.130128918s
Jan 19 02:49:38.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.130164533s
Jan 19 02:49:40.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.129472868s
Jan 19 02:49:42.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.130138118s
Jan 19 02:49:44.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.130582732s
Jan 19 02:49:46.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.130921427s
Jan 19 02:49:48.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.130645038s
Jan 19 02:49:50.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.130123484s
Jan 19 02:49:52.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.1295837s
Jan 19 02:49:54.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.12967974s
Jan 19 02:49:56.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.130136269s
Jan 19 02:49:58.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.130163707s
Jan 19 02:50:00.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.130467353s
Jan 19 02:50:02.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.129735846s
Jan 19 02:50:04.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.129689919s
Jan 19 02:50:06.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.130460354s
Jan 19 02:50:08.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.129845279s
Jan 19 02:50:10.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.129673088s
Jan 19 02:50:12.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.129885021s
Jan 19 02:50:14.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.130197218s
Jan 19 02:50:16.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.130415067s
Jan 19 02:50:18.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.129774171s
Jan 19 02:50:20.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.13050739s
Jan 19 02:50:22.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.130138213s
Jan 19 02:50:24.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.130469114s
Jan 19 02:50:26.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.130599487s
Jan 19 02:50:28.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.130328523s
Jan 19 02:50:30.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.129498332s
Jan 19 02:50:32.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.130140009s
Jan 19 02:50:34.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.130424681s
Jan 19 02:50:36.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.130527224s
Jan 19 02:50:38.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.130521307s
Jan 19 02:50:40.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.130386812s
Jan 19 02:50:42.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.129513481s
Jan 19 02:50:44.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.129677418s
Jan 19 02:50:46.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.130440218s
Jan 19 02:50:48.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.129442522s
Jan 19 02:50:50.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.129220607s
Jan 19 02:50:52.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.12950822s
Jan 19 02:50:54.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.129809988s
Jan 19 02:50:56.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.130143723s
Jan 19 02:50:58.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.129238224s
Jan 19 02:51:00.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.130333098s
Jan 19 02:51:02.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.129681314s
Jan 19 02:51:04.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.130161482s
Jan 19 02:51:06.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.129751721s
Jan 19 02:51:08.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.130550224s
Jan 19 02:51:10.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.130098286s
Jan 19 02:51:12.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.129613751s
Jan 19 02:51:14.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.130017007s
Jan 19 02:51:16.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.129442945s
Jan 19 02:51:18.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.129654852s
Jan 19 02:51:20.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.130298912s
Jan 19 02:51:22.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.12935993s
Jan 19 02:51:24.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.130536676s
Jan 19 02:51:26.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.13008836s
Jan 19 02:51:28.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.12952988s
Jan 19 02:51:30.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.129531647s
Jan 19 02:51:32.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.129931617s
Jan 19 02:51:34.807: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.129844781s
Jan 19 02:51:36.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.130508954s
Jan 19 02:51:38.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.130455213s
Jan 19 02:51:40.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.130431785s
Jan 19 02:51:42.808: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.130241957s
Jan 19 02:51:42.872: INFO: Pod "pod-87600900-ab09-4695-a4b1-f510a9918667": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.194513061s
Jan 19 02:51:42.872: INFO: Unexpected error:
<*errors.errorString | 0xc001390c40>: {
s: "pod \"pod-87600900-ab09-4695-a4b1-f510a9918667\" is not Running: timed out while waiting for pod fsgroupchangepolicy-8904/pod-87600900-ab09-4695-a4b1-f510a9918667 to be running",
}
Jan 19 02:51:42.872: FAIL: pod "pod-87600900-ab09-4695-a4b1-f510a9918667" is not Running: timed out while waiting for pod fsgroupchangepolicy-8904/pod-87600900-ab09-4695-a4b1-f510a9918667 to be running
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc001776f00, 0xc005207e10, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/19/23 02:51:42.872�[0m
Jan 19 02:51:43.000: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comspd98"
Jan 19 02:51:43.071: INFO: Waiting up to 5m0s for PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c to get deleted
Jan 19 02:51:43.135: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (64.340894ms)
Jan 19 02:51:48.200: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (5.12926075s)
Jan 19 02:51:53.263: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (10.192699202s)
Jan 19 02:51:58.326: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (15.255750052s)
Jan 19 02:52:03.390: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (20.319107247s)
Jan 19 02:52:08.454: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (25.383399609s)
Jan 19 02:52:13.517: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (30.446414312s)
Jan 19 02:52:18.581: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (35.510564565s)
Jan 19 02:52:23.645: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (40.574491939s)
Jan 19 02:52:28.709: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (45.638870507s)
Jan 19 02:52:33.773: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (50.702483616s)
Jan 19 02:52:38.837: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (55.766361948s)
Jan 19 02:52:43.901: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m0.830268078s)
Jan 19 02:52:48.966: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m5.895489468s)
Jan 19 02:52:54.030: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m10.959080319s)
Jan 19 02:52:59.094: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m16.023066342s)
Jan 19 02:53:04.157: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m21.086857786s)
Jan 19 02:53:09.221: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m26.15069201s)
Jan 19 02:53:14.285: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m31.214275863s)
Jan 19 02:53:19.349: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m36.278325702s)
Jan 19 02:53:24.413: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m41.342505814s)
Jan 19 02:53:29.478: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m46.406940314s)
Jan 19 02:53:34.541: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m51.470807607s)
Jan 19 02:53:39.605: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (1m56.534510108s)
Jan 19 02:53:44.669: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m1.598511973s)
Jan 19 02:53:49.733: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m6.66196364s)
Jan 19 02:53:54.796: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m11.725647862s)
Jan 19 02:53:59.860: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m16.789522156s)
Jan 19 02:54:04.923: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m21.852825218s)
Jan 19 02:54:09.988: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m26.917288436s)
Jan 19 02:54:15.052: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m31.981021911s)
Jan 19 02:54:20.115: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m37.044619784s)
Jan 19 02:54:25.179: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m42.108484548s)
Jan 19 02:54:30.243: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m47.172369559s)
Jan 19 02:54:35.307: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m52.236156675s)
Jan 19 02:54:40.370: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (2m57.299691647s)
Jan 19 02:54:45.434: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m2.363490164s)
Jan 19 02:54:50.498: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m7.427251617s)
Jan 19 02:54:55.562: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m12.491466345s)
Jan 19 02:55:00.626: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m17.555423347s)
Jan 19 02:55:05.690: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m22.619179242s)
Jan 19 02:55:10.754: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m27.683638804s)
Jan 19 02:55:15.818: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m32.747522025s)
Jan 19 02:55:20.882: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m37.811081425s)
Jan 19 02:55:25.946: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m42.875520602s)
Jan 19 02:55:31.010: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m47.939107691s)
Jan 19 02:55:36.073: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m53.00233647s)
Jan 19 02:55:41.137: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (3m58.066703388s)
Jan 19 02:55:46.201: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m3.130247313s)
Jan 19 02:55:51.264: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m8.193823603s)
Jan 19 02:55:56.328: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m13.257656593s)
Jan 19 02:56:01.393: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m18.32236696s)
Jan 19 02:56:06.457: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m23.386452501s)
Jan 19 02:56:11.523: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m28.452586317s)
Jan 19 02:56:16.587: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m33.516519629s)
Jan 19 02:56:21.651: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m38.580784004s)
Jan 19 02:56:26.715: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m43.644170366s)
Jan 19 02:56:31.779: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m48.708152177s)
Jan 19 02:56:36.842: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m53.771831579s)
Jan 19 02:56:41.905: INFO: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c found and phase=Bound (4m58.834724896s)
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/19/23 02:56:46.906�[0m
Jan 19 02:56:46.970: INFO: Unexpected error: while cleanup resource:
<errors.aggregate | len:1, cap:1>: [
<errors.aggregate | len:1, cap:1>[
<*fmt.wrapError | 0xc005400300>{
msg: "persistent Volume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c not deleted by dynamic provisioner: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c still exists within 5m0s",
err: <*errors.errorString | 0xc001390890>{
s: "PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c still exists within 5m0s",
},
},
],
]
Jan 19 02:56:46.971: FAIL: while cleanup resource: persistent Volume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c not deleted by dynamic provisioner: PersistentVolume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c still exists within 5m0s
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:128 +0x14e
panic({0x70efe60, 0xc00084c380})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/test/e2e/framework.Fail({0xc0038ac9a0, 0xae}, {0xc0011ebc30?, 0xc0038ac9a0?, 0xc0011ebc58?})
test/e2e/framework/log.go:61 +0x145
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7fa8f20, 0xc001390c40}, {0x0?, 0x2?, 0x7fd3db4c9108?})
test/e2e/framework/expect.go:76 +0x267
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
test/e2e/framework/expect.go:43
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc001776f00, 0xc005207e10, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/node/init/init.go:32
Jan 19 02:56:46.971: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 02:56:47.035�[0m
�[1mSTEP:�[0m Collecting events from namespace "fsgroupchangepolicy-8904". �[38;5;243m01/19/23 02:56:47.035�[0m
�[1mSTEP:�[0m Found 16 events. �[38;5;243m01/19/23 02:56:47.098�[0m
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:46:42 +0000 UTC - event for ebs.csi.aws.comspd98: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:46:42 +0000 UTC - event for ebs.csi.aws.comspd98: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:46:42 +0000 UTC - event for ebs.csi.aws.comspd98: {ebs.csi.aws.com_i-098a14e8a4aca3f52_38e95677-9241-4a2a-b7ef-bdf40a9bc538 } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-8904/ebs.csi.aws.comspd98"
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:46:46 +0000 UTC - event for ebs.csi.aws.comspd98: {ebs.csi.aws.com_i-098a14e8a4aca3f52_38e95677-9241-4a2a-b7ef-bdf40a9bc538 } ProvisioningSucceeded: Successfully provisioned volume pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:46:46 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {default-scheduler } Scheduled: Successfully assigned fsgroupchangepolicy-8904/pod-87600900-ab09-4695-a4b1-f510a9918667 to i-0f8b7f8eacf81cd58
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:46:48 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-30e0601c-00d9-4d9b-933a-3bf7e3cc035c"
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:46:52 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "41b835f03acd83e159a861aec5d67d1d24f39c1b3eb03fc346342e9822e4c119": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:47:06 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "df374a59f7b6621cc6f6bb277eaa2c0e12fc0526a24fbb0ded55a12a1dcb983c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:47:20 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2c8c6def54b3a10c5cf98904a9a86a3a4f033162d3940e59d255d08ea3d168df": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:47:35 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4859579cb0764995b9d65b9be5af3784340659efc8ff26230893cbca91fdb19e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:47:46 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c355990d6940f43c56842756c4e9a7af8fcd085a8a66e9e91305757f5ab5e096": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:48:00 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ff4912c1daee45194e4b5eb95b39d3fd76c10891f24b01273407e8bdcd520182": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:48:13 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "738b413a6339eff8cc1ee973d1770da9839c4275e0d24a2eb38118826f545042": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:48:25 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b7ba0b7bf4385605651e55f7f0796ab09f2f17029c04c21d52a2b4db5d09c5ed": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:48:40 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5668737bf6a992b91cbf2584b6728b69d3687c359391b9ffb1862ce176c9bed4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:56:47.099: INFO: At 2023-01-19 02:48:53 +0000 UTC - event for pod-87600900-ab09-4695-a4b1-f510a9918667: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "14f07b716dcc32eb7ba3988a1427a60dd85a1348eb0e9c8b946b2c9b9f6a71e7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:56:47.161: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 19 02:56:47.161: INFO: pod-87600900-ab09-4695-a4b1-f510a9918667 i-0f8b7f8eacf81cd58 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:46:46 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:46:46 +0000 UTC ContainersNotReady containers with unready status: [write-pod]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:46:46 +0000 UTC ContainersNotReady containers with unready status: [write-pod]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:46:46 +0000 UTC }]
Jan 19 02:56:47.161: INFO:
Jan 19 02:56:47.226: INFO: Unable to fetch fsgroupchangepolicy-8904/pod-87600900-ab09-4695-a4b1-f510a9918667/write-pod logs: the server rejected our request for an unknown reason (get pods pod-87600900-ab09-4695-a4b1-f510a9918667)
Jan 19 02:56:47.292: INFO:
Logging node info for node i-023e074b52731ec5a
Jan 19 02:56:47.354: INFO: Node Info: &Node{ObjectMeta:{i-023e074b52731ec5a e961fee7-3382-47b0-8744-433e44345d0f 22429 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-023e074b52731ec5a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-023e074b52731ec5a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.43 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-023e074b52731ec5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:56:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-023e074b52731ec5a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:47 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.43,},NodeAddress{Type:ExternalIP,Address:35.163.72.25,},NodeAddress{Type:InternalDNS,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-163-72-25.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2fdc458699464b606b9fca6747bb8e,SystemUUID:ec2fdc45-8699-464b-606b-9fca6747bb8e,BootID:c860ef30-1fd7-41be-b096-79723bc17c52,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 02:56:47.355: INFO:
Logging kubelet events for node i-023e074b52731ec5a
Jan 19 02:56:47.426: INFO:
Logging pods the kubelet thinks is on node i-023e074b52731ec5a
Jan 19 02:56:47.497: INFO: coredns-559769c974-tc4gk started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Container coredns ready: true, restart count 0
Jan 19 02:56:47.497: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gzrm9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.497: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-px9wv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0
Jan 19 02:56:47.497: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-kmq27 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.497: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nlzkq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.497: INFO: cilium-4xgjg started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:56:47.497: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:56:47.497: INFO: coredns-autoscaler-7cb5c5b969-pkb4q started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Container autoscaler ready: true, restart count 0
Jan 19 02:56:47.497: INFO: hostexec-i-023e074b52731ec5a-7pkmp started at 2023-01-19 02:53:40 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:56:47.497: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z97mx started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.497: INFO: pod-subpath-test-preprovisionedpv-7z5f started at 2023-01-19 02:53:56 +0000 UTC (2+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Init container init-volume-preprovisionedpv-7z5f ready: true, restart count 0
Jan 19 02:56:47.497: INFO: Init container test-init-volume-preprovisionedpv-7z5f ready: true, restart count 0
Jan 19 02:56:47.497: INFO: Container test-container-subpath-preprovisionedpv-7z5f ready: false, restart count 0
Jan 19 02:56:47.497: INFO: pod-d9db111b-e3ea-492e-8d92-f800d7e5eb72 started at 2023-01-19 02:54:00 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Container write-pod ready: false, restart count 0
Jan 19 02:56:47.497: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dzctr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.497: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.497: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nztbv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.498: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.498: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-fqdth started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.498: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.498: INFO: ebs-csi-node-txkj8 started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:56:47.498: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:56:47.498: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:56:47.498: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:56:47.498: INFO: hostexec-i-023e074b52731ec5a-54hsp started at 2023-01-19 02:53:57 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.498: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:56:47.498: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-k7tm4 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.498: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.498: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-rbxbc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.498: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.498: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:51:28 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:56:47.498: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 02:56:47.498: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 02:56:47.498: INFO: Container csi-resizer ready: false, restart count 0
Jan 19 02:56:47.498: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 19 02:56:47.498: INFO: Container hostpath ready: false, restart count 0
Jan 19 02:56:47.498: INFO: Container liveness-probe ready: false, restart count 0
Jan 19 02:56:47.498: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 19 02:56:47.498: INFO: csi-mockplugin-0 started at 2023-01-19 02:55:03 +0000 UTC (0+4 container statuses recorded)
Jan 19 02:56:47.498: INFO: Container busybox ready: false, restart count 0
Jan 19 02:56:47.498: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 02:56:47.498: INFO: Container driver-registrar ready: false, restart count 0
Jan 19 02:56:47.498: INFO: Container mock ready: false, restart count 0
Jan 19 02:56:47.777: INFO:
Latency metrics for node i-023e074b52731ec5a
Jan 19 02:56:47.777: INFO:
Logging node info for node i-02d86c0c31a5b3e66
Jan 19 02:56:47.840: INFO: Node Info: &Node{ObjectMeta:{i-02d86c0c31a5b3e66 2b72ee85-8a44-46ad-89d8-94df5d455adf 21681 0 2023-01-19 02:33:41 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02d86c0c31a5b3e66 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-02d86c0c31a5b3e66 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.52.66 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3594":"i-02d86c0c31a5b3e66","ebs.csi.aws.com":"i-02d86c0c31a5b3e66"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:54:17 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:54:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-02d86c0c31a5b3e66,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.52.66,},NodeAddress{Type:ExternalIP,Address:54.218.213.176,},NodeAddress{Type:InternalDNS,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-218-213-176.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2854d64f7363e92b7b006397583f0a,SystemUUID:ec2854d6-4f73-63e9-2b7b-006397583f0a,BootID:a64d8535-a0a2-421b-b474-ed26b967c37a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-3594^900045cd-97a4-11ed-af43-d6e7a8e15f2d kubernetes.io/csi/csi-hostpath-ephemeral-3594^90009a58-97a4-11ed-af43-d6e7a8e15f2d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3594^90009a58-97a4-11ed-af43-d6e7a8e15f2d,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3594^900045cd-97a4-11ed-af43-d6e7a8e15f2d,DevicePath:,},},Config:nil,},}
Jan 19 02:56:47.840: INFO:
Logging kubelet events for node i-02d86c0c31a5b3e66
Jan 19 02:56:47.905: INFO:
Logging pods the kubelet thinks is on node i-02d86c0c31a5b3e66
Jan 19 02:56:47.976: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:53:05 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:56:47.976: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:56:47.976: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:56:47.976: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 19 02:56:47.976: INFO: Container hostpath ready: true, restart count 0
Jan 19 02:56:47.976: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:56:47.976: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:56:47.976: INFO: ebs-csi-node-vnlk5 started at 2023-01-19 02:33:41 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:56:47.976: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:56:47.976: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:56:47.976: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-46kbx started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.976: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-jq8pp started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.976: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-wm87d started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.976: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-thtlz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.976: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gqbwh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.976: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-njqx8 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.976: INFO: coredns-559769c974-jhsx5 started at 2023-01-19 02:34:10 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container coredns ready: true, restart count 0
Jan 19 02:56:47.976: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hgwmq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.976: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4pps started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.976: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-r25l2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.976: INFO: cilium-dpz9q started at 2023-01-19 02:33:41 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:56:47.976: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:56:47.976: INFO: hostexec-i-02d86c0c31a5b3e66-c6b9d started at 2023-01-19 02:56:47 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container agnhost-container ready: false, restart count 0
Jan 19 02:56:47.976: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hkqgk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:47.976: INFO: inline-volume-tester-7nwl6 started at 2023-01-19 02:54:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:47.976: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:56:48.279: INFO:
Latency metrics for node i-02d86c0c31a5b3e66
Jan 19 02:56:48.279: INFO:
Logging node info for node i-08066f65509d69679
Jan 19 02:56:48.342: INFO: Node Info: &Node{ObjectMeta:{i-08066f65509d69679 0be3effa-655e-4b68-9a19-46c9ab83ba9a 21453 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08066f65509d69679 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-08066f65509d69679 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.217 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1190":"i-08066f65509d69679","ebs.csi.aws.com":"i-08066f65509d69679"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:48:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:53:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-08066f65509d69679,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:53:49 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:53:49 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:53:49 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:53:49 +0000 UTC,LastTransitionTime:2023-01-19 02:33:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.217,},NodeAddress{Type:ExternalIP,Address:52.35.165.136,},NodeAddress{Type:InternalDNS,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-35-165-136.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ef74bd259aa6181a8189c00469b84,SystemUUID:ec2ef74b-d259-aa61-81a8-189c00469b84,BootID:14a8f3be-4273-41bf-906d-a4c0fdb82ba0,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1190^873e76ca-97a3-11ed-b258-d2540af1607e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1190^873e76ca-97a3-11ed-b258-d2540af1607e,DevicePath:,},},Config:nil,},}
Jan 19 02:56:48.342: INFO:
Logging kubelet events for node i-08066f65509d69679
Jan 19 02:56:48.407: INFO:
Logging pods the kubelet thinks is on node i-08066f65509d69679
Jan 19 02:56:48.478: INFO: cilium-c7s4l started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:56:48.478: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:56:48.478: INFO: pod-1 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container donothing ready: true, restart count 0
Jan 19 02:56:48.478: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-qr89m started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:48.478: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5mxxc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:48.478: INFO: rc-test-2jq8d started at 2023-01-19 02:47:08 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container rc-test ready: false, restart count 0
Jan 19 02:56:48.478: INFO: externalname-service-f9p78 started at 2023-01-19 02:56:07 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container externalname-service ready: false, restart count 0
Jan 19 02:56:48.478: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:56:32 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 02:56:48.478: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 02:56:48.478: INFO: Container csi-resizer ready: false, restart count 0
Jan 19 02:56:48.478: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 19 02:56:48.478: INFO: Container hostpath ready: false, restart count 0
Jan 19 02:56:48.478: INFO: Container liveness-probe ready: false, restart count 0
Jan 19 02:56:48.478: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 19 02:56:48.478: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5prrc started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:48.478: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dvwqc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:48.478: INFO: inline-volume-tester-kg7wv started at 2023-01-19 02:46:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:56:48.478: INFO: pod-subpath-test-inlinevolume-fq8p started at 2023-01-19 02:52:44 +0000 UTC (1+2 container statuses recorded)
Jan 19 02:56:48.478: INFO: Init container test-init-subpath-inlinevolume-fq8p ready: false, restart count 0
Jan 19 02:56:48.478: INFO: Container test-container-subpath-inlinevolume-fq8p ready: false, restart count 0
Jan 19 02:56:48.478: INFO: Container test-container-volume-inlinevolume-fq8p ready: false, restart count 0
Jan 19 02:56:48.478: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-tvhph started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:48.478: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-49t56 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:48.478: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z4wjr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:48.478: INFO: agnhost-primary-t6mr6 started at 2023-01-19 02:52:03 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container agnhost-primary ready: false, restart count 0
Jan 19 02:56:48.478: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-sshfj started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:48.478: INFO: httpd started at 2023-01-19 02:52:05 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container httpd ready: false, restart count 0
Jan 19 02:56:48.478: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:42:03 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:56:48.478: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:56:48.478: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:56:48.478: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 19 02:56:48.478: INFO: Container hostpath ready: true, restart count 0
Jan 19 02:56:48.478: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:56:48.478: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:56:48.478: INFO: pod-0 started at 2023-01-19 02:52:12 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container donothing ready: false, restart count 0
Jan 19 02:56:48.478: INFO: ebs-csi-node-szxtn started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:56:48.478: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:56:48.478: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:56:48.478: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-266nr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:48.478: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-cqpsv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.478: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:48.776: INFO:
Latency metrics for node i-08066f65509d69679
Jan 19 02:56:48.776: INFO:
Logging node info for node i-098a14e8a4aca3f52
Jan 19 02:56:48.839: INFO: Node Info: &Node{ObjectMeta:{i-098a14e8a4aca3f52 7d2548e6-f0b4-43c4-880f-93f669b42eab 21756 0 2023-01-19 02:32:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-098a14e8a4aca3f52 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.164 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-098a14e8a4aca3f52"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 02:32:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-19 02:32:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:32:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 02:54:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-098a14e8a4aca3f52,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.164,},NodeAddress{Type:ExternalIP,Address:35.89.228.171,},NodeAddress{Type:InternalDNS,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-89-228-171.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2da2cd6ae96e63652bd883a94f495c,SystemUUID:ec2da2cd-6ae9-6e63-652b-d883a94f495c,BootID:7a95f25a-dfd5-459e-b4a5-db275a1b4e67,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191755,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821707,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965792,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 02:56:48.840: INFO:
Logging kubelet events for node i-098a14e8a4aca3f52
Jan 19 02:56:48.913: INFO:
Logging pods the kubelet thinks is on node i-098a14e8a4aca3f52
Jan 19 02:56:48.985: INFO: aws-cloud-controller-manager-4c7k7 started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.985: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 19 02:56:48.985: INFO: kops-controller-rkkdt started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.985: INFO: Container kops-controller ready: true, restart count 0
Jan 19 02:56:48.985: INFO: etcd-manager-events-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.985: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 02:56:48.985: INFO: etcd-manager-main-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.985: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 02:56:48.985: INFO: kube-apiserver-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+2 container statuses recorded)
Jan 19 02:56:48.985: INFO: Container healthcheck ready: true, restart count 0
Jan 19 02:56:48.985: INFO: Container kube-apiserver ready: true, restart count 1
Jan 19 02:56:48.985: INFO: ebs-csi-node-trsl9 started at 2023-01-19 02:32:40 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:56:48.985: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:56:48.985: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:56:48.985: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:56:48.985: INFO: cilium-knt4k started at 2023-01-19 02:32:40 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:56:48.985: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:56:48.985: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:56:48.985: INFO: kube-controller-manager-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.985: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 19 02:56:48.985: INFO: kube-scheduler-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.985: INFO: Container kube-scheduler ready: true, restart count 0
Jan 19 02:56:48.985: INFO: cilium-operator-6f8d6c4bf-tr54z started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.985: INFO: Container cilium-operator ready: true, restart count 0
Jan 19 02:56:48.985: INFO: ebs-csi-controller-89bddb897-vfp22 started at 2023-01-19 02:32:43 +0000 UTC (0+5 container statuses recorded)
Jan 19 02:56:48.985: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:56:48.985: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:56:48.985: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:56:48.985: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:56:48.985: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:56:48.985: INFO: dns-controller-74d4646d88-9znsr started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:48.985: INFO: Container dns-controller ready: true, restart count 0
Jan 19 02:56:49.244: INFO:
Latency metrics for node i-098a14e8a4aca3f52
Jan 19 02:56:49.244: INFO:
Logging node info for node i-0f8b7f8eacf81cd58
Jan 19 02:56:49.307: INFO: Node Info: &Node{ObjectMeta:{i-0f8b7f8eacf81cd58 969780cc-600f-4d79-80fa-2e681c67e470 21787 0 2023-01-19 02:33:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f8b7f8eacf81cd58 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-0f8b7f8eacf81cd58 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f8b7f8eacf81cd58"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:54:50 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:54:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0f8b7f8eacf81cd58,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:50 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:50 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:50 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:54:50 +0000 UTC,LastTransitionTime:2023-01-19 02:33:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.113,},NodeAddress{Type:ExternalIP,Address:54.188.219.55,},NodeAddress{Type:InternalDNS,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-188-219-55.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec296be3bda6a5cf5f1cfc033b1bb6bb,SystemUUID:ec296be3-bda6-a5cf-5f1c-fc033b1bb6bb,BootID:2cccdc7f-1458-4e66-9053-d2f4c0f3fc70,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00293629c9f01aed3 kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00293629c9f01aed3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a,DevicePath:,},},Config:nil,},}
Jan 19 02:56:49.307: INFO:
Logging kubelet events for node i-0f8b7f8eacf81cd58
Jan 19 02:56:49.372: INFO:
Logging pods the kubelet thinks is on node i-0f8b7f8eacf81cd58
Jan 19 02:56:49.447: INFO: hostexec-i-0f8b7f8eacf81cd58-wmb8f started at 2023-01-19 02:52:25 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:56:49.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dw974 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:49.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hb6r2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:49.447: INFO: ebs-csi-node-x2rds started at 2023-01-19 02:33:37 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:56:49.447: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:56:49.447: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:56:49.447: INFO: suspend-true-to-false-gvdhj started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container c ready: false, restart count 0
Jan 19 02:56:49.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-bd6fk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:49.447: INFO: pod-0 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container donothing ready: true, restart count 0
Jan 19 02:56:49.447: INFO: suspend-true-to-false-qkh4c started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container c ready: false, restart count 0
Jan 19 02:56:49.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-c8gns started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:49.447: INFO: suspend-true-to-false-s5btk started at 2023-01-19 02:42:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container c ready: false, restart count 0
Jan 19 02:56:49.447: INFO: pod-subpath-test-preprovisionedpv-n92q started at 2023-01-19 02:52:41 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Init container init-volume-preprovisionedpv-n92q ready: false, restart count 0
Jan 19 02:56:49.447: INFO: Container test-container-subpath-preprovisionedpv-n92q ready: false, restart count 0
Jan 19 02:56:49.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-m7587 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:49.447: INFO: probe-test-126ae020-cadf-4777-bb25-ed14ee1ae642 started at 2023-01-19 02:56:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container probe-test-126ae020-cadf-4777-bb25-ed14ee1ae642 ready: false, restart count 0
Jan 19 02:56:49.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4hdh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:49.447: INFO: pod-2 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container donothing ready: false, restart count 0
Jan 19 02:56:49.447: INFO: rc-test-qn447 started at 2023-01-19 02:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container rc-test ready: true, restart count 0
Jan 19 02:56:49.447: INFO: inline-volume-tester-m6c6d started at 2023-01-19 02:47:11 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:56:49.447: INFO: pod-3fa88a33-3e62-47c0-8c83-7da7fa62fd26 started at 2023-01-19 02:52:11 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container write-pod ready: false, restart count 0
Jan 19 02:56:49.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8cnst started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:49.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-t8z58 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:49.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-72jsz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:49.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8vqd9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:56:49.447: INFO: hostexec-i-0f8b7f8eacf81cd58-x92jz started at 2023-01-19 02:52:02 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:56:49.447: INFO: pod-87600900-ab09-4695-a4b1-f510a9918667 started at 2023-01-19 02:46:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container write-pod ready: false, restart count 0
Jan 19 02:56:49.447: INFO: cilium-mpc7m started at 2023-01-19 02:33:37 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:56:49.447: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:56:49.447: INFO: dns-test-b47ec622-3c9e-4a50-8572-e5911975e43a started at 2023-01-19 02:54:10 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container jessie-querier ready: false, restart count 0
Jan 19 02:56:49.447: INFO: Container querier ready: false, restart count 0
Jan 19 02:56:49.447: INFO: Container webserver ready: false, restart count 0
Jan 19 02:56:49.447: INFO: externalname-service-cr8rp started at 2023-01-19 02:56:07 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:56:49.447: INFO: Container externalname-service ready: false, restart count 0
Jan 19 02:56:49.708: INFO:
Latency metrics for node i-0f8b7f8eacf81cd58
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "fsgroupchangepolicy-8904" for this suite. �[38;5;243m01/19/23 02:56:49.708�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(ext4\)\]\svolumes\sshould\sallow\sexec\sof\sfiles\son\sthe\svolume$'
test/e2e/framework/pod/output/output.go:237
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc003b62450?, {0x75eb81c?, 0x0?}, 0xc00444d680, 0x0, {0xc001c7beb8, 0x1, 0x1}, 0x0?)
test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/storage/testsuites.testScriptInPod(0xc00173de00, {0x75c9b48?, 0x1?}, 0xc000da61e0, 0xc003610960)
test/e2e/storage/testsuites/volumes.go:254 +0x6aa
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func4()
test/e2e/storage/testsuites/volumes.go:200 +0xb1
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 02:41:48.507�[0m
Jan 19 02:41:48.507: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename volume �[38;5;243m01/19/23 02:41:48.508�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 02:41:48.708�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 02:41:48.84�[0m
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
test/e2e/framework/metrics/init/init.go:31
[It] should allow exec of files on the volume
test/e2e/storage/testsuites/volumes.go:195
Jan 19 02:41:48.971: INFO: Creating resource for dynamic PV
Jan 19 02:41:48.971: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass volume-5794-e2e-schlgtz �[38;5;243m01/19/23 02:41:48.972�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/19/23 02:41:49.04�[0m
Jan 19 02:41:49.041: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating pod exec-volume-test-dynamicpv-dlxc �[38;5;243m01/19/23 02:41:49.176�[0m
�[1mSTEP:�[0m Creating a pod to test exec-volume-test �[38;5;243m01/19/23 02:41:49.176�[0m
Jan 19 02:41:49.244: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-dlxc" in namespace "volume-5794" to be "Succeeded or Failed"
Jan 19 02:41:49.311: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 67.108382ms
Jan 19 02:41:51.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.133744281s
Jan 19 02:41:53.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.134329885s
Jan 19 02:41:55.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 6.135538589s
Jan 19 02:41:57.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 8.134239273s
Jan 19 02:41:59.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 10.134473328s
Jan 19 02:42:01.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 12.134246349s
Jan 19 02:42:03.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 14.134140428s
Jan 19 02:42:05.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 16.134456436s
Jan 19 02:42:07.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 18.133987046s
Jan 19 02:42:09.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 20.13498478s
Jan 19 02:42:11.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 22.134706969s
Jan 19 02:42:13.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 24.134662014s
Jan 19 02:42:15.453: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 26.20954901s
Jan 19 02:42:17.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 28.134166992s
Jan 19 02:42:19.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 30.134347491s
Jan 19 02:42:21.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 32.133963025s
Jan 19 02:42:23.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 34.133785833s
Jan 19 02:42:25.381: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 36.137304385s
Jan 19 02:42:27.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 38.134522533s
Jan 19 02:42:29.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 40.134407271s
Jan 19 02:42:31.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 42.134369092s
Jan 19 02:42:33.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 44.133525283s
Jan 19 02:42:35.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 46.134456265s
Jan 19 02:42:37.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 48.134389587s
Jan 19 02:42:39.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 50.134340068s
Jan 19 02:42:41.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 52.134676521s
Jan 19 02:42:43.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 54.13437415s
Jan 19 02:42:45.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 56.134523208s
Jan 19 02:42:47.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 58.134590245s
Jan 19 02:42:49.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.134320681s
Jan 19 02:42:51.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.134467585s
Jan 19 02:42:53.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.13370654s
Jan 19 02:42:55.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.134845697s
Jan 19 02:42:57.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.133746653s
Jan 19 02:42:59.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.134954708s
Jan 19 02:43:01.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.134315672s
Jan 19 02:43:03.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.133918317s
Jan 19 02:43:05.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.134221405s
Jan 19 02:43:07.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.134453376s
Jan 19 02:43:09.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.134621975s
Jan 19 02:43:11.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.134616884s
Jan 19 02:43:13.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.134294616s
Jan 19 02:43:15.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.134406806s
Jan 19 02:43:17.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.133877199s
Jan 19 02:43:19.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.133808718s
Jan 19 02:43:21.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.13416395s
Jan 19 02:43:23.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.134553353s
Jan 19 02:43:25.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.134671841s
Jan 19 02:43:27.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.134466752s
Jan 19 02:43:29.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.133871566s
Jan 19 02:43:31.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.134511972s
Jan 19 02:43:33.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.135034027s
Jan 19 02:43:35.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.133981833s
Jan 19 02:43:37.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.134381762s
Jan 19 02:43:39.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.134100818s
Jan 19 02:43:41.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.133975073s
Jan 19 02:43:43.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.13449168s
Jan 19 02:43:45.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.1344694s
Jan 19 02:43:47.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.134147194s
Jan 19 02:43:49.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.134007144s
Jan 19 02:43:51.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.133927284s
Jan 19 02:43:53.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.13358464s
Jan 19 02:43:55.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.134872788s
Jan 19 02:43:57.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.134637878s
Jan 19 02:43:59.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.134852991s
Jan 19 02:44:01.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.134854945s
Jan 19 02:44:03.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.134082234s
Jan 19 02:44:05.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.134193211s
Jan 19 02:44:07.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.134129204s
Jan 19 02:44:09.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.134376168s
Jan 19 02:44:11.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.134020694s
Jan 19 02:44:13.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.134465563s
Jan 19 02:44:15.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.134349276s
Jan 19 02:44:17.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.134522181s
Jan 19 02:44:19.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.134040803s
Jan 19 02:44:21.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.133792473s
Jan 19 02:44:23.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.134334477s
Jan 19 02:44:25.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.134543774s
Jan 19 02:44:27.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.13475882s
Jan 19 02:44:29.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.134355673s
Jan 19 02:44:31.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.134641691s
Jan 19 02:44:33.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.133787415s
Jan 19 02:44:35.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.134373257s
Jan 19 02:44:37.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.134600661s
Jan 19 02:44:39.380: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.136063426s
Jan 19 02:44:41.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.134313073s
Jan 19 02:44:43.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.134406728s
Jan 19 02:44:45.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.134569417s
Jan 19 02:44:47.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.134524134s
Jan 19 02:44:49.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.134309058s
Jan 19 02:44:51.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.134045649s
Jan 19 02:44:53.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.13466329s
Jan 19 02:44:55.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.134627283s
Jan 19 02:44:57.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.13472163s
Jan 19 02:44:59.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.135220671s
Jan 19 02:45:01.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.134639124s
Jan 19 02:45:03.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.134242917s
Jan 19 02:45:05.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.134678749s
Jan 19 02:45:07.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.134289611s
Jan 19 02:45:09.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.134066507s
Jan 19 02:45:11.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.134291191s
Jan 19 02:45:13.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.133844257s
Jan 19 02:45:15.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.13441583s
Jan 19 02:45:17.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.134847378s
Jan 19 02:45:19.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.134893743s
Jan 19 02:45:21.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.134287687s
Jan 19 02:45:23.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.134744158s
Jan 19 02:45:25.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.134633054s
Jan 19 02:45:27.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.13513356s
Jan 19 02:45:29.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.13464075s
Jan 19 02:45:31.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.134524538s
Jan 19 02:45:33.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.134263235s
Jan 19 02:45:35.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.13360656s
Jan 19 02:45:37.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.133771023s
Jan 19 02:45:39.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.134456665s
Jan 19 02:45:41.381: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.137533438s
Jan 19 02:45:43.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.134433362s
Jan 19 02:45:45.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.134344772s
Jan 19 02:45:47.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.134660744s
Jan 19 02:45:49.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.13401769s
Jan 19 02:45:51.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.134788829s
Jan 19 02:45:53.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.134372576s
Jan 19 02:45:55.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.134113229s
Jan 19 02:45:57.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.133527915s
Jan 19 02:45:59.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.133641317s
Jan 19 02:46:01.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.134258273s
Jan 19 02:46:03.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.134638043s
Jan 19 02:46:05.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.13351649s
Jan 19 02:46:07.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.134465017s
Jan 19 02:46:09.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.1342369s
Jan 19 02:46:11.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.134168242s
Jan 19 02:46:13.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.134394439s
Jan 19 02:46:15.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.134816884s
Jan 19 02:46:17.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.134414159s
Jan 19 02:46:19.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.134379775s
Jan 19 02:46:21.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.133710719s
Jan 19 02:46:23.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.134353903s
Jan 19 02:46:25.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.134420024s
Jan 19 02:46:27.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.134051491s
Jan 19 02:46:29.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.134150414s
Jan 19 02:46:31.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.134718283s
Jan 19 02:46:33.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.133872496s
Jan 19 02:46:35.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.134353863s
Jan 19 02:46:37.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.1345765s
Jan 19 02:46:39.377: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.133626762s
Jan 19 02:46:41.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.134308818s
Jan 19 02:46:43.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.134305276s
Jan 19 02:46:45.379: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.135221578s
Jan 19 02:46:47.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.134721892s
Jan 19 02:46:49.378: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.134284093s
Jan 19 02:46:49.444: INFO: Pod "exec-volume-test-dynamicpv-dlxc": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.200497974s
Jan 19 02:46:49.580: INFO: Failed to get logs from node "i-0f8b7f8eacf81cd58" pod "exec-volume-test-dynamicpv-dlxc" container "exec-container-dynamicpv-dlxc": the server rejected our request for an unknown reason (get pods exec-volume-test-dynamicpv-dlxc)
�[1mSTEP:�[0m delete the pod �[38;5;243m01/19/23 02:46:49.58�[0m
Jan 19 02:46:49.648: INFO: Waiting for pod exec-volume-test-dynamicpv-dlxc to disappear
Jan 19 02:46:49.715: INFO: Pod exec-volume-test-dynamicpv-dlxc still exists
Jan 19 02:46:51.715: INFO: Waiting for pod exec-volume-test-dynamicpv-dlxc to disappear
Jan 19 02:46:51.782: INFO: Pod exec-volume-test-dynamicpv-dlxc no longer exists
Jan 19 02:46:51.782: INFO: Unexpected error:
<*errors.errorString | 0xc000de5f40>: {
s: "expected pod \"exec-volume-test-dynamicpv-dlxc\" success: timed out while waiting for pod volume-5794/exec-volume-test-dynamicpv-dlxc to be Succeeded or Failed",
}
Jan 19 02:46:51.782: FAIL: expected pod "exec-volume-test-dynamicpv-dlxc" success: timed out while waiting for pod volume-5794/exec-volume-test-dynamicpv-dlxc to be Succeeded or Failed
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc003b62450?, {0x75eb81c?, 0x0?}, 0xc00444d680, 0x0, {0xc001c7beb8, 0x1, 0x1}, 0x0?)
test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/storage/testsuites.testScriptInPod(0xc00173de00, {0x75c9b48?, 0x1?}, 0xc000da61e0, 0xc003610960)
test/e2e/storage/testsuites/volumes.go:254 +0x6aa
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func4()
test/e2e/storage/testsuites/volumes.go:200 +0xb1
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/19/23 02:46:51.782�[0m
Jan 19 02:46:51.921: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comxmw24"
Jan 19 02:46:51.993: INFO: Waiting up to 5m0s for PersistentVolume pvc-385c1dd9-1bb9-4279-9f90-4a79c2fd59ad to get deleted
Jan 19 02:46:52.059: INFO: PersistentVolume pvc-385c1dd9-1bb9-4279-9f90-4a79c2fd59ad found and phase=Released (65.882453ms)
Jan 19 02:46:57.126: INFO: PersistentVolume pvc-385c1dd9-1bb9-4279-9f90-4a79c2fd59ad found and phase=Released (5.132897825s)
Jan 19 02:47:02.193: INFO: PersistentVolume pvc-385c1dd9-1bb9-4279-9f90-4a79c2fd59ad was removed
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/19/23 02:47:02.193�[0m
[AfterEach] [Testpattern: Dynamic PV (ext4)] volumes
test/e2e/framework/node/init/init.go:32
Jan 19 02:47:02.263: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 02:47:02.332�[0m
�[1mSTEP:�[0m Collecting events from namespace "volume-5794". �[38;5;243m01/19/23 02:47:02.332�[0m
�[1mSTEP:�[0m Found 16 events. �[38;5;243m01/19/23 02:47:02.399�[0m
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:41:49 +0000 UTC - event for ebs.csi.aws.comxmw24: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:41:49 +0000 UTC - event for ebs.csi.aws.comxmw24: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:41:49 +0000 UTC - event for ebs.csi.aws.comxmw24: {ebs.csi.aws.com_i-098a14e8a4aca3f52_38e95677-9241-4a2a-b7ef-bdf40a9bc538 } Provisioning: External provisioner is provisioning volume for claim "volume-5794/ebs.csi.aws.comxmw24"
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:41:52 +0000 UTC - event for ebs.csi.aws.comxmw24: {ebs.csi.aws.com_i-098a14e8a4aca3f52_38e95677-9241-4a2a-b7ef-bdf40a9bc538 } ProvisioningSucceeded: Successfully provisioned volume pvc-385c1dd9-1bb9-4279-9f90-4a79c2fd59ad
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:41:53 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {default-scheduler } Scheduled: Successfully assigned volume-5794/exec-volume-test-dynamicpv-dlxc to i-0f8b7f8eacf81cd58
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:41:55 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-385c1dd9-1bb9-4279-9f90-4a79c2fd59ad"
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:41:56 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "59a9bc52a0d76abe055c7fee153752745383cc8fdaa4a597629fab0f0adb1c6c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:42:07 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "106d0e84331331baaa1a3218b84548c96225e33f01e4d98ca49dd4e6fc5b5cbf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:42:19 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4bb56d856dba968b4a4272d01fca65e9dc0b91fb1d7b8913f1fd4283e2b55faa": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:42:33 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f6b09c1e4ab7f93c2afa81fef9ad5e29bbd6d9ca9a9d314ad8e417e20821eb0e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:42:46 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7b22da2b7e2be3186be4ce87d0cd095b2be03bf684a1cbf7ca1b6c8fe6049d3d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:43:01 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "65afc509b92c2b09f6cd397e14dff6cffd23eac1a3e2c5d74020fe72e9c6ccdd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:43:14 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "059ad80813999b13fac6ad85fb292d7827dae8cd3652f09198e9909a1fbfeb8c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:43:30 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2e77a0a18b9cbd7b01fe55bab0eb481bfa59746c25ad358ea42a6f0df5955be5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:43:41 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1e82078ba242dff2c4e02cefa68e42d96e874ed0987c62f6112d52c5d81a77a2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:47:02.399: INFO: At 2023-01-19 02:43:52 +0000 UTC - event for exec-volume-test-dynamicpv-dlxc: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4762547a921ea2850cd59a8994ff3c3304cf8747c143af53dbea87c68a69020f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:47:02.465: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 19 02:47:02.465: INFO:
Jan 19 02:47:02.533: INFO:
Logging node info for node i-023e074b52731ec5a
Jan 19 02:47:02.600: INFO: Node Info: &Node{ObjectMeta:{i-023e074b52731ec5a e961fee7-3382-47b0-8744-433e44345d0f 18299 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-023e074b52731ec5a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-023e074b52731ec5a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.43 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1903":"i-023e074b52731ec5a","ebs.csi.aws.com":"i-023e074b52731ec5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:46:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-023e074b52731ec5a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:22 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:22 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:22 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:46:22 +0000 UTC,LastTransitionTime:2023-01-19 02:33:47 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.43,},NodeAddress{Type:ExternalIP,Address:35.163.72.25,},NodeAddress{Type:InternalDNS,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-163-72-25.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2fdc458699464b606b9fca6747bb8e,SystemUUID:ec2fdc45-8699-464b-606b-9fca6747bb8e,BootID:c860ef30-1fd7-41be-b096-79723bc17c52,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 02:47:02.601: INFO:
Logging kubelet events for node i-023e074b52731ec5a
Jan 19 02:47:02.669: INFO:
Logging pods the kubelet thinks is on node i-023e074b52731ec5a
Jan 19 02:47:02.808: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z97mx started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:02.808: INFO: cilium-4xgjg started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:47:02.808: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:47:02.808: INFO: coredns-autoscaler-7cb5c5b969-pkb4q started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container autoscaler ready: true, restart count 0
Jan 19 02:47:02.808: INFO: affinity-clusterip-timeout-4hdhw started at 2023-01-19 02:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container affinity-clusterip-timeout ready: false, restart count 0
Jan 19 02:47:02.808: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:41:27 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:47:02.808: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:47:02.808: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:47:02.808: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 19 02:47:02.808: INFO: Container hostpath ready: true, restart count 0
Jan 19 02:47:02.808: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:47:02.808: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:47:02.808: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dzctr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:02.808: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nztbv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:02.808: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-fqdth started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:02.808: INFO: ebs-csi-node-txkj8 started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:47:02.808: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:47:02.808: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:47:02.808: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-k7tm4 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:02.808: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-rbxbc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:02.808: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nlzkq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:02.808: INFO: inline-volume-tester-drdvw started at 2023-01-19 02:41:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:47:02.808: INFO: coredns-559769c974-tc4gk started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container coredns ready: true, restart count 0
Jan 19 02:47:02.808: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gzrm9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:02.808: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-px9wv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0
Jan 19 02:47:02.808: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-kmq27 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:02.808: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.081: INFO:
Latency metrics for node i-023e074b52731ec5a
Jan 19 02:47:03.081: INFO:
Logging node info for node i-02d86c0c31a5b3e66
Jan 19 02:47:03.147: INFO: Node Info: &Node{ObjectMeta:{i-02d86c0c31a5b3e66 2b72ee85-8a44-46ad-89d8-94df5d455adf 19010 0 2023-01-19 02:33:41 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02d86c0c31a5b3e66 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-02d86c0c31a5b3e66 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.52.66 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-02d86c0c31a5b3e66"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:47:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-02d86c0c31a5b3e66,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:46 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:46 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:46 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:46:46 +0000 UTC,LastTransitionTime:2023-01-19 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.52.66,},NodeAddress{Type:ExternalIP,Address:54.218.213.176,},NodeAddress{Type:InternalDNS,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-218-213-176.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2854d64f7363e92b7b006397583f0a,SystemUUID:ec2854d6-4f73-63e9-2b7b-006397583f0a,BootID:a64d8535-a0a2-421b-b474-ed26b967c37a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 02:47:03.148: INFO:
Logging kubelet events for node i-02d86c0c31a5b3e66
Jan 19 02:47:03.217: INFO:
Logging pods the kubelet thinks is on node i-02d86c0c31a5b3e66
Jan 19 02:47:03.292: INFO: ebs-csi-node-vnlk5 started at 2023-01-19 02:33:41 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:47:03.292: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:47:03.292: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:47:03.292: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-46kbx started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.292: INFO: pod-subpath-test-preprovisionedpv-8twk started at 2023-01-19 02:46:57 +0000 UTC (0+2 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container test-container-subpath-preprovisionedpv-8twk ready: false, restart count 0
Jan 19 02:47:03.292: INFO: Container test-container-volume-preprovisionedpv-8twk ready: false, restart count 0
Jan 19 02:47:03.292: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-jq8pp started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.292: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-wm87d started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0
Jan 19 02:47:03.292: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-thtlz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0
Jan 19 02:47:03.292: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gqbwh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.292: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-njqx8 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.292: INFO: affinity-clusterip-timeout-c9tph started at 2023-01-19 02:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container affinity-clusterip-timeout ready: true, restart count 0
Jan 19 02:47:03.292: INFO: hostexec-i-02d86c0c31a5b3e66-glnxp started at 2023-01-19 02:46:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:47:03.292: INFO: coredns-559769c974-jhsx5 started at 2023-01-19 02:34:10 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container coredns ready: true, restart count 0
Jan 19 02:47:03.292: INFO: csi-mockplugin-0 started at 2023-01-19 02:41:34 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:47:03.292: INFO: Container driver-registrar ready: true, restart count 0
Jan 19 02:47:03.292: INFO: Container mock ready: true, restart count 0
Jan 19 02:47:03.292: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hgwmq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.292: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4pps started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.292: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-r25l2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.292: INFO: pod-subpath-test-preprovisionedpv-lcbz started at 2023-01-19 02:42:41 +0000 UTC (1+2 container statuses recorded)
Jan 19 02:47:03.292: INFO: Init container test-init-subpath-preprovisionedpv-lcbz ready: false, restart count 0
Jan 19 02:47:03.292: INFO: Container test-container-subpath-preprovisionedpv-lcbz ready: false, restart count 0
Jan 19 02:47:03.292: INFO: Container test-container-volume-preprovisionedpv-lcbz ready: false, restart count 0
Jan 19 02:47:03.292: INFO: cilium-dpz9q started at 2023-01-19 02:33:41 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:47:03.292: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:47:03.292: INFO: csi-mockplugin-resizer-0 started at 2023-01-19 02:41:34 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container csi-resizer ready: false, restart count 0
Jan 19 02:47:03.292: INFO: hostexec-i-02d86c0c31a5b3e66-tnklx started at 2023-01-19 02:42:34 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:47:03.292: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hkqgk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.292: INFO: csi-mockplugin-attacher-0 started at 2023-01-19 02:41:34 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.292: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:47:03.563: INFO:
Latency metrics for node i-02d86c0c31a5b3e66
Jan 19 02:47:03.563: INFO:
Logging node info for node i-08066f65509d69679
Jan 19 02:47:03.630: INFO: Node Info: &Node{ObjectMeta:{i-08066f65509d69679 0be3effa-655e-4b68-9a19-46c9ab83ba9a 18981 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08066f65509d69679 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-08066f65509d69679 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.217 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1190":"i-08066f65509d69679","csi-hostpath-ephemeral-4490":"i-08066f65509d69679","ebs.csi.aws.com":"i-08066f65509d69679"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:46:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:47:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-08066f65509d69679,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:47:01 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:47:01 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:47:01 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:47:01 +0000 UTC,LastTransitionTime:2023-01-19 02:33:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.217,},NodeAddress{Type:ExternalIP,Address:52.35.165.136,},NodeAddress{Type:InternalDNS,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-35-165-136.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ef74bd259aa6181a8189c00469b84,SystemUUID:ec2ef74b-d259-aa61-81a8-189c00469b84,BootID:14a8f3be-4273-41bf-906d-a4c0fdb82ba0,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1190^873e76ca-97a3-11ed-b258-d2540af1607e kubernetes.io/csi/csi-hostpath-ephemeral-4490^795aba26-97a3-11ed-8f7c-fefcedae37df],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-4490^795aba26-97a3-11ed-8f7c-fefcedae37df,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1190^873e76ca-97a3-11ed-b258-d2540af1607e,DevicePath:,},},Config:nil,},}
Jan 19 02:47:03.630: INFO:
Logging kubelet events for node i-08066f65509d69679
Jan 19 02:47:03.699: INFO:
Logging pods the kubelet thinks is on node i-08066f65509d69679
Jan 19 02:47:03.774: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5prrc started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.774: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.774: INFO: inline-volume-tester-kg7wv started at 2023-01-19 02:46:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.774: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:47:03.774: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dvwqc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.774: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.774: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-tvhph started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.774: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0
Jan 19 02:47:03.774: INFO: fail-once-local-txdfv started at 2023-01-19 02:41:41 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.774: INFO: Container c ready: false, restart count 0
Jan 19 02:47:03.774: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-49t56 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.774: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.774: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-sshfj started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.775: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z4wjr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.775: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-266nr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.775: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-cqpsv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.775: INFO: inline-volume-tester-r9m7s started at 2023-01-19 02:46:29 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 19 02:47:03.775: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:42:03 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container hostpath ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:47:03.775: INFO: ebs-csi-node-szxtn started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:47:03.775: INFO: hostexec-i-08066f65509d69679-cctkr started at 2023-01-19 02:46:57 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:47:03.775: INFO: cilium-c7s4l started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:47:03.775: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:47:03.775: INFO: pod-61f30e3f-9edf-4b8b-9c26-6b3a7ec98892 started at 2023-01-19 02:47:00 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container write-pod ready: false, restart count 0
Jan 19 02:47:03.775: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5mxxc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:03.775: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:41:54 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container hostpath ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:47:03.775: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:47:03.775: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-qr89m started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:03.775: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:04.121: INFO:
Latency metrics for node i-08066f65509d69679
Jan 19 02:47:04.121: INFO:
Logging node info for node i-098a14e8a4aca3f52
Jan 19 02:47:04.187: INFO: Node Info: &Node{ObjectMeta:{i-098a14e8a4aca3f52 7d2548e6-f0b4-43c4-880f-93f669b42eab 17732 0 2023-01-19 02:32:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-098a14e8a4aca3f52 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.164 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-098a14e8a4aca3f52"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 02:32:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-19 02:32:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:32:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 02:44:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-098a14e8a4aca3f52,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:44:31 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:44:31 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:44:31 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:44:31 +0000 UTC,LastTransitionTime:2023-01-19 02:32:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.164,},NodeAddress{Type:ExternalIP,Address:35.89.228.171,},NodeAddress{Type:InternalDNS,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-89-228-171.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2da2cd6ae96e63652bd883a94f495c,SystemUUID:ec2da2cd-6ae9-6e63-652b-d883a94f495c,BootID:7a95f25a-dfd5-459e-b4a5-db275a1b4e67,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191755,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821707,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965792,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 02:47:04.188: INFO:
Logging kubelet events for node i-098a14e8a4aca3f52
Jan 19 02:47:04.256: INFO:
Logging pods the kubelet thinks is on node i-098a14e8a4aca3f52
Jan 19 02:47:04.329: INFO: kube-controller-manager-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.329: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 19 02:47:04.329: INFO: kube-scheduler-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.329: INFO: Container kube-scheduler ready: true, restart count 0
Jan 19 02:47:04.329: INFO: cilium-operator-6f8d6c4bf-tr54z started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.329: INFO: Container cilium-operator ready: true, restart count 0
Jan 19 02:47:04.329: INFO: ebs-csi-controller-89bddb897-vfp22 started at 2023-01-19 02:32:43 +0000 UTC (0+5 container statuses recorded)
Jan 19 02:47:04.329: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:47:04.329: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:47:04.329: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:47:04.329: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:47:04.329: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:47:04.329: INFO: dns-controller-74d4646d88-9znsr started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.329: INFO: Container dns-controller ready: true, restart count 0
Jan 19 02:47:04.329: INFO: etcd-manager-events-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.329: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 02:47:04.329: INFO: etcd-manager-main-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.329: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 02:47:04.329: INFO: kube-apiserver-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+2 container statuses recorded)
Jan 19 02:47:04.329: INFO: Container healthcheck ready: true, restart count 0
Jan 19 02:47:04.329: INFO: Container kube-apiserver ready: true, restart count 1
Jan 19 02:47:04.329: INFO: ebs-csi-node-trsl9 started at 2023-01-19 02:32:40 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:47:04.329: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:47:04.329: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:47:04.329: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:47:04.329: INFO: cilium-knt4k started at 2023-01-19 02:32:40 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:47:04.329: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:47:04.329: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:47:04.329: INFO: aws-cloud-controller-manager-4c7k7 started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.329: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 19 02:47:04.329: INFO: kops-controller-rkkdt started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.329: INFO: Container kops-controller ready: true, restart count 0
Jan 19 02:47:04.571: INFO:
Latency metrics for node i-098a14e8a4aca3f52
Jan 19 02:47:04.571: INFO:
Logging node info for node i-0f8b7f8eacf81cd58
Jan 19 02:47:04.638: INFO: Node Info: &Node{ObjectMeta:{i-0f8b7f8eacf81cd58 969780cc-600f-4d79-80fa-2e681c67e470 18783 0 2023-01-19 02:33:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f8b7f8eacf81cd58 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-0f8b7f8eacf81cd58 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f8b7f8eacf81cd58"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:46:51 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:46:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0f8b7f8eacf81cd58,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:51 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:51 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:51 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:46:51 +0000 UTC,LastTransitionTime:2023-01-19 02:33:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.113,},NodeAddress{Type:ExternalIP,Address:54.188.219.55,},NodeAddress{Type:InternalDNS,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-188-219-55.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec296be3bda6a5cf5f1cfc033b1bb6bb,SystemUUID:ec296be3-bda6-a5cf-5f1c-fc033b1bb6bb,BootID:2cccdc7f-1458-4e66-9053-d2f4c0f3fc70,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00293629c9f01aed3 kubernetes.io/csi/ebs.csi.aws.com^vol-082942bdcba78ee31],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-01dbf41c096acfab4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-082942bdcba78ee31,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00293629c9f01aed3,DevicePath:,},},Config:nil,},}
Jan 19 02:47:04.638: INFO:
Logging kubelet events for node i-0f8b7f8eacf81cd58
Jan 19 02:47:04.707: INFO:
Logging pods the kubelet thinks is on node i-0f8b7f8eacf81cd58
Jan 19 02:47:04.786: INFO: fail-once-local-k868g started at 2023-01-19 02:41:03 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container c ready: false, restart count 1
Jan 19 02:47:04.786: INFO: suspend-true-to-false-qkh4c started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container c ready: false, restart count 0
Jan 19 02:47:04.786: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-c8gns started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:04.786: INFO: suspend-true-to-false-s5btk started at 2023-01-19 02:42:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container c ready: false, restart count 0
Jan 19 02:47:04.786: INFO: pod-projected-configmaps-d17dcceb-0d60-41fe-a566-886844b76793 started at 2023-01-19 02:42:36 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container agnhost-container ready: false, restart count 0
Jan 19 02:47:04.786: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-m7587 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:04.786: INFO: pfpod started at 2023-01-19 02:46:30 +0000 UTC (0+2 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container portforwardtester ready: false, restart count 0
Jan 19 02:47:04.786: INFO: Container readiness ready: false, restart count 0
Jan 19 02:47:04.786: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4hdh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:04.786: INFO: pod-subpath-test-preprovisionedpv-kd2k started at 2023-01-19 02:46:42 +0000 UTC (2+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Init container init-volume-preprovisionedpv-kd2k ready: false, restart count 0
Jan 19 02:47:04.786: INFO: Init container test-init-volume-preprovisionedpv-kd2k ready: false, restart count 0
Jan 19 02:47:04.786: INFO: Container test-container-subpath-preprovisionedpv-kd2k ready: false, restart count 0
Jan 19 02:47:04.786: INFO: inline-volume-tester-g8cw8 started at 2023-01-19 02:46:37 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:47:04.786: INFO: fail-once-local-szfzl started at 2023-01-19 02:47:02 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container c ready: false, restart count 0
Jan 19 02:47:04.786: INFO: rc-test-qn447 started at 2023-01-19 02:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container rc-test ready: false, restart count 0
Jan 19 02:47:04.786: INFO: test-webserver-a568d965-3d10-4caa-ac3d-d2780127a41d started at 2023-01-19 02:46:14 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container test-webserver ready: false, restart count 0
Jan 19 02:47:04.786: INFO: pod1 started at 2023-01-19 02:46:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container agnhost-container ready: false, restart count 0
Jan 19 02:47:04.786: INFO: pod-service-account-nomountsa-mountspec started at 2023-01-19 02:46:18 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container token-test ready: false, restart count 0
Jan 19 02:47:04.786: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8cnst started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:04.786: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-t8z58 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:04.786: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-72jsz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:04.786: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8vqd9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:04.786: INFO: pod-service-account-defaultsa-mountspec started at 2023-01-19 02:46:18 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container token-test ready: false, restart count 0
Jan 19 02:47:04.786: INFO: affinity-clusterip-timeout-sflx7 started at 2023-01-19 02:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container affinity-clusterip-timeout ready: false, restart count 0
Jan 19 02:47:04.786: INFO: pod-87600900-ab09-4695-a4b1-f510a9918667 started at 2023-01-19 02:46:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container write-pod ready: false, restart count 0
Jan 19 02:47:04.786: INFO: cilium-mpc7m started at 2023-01-19 02:33:37 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:47:04.786: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:47:04.786: INFO: pod-2f85e175-075b-42e4-b09c-e9c5ee713f7f started at 2023-01-19 02:42:37 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container write-pod ready: false, restart count 0
Jan 19 02:47:04.786: INFO: pod-service-account-mountsa-mountspec started at 2023-01-19 02:46:18 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container token-test ready: false, restart count 0
Jan 19 02:47:04.786: INFO: hostexec-i-0f8b7f8eacf81cd58-h8vgt started at 2023-01-19 02:46:35 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:47:04.786: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dw974 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:04.786: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hb6r2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:04.786: INFO: busybox-442965cd-d81e-447d-a065-241d15d0f07f started at 2023-01-19 02:44:08 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container busybox ready: false, restart count 0
Jan 19 02:47:04.786: INFO: pod-subpath-test-configmap-l7jk started at 2023-01-19 02:46:29 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container test-container-subpath-configmap-l7jk ready: false, restart count 0
Jan 19 02:47:04.786: INFO: ebs-csi-node-x2rds started at 2023-01-19 02:33:37 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:47:04.786: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:47:04.786: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:47:04.786: INFO: suspend-true-to-false-gvdhj started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container c ready: false, restart count 0
Jan 19 02:47:04.786: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-bd6fk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:47:04.786: INFO: fail-once-local-llx45 started at 2023-01-19 02:41:03 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container c ready: false, restart count 1
Jan 19 02:47:04.786: INFO: test-webserver-91c78450-03e8-4fce-9260-bb2f1db62c46 started at 2023-01-19 02:46:20 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:47:04.786: INFO: Container test-webserver ready: false, restart count 0
Jan 19 02:47:05.199: INFO:
Latency metrics for node i-0f8b7f8eacf81cd58
[DeferCleanup (Each)] [Testpattern: Dynamic PV (ext4)] volumes
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "volume-5794" for this suite. �[38;5;243m01/19/23 02:47:05.199�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDeployment\sRecreateDeployment\sshould\sdelete\sold\spods\sand\screate\snew\sones\s\[Conformance\]$'
test/e2e/apps/deployment.go:800 k8s.io/kubernetes/test/e2e/apps.testRecreateDeployment(0xc000d20f58?) test/e2e/apps/deployment.go:800 +0x5c5 k8s.io/kubernetes/test/e2e/apps.glob..func5.5() test/e2e/apps/deployment.go:114 +0x1dfrom junit_01.xml
[BeforeEach] [sig-apps] Deployment set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 02:47:08.057�[0m Jan 19 02:47:08.057: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename deployment �[38;5;243m01/19/23 02:47:08.058�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 02:47:08.253�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 02:47:08.38�[0m [BeforeEach] [sig-apps] Deployment test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-apps] Deployment test/e2e/apps/deployment.go:91 [It] RecreateDeployment should delete old pods and create new ones [Conformance] test/e2e/apps/deployment.go:113 Jan 19 02:47:08.508: INFO: Creating deployment "test-recreate-deployment" Jan 19 02:47:08.574: INFO: Waiting deployment "test-recreate-deployment" to be updated to revision 1 Jan 19 02:47:08.702: INFO: Waiting deployment "test-recreate-deployment" to complete Jan 19 02:47:08.766: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:10.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:12.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:14.833: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:16.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:18.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:20.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:22.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:24.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:26.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:28.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:30.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:32.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:34.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:36.832: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:38.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:40.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:42.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:44.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:46.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:48.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:50.832: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:52.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:54.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:56.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:47:58.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:00.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:02.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:04.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:06.832: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:08.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:10.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:12.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:14.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:16.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:18.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:20.832: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:22.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:24.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:26.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:28.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:30.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:32.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:34.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:36.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:38.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:40.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:42.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:44.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:46.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:48.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:50.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:52.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:54.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:56.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:48:58.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:00.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:02.833: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:04.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:06.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:08.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:10.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:12.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:14.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:16.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:18.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:20.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:22.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:24.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:26.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:28.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:30.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:32.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:34.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:36.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:38.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:40.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:42.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:44.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:46.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:48.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:50.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:52.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:54.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:56.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:49:58.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:00.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:02.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:04.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:06.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:08.833: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:10.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:12.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:14.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:16.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:18.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:20.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:22.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:24.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:26.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:28.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:30.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:32.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:34.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:36.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:38.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:40.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:42.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:44.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:46.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:48.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:50.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:52.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:54.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:56.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:50:58.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:00.833: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:02.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:04.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:06.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:08.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:10.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:12.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:14.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:16.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:18.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:20.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:22.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:24.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:26.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:28.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:30.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:32.832: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:34.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:36.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:38.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:40.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:42.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:44.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:46.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:48.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:50.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:52.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:54.829: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:56.829: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:51:58.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:52:00.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:52:02.831: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:52:04.829: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:52:06.829: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:52:08.830: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:52:08.893: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 19 02:52:08.893: INFO: Unexpected error: <*errors.errorString | 0xc0011e5750>: { s: "error waiting for deployment \"test-recreate-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"test-recreate-deployment-795566c5cb\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", } Jan 19 02:52:08.893: FAIL: error waiting for deployment "test-recreate-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 19, 2, 47, 8, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-recreate-deployment-795566c5cb\" is progressing."}}, CollisionCount:(*int32)(nil)} Full Stack Trace k8s.io/kubernetes/test/e2e/apps.testRecreateDeployment(0xc000d20f58?) test/e2e/apps/deployment.go:800 +0x5c5 k8s.io/kubernetes/test/e2e/apps.glob..func5.5() test/e2e/apps/deployment.go:114 +0x1d [AfterEach] [sig-apps] Deployment test/e2e/apps/deployment.go:84 Jan 19 02:52:08.957: INFO: Deployment "test-recreate-deployment": &Deployment{ObjectMeta:{test-recreate-deployment deployment-9563 9712c49e-d4cb-4b0f-86e2-0adf3ad2b648 19105 1 2023-01-19 02:47:08 +0000 UTC <nil> <nil> map[name:sample-pod-3] map[deployment.kubernetes.io/revision:1] [] [] [{e2e.test Update apps/v1 2023-01-19 02:47:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-19 02:47:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}}},"f:status":{"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Progressing\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:observedGeneration":{},"f:replicas":{},"f:unavailableReplicas":{},"f:updatedReplicas":{}}} status}]},Spec:DeploymentSpec{Replicas:*1,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: sample-pod-3,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[name:sample-pod-3] map[] [] [] []} {[] [] [{agnhost registry.k8s.io/e2e-test-images/agnhost:2.43 [] [] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc002511e48 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},Strategy:DeploymentStrategy{Type:Recreate,RollingUpdate:nil,},MinReadySeconds:0,RevisionHistoryLimit:*10,Paused:false,ProgressDeadlineSeconds:*600,},Status:DeploymentStatus{ObservedGeneration:1,Replicas:1,UpdatedReplicas:1,AvailableReplicas:0,UnavailableReplicas:1,Conditions:[]DeploymentCondition{DeploymentCondition{Type:Available,Status:False,Reason:MinimumReplicasUnavailable,Message:Deployment does not have minimum availability.,LastUpdateTime:2023-01-19 02:47:08 +0000 UTC,LastTransitionTime:2023-01-19 02:47:08 +0000 UTC,},DeploymentCondition{Type:Progressing,Status:True,Reason:ReplicaSetUpdated,Message:ReplicaSet "test-recreate-deployment-795566c5cb" is progressing.,LastUpdateTime:2023-01-19 02:47:08 +0000 UTC,LastTransitionTime:2023-01-19 02:47:08 +0000 UTC,},},ReadyReplicas:0,CollisionCount:nil,},} Jan 19 02:52:09.020: INFO: New ReplicaSet "test-recreate-deployment-795566c5cb" of Deployment "test-recreate-deployment": &ReplicaSet{ObjectMeta:{test-recreate-deployment-795566c5cb deployment-9563 1710a358-b0e5-4616-b787-d96b4c20fd3d 19103 1 2023-01-19 02:47:08 +0000 UTC <nil> <nil> map[name:sample-pod-3 pod-template-hash:795566c5cb] map[deployment.kubernetes.io/desired-replicas:1 deployment.kubernetes.io/max-replicas:1 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment test-recreate-deployment 9712c49e-d4cb-4b0f-86e2-0adf3ad2b648 0xc0054c81e7 0xc0054c81e8}] [] [{kube-controller-manager Update apps/v1 2023-01-19 02:47:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"9712c49e-d4cb-4b0f-86e2-0adf3ad2b648\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-19 02:47:08 +0000 UTC FieldsV1 {"f:status":{"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*1,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: sample-pod-3,pod-template-hash: 795566c5cb,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[name:sample-pod-3 pod-template-hash:795566c5cb] map[] [] [] []} {[] [] [{agnhost registry.k8s.io/e2e-test-images/agnhost:2.43 [] [] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc0054c8298 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:1,FullyLabeledReplicas:1,ObservedGeneration:1,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Jan 19 02:52:09.083: INFO: Pod "test-recreate-deployment-795566c5cb-6zd9w" is not available: &Pod{ObjectMeta:{test-recreate-deployment-795566c5cb-6zd9w test-recreate-deployment-795566c5cb- deployment-9563 1a3aeb4c-e713-414a-b9cc-ab2aed6341b4 19106 0 2023-01-19 02:47:08 +0000 UTC <nil> <nil> map[name:sample-pod-3 pod-template-hash:795566c5cb] map[] [{apps/v1 ReplicaSet test-recreate-deployment-795566c5cb 1710a358-b0e5-4616-b787-d96b4c20fd3d 0xc0054c8607 0xc0054c8608}] [] [{kube-controller-manager Update v1 2023-01-19 02:47:08 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"1710a358-b0e5-4616-b787-d96b4c20fd3d\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-19 02:47:08 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-hfcl4,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-hfcl4,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-08066f65509d69679,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-19 02:47:08 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-19 02:47:08 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [agnhost],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-19 02:47:08 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [agnhost],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-19 02:47:08 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.61.217,PodIP:,StartTime:2023-01-19 02:47:08 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment test/e2e/framework/node/init/init.go:32 Jan 19 02:52:09.083: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] Deployment test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-apps] Deployment dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 02:52:09.149�[0m �[1mSTEP:�[0m Collecting events from namespace "deployment-9563". �[38;5;243m01/19/23 02:52:09.15�[0m �[1mSTEP:�[0m Found 13 events. �[38;5;243m01/19/23 02:52:09.213�[0m Jan 19 02:52:09.213: INFO: At 2023-01-19 02:47:08 +0000 UTC - event for test-recreate-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-recreate-deployment-795566c5cb to 1 Jan 19 02:52:09.213: INFO: At 2023-01-19 02:47:08 +0000 UTC - event for test-recreate-deployment-795566c5cb: {replicaset-controller } SuccessfulCreate: Created pod: test-recreate-deployment-795566c5cb-6zd9w Jan 19 02:52:09.213: INFO: At 2023-01-19 02:47:08 +0000 UTC - event for test-recreate-deployment-795566c5cb-6zd9w: {default-scheduler } Scheduled: Successfully assigned deployment-9563/test-recreate-deployment-795566c5cb-6zd9w to i-08066f65509d69679 Jan 19 02:52:09.213: INFO: At 2023-01-19 02:47:09 +0000 UTC - event for test-recreate-deployment-795566c5cb-6zd9w: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0ed0d9b7ab3d8d5042456d5fb94c31be5d4b1868557afc7cab97425f38bfbf56": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:52:09.213: INFO: At 2023-01-19 02:47:21 +0000 UTC - event for test-recreate-deployment-795566c5cb-6zd9w: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8853202dfe5be1e57da29abbee3634e8f27db6fda8d8089a5617c2fcb1269959": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:52:09.213: INFO: At 2023-01-19 02:47:34 +0000 UTC - event for test-recreate-deployment-795566c5cb-6zd9w: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8e0e5f860445dac331f4e207f7a50ae4ff86b8005ae7b5c52431cb7bb1328d9b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:52:09.213: INFO: At 2023-01-19 02:47:45 +0000 UTC - event for test-recreate-deployment-795566c5cb-6zd9w: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "07c79c2aafe90d8640fa1e7e52da9a8990fe7b3fb0829d7498889fa57f3e248d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:52:09.213: INFO: At 2023-01-19 02:47:59 +0000 UTC - event for test-recreate-deployment-795566c5cb-6zd9w: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "428727d41739fb2d7823a357d707cc6829cc6f5a054586cb40d52dc688e92595": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:52:09.213: INFO: At 2023-01-19 02:48:11 +0000 UTC - event for test-recreate-deployment-795566c5cb-6zd9w: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b9d33da98a3ddd893ea36195c220202ad6ffd0bb30dbce5a1c2fd662027a7165": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:52:09.213: INFO: At 2023-01-19 02:48:22 +0000 UTC - event for test-recreate-deployment-795566c5cb-6zd9w: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2655ce1d9a85c003ab27e16c608b76474f995f99193f96ce10175de37cc2f612": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:52:09.213: INFO: At 2023-01-19 02:48:35 +0000 UTC - event for test-recreate-deployment-795566c5cb-6zd9w: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5e4df13eb195b4550cebc6b44ee584a72cff439a82d41b85b262491f9138e197": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:52:09.213: INFO: At 2023-01-19 02:48:48 +0000 UTC - event for test-recreate-deployment-795566c5cb-6zd9w: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "93a2cc5217dc50bb561eaf5ca7daf5d500a968a5e91b01376309b8b4dd32b5ac": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:52:09.213: INFO: At 2023-01-19 02:49:04 +0000 UTC - event for test-recreate-deployment-795566c5cb-6zd9w: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "264d3724dd7a4d3f24c626dd7a463e9081bf8379aeba06460438459bb95a0c60": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:52:09.276: INFO: POD NODE PHASE GRACE CONDITIONS Jan 19 02:52:09.276: INFO: test-recreate-deployment-795566c5cb-6zd9w i-08066f65509d69679 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:08 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:08 +0000 UTC ContainersNotReady containers with unready status: [agnhost]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:08 +0000 UTC ContainersNotReady containers with unready status: [agnhost]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:08 +0000 UTC }] Jan 19 02:52:09.276: INFO: Jan 19 02:52:09.340: INFO: Unable to fetch deployment-9563/test-recreate-deployment-795566c5cb-6zd9w/agnhost logs: the server rejected our request for an unknown reason (get pods test-recreate-deployment-795566c5cb-6zd9w) Jan 19 02:52:09.404: INFO: Logging node info for node i-023e074b52731ec5a Jan 19 02:52:09.468: INFO: Node Info: &Node{ObjectMeta:{i-023e074b52731ec5a e961fee7-3382-47b0-8744-433e44345d0f 20482 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-023e074b52731ec5a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-023e074b52731ec5a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.43 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1903":"i-023e074b52731ec5a","ebs.csi.aws.com":"i-023e074b52731ec5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:51:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-023e074b52731ec5a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:47 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.43,},NodeAddress{Type:ExternalIP,Address:35.163.72.25,},NodeAddress{Type:InternalDNS,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-163-72-25.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2fdc458699464b606b9fca6747bb8e,SystemUUID:ec2fdc45-8699-464b-606b-9fca6747bb8e,BootID:c860ef30-1fd7-41be-b096-79723bc17c52,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 02:52:09.468: INFO: Logging kubelet events for node i-023e074b52731ec5a Jan 19 02:52:09.533: INFO: Logging pods the kubelet thinks is on node i-023e074b52731ec5a Jan 19 02:52:09.606: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dzctr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:09.606: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nztbv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:09.606: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-fqdth started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:09.606: INFO: hostexec-i-023e074b52731ec5a-ltg8q started at 2023-01-19 02:47:48 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:52:09.606: INFO: netserver-0 started at 2023-01-19 02:47:20 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container webserver ready: false, restart count 0 Jan 19 02:52:09.606: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-k7tm4 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:09.606: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-rbxbc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:09.606: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:51:28 +0000 UTC (0+7 container statuses recorded) Jan 19 02:52:09.606: INFO: Container csi-attacher ready: false, restart count 0 Jan 19 02:52:09.606: INFO: Container csi-provisioner ready: false, restart count 0 Jan 19 02:52:09.606: INFO: Container csi-resizer ready: false, restart count 0 Jan 19 02:52:09.606: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 19 02:52:09.606: INFO: Container hostpath ready: false, restart count 0 Jan 19 02:52:09.606: INFO: Container liveness-probe ready: false, restart count 0 Jan 19 02:52:09.606: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 19 02:52:09.606: INFO: ebs-csi-node-txkj8 started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded) Jan 19 02:52:09.606: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:52:09.606: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:52:09.606: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:52:09.606: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gzrm9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:09.606: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-px9wv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0 Jan 19 02:52:09.606: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-kmq27 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:09.606: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nlzkq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:09.606: INFO: netserver-0 started at 2023-01-19 02:48:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container webserver ready: false, restart count 0 Jan 19 02:52:09.606: INFO: inline-volume-tester-drdvw started at 2023-01-19 02:41:27 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:52:09.606: INFO: coredns-559769c974-tc4gk started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container coredns ready: true, restart count 0 Jan 19 02:52:09.606: INFO: coredns-autoscaler-7cb5c5b969-pkb4q started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container autoscaler ready: true, restart count 0 Jan 19 02:52:09.606: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:41:27 +0000 UTC (0+7 container statuses recorded) Jan 19 02:52:09.606: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 02:52:09.606: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 02:52:09.606: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 02:52:09.606: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 19 02:52:09.606: INFO: Container hostpath ready: true, restart count 0 Jan 19 02:52:09.606: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:52:09.606: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:52:09.606: INFO: pod-974aa149-9cd4-4da3-9d1f-c61d49a3ba6c started at 2023-01-19 02:47:56 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container write-pod ready: false, restart count 0 Jan 19 02:52:09.606: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z97mx started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:09.606: INFO: cilium-4xgjg started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded) Jan 19 02:52:09.606: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:52:09.606: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:52:09.879: INFO: Latency metrics for node i-023e074b52731ec5a Jan 19 02:52:09.879: INFO: Logging node info for node i-02d86c0c31a5b3e66 Jan 19 02:52:09.942: INFO: Node Info: &Node{ObjectMeta:{i-02d86c0c31a5b3e66 2b72ee85-8a44-46ad-89d8-94df5d455adf 20653 0 2023-01-19 02:33:41 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02d86c0c31a5b3e66 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-02d86c0c31a5b3e66 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.52.66 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-02d86c0c31a5b3e66"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:51:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-02d86c0c31a5b3e66,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:51 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:51 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:51 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:51:51 +0000 UTC,LastTransitionTime:2023-01-19 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.52.66,},NodeAddress{Type:ExternalIP,Address:54.218.213.176,},NodeAddress{Type:InternalDNS,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-218-213-176.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2854d64f7363e92b7b006397583f0a,SystemUUID:ec2854d6-4f73-63e9-2b7b-006397583f0a,BootID:a64d8535-a0a2-421b-b474-ed26b967c37a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 02:52:09.942: INFO: Logging kubelet events for node i-02d86c0c31a5b3e66 Jan 19 02:52:10.008: INFO: Logging pods the kubelet thinks is on node i-02d86c0c31a5b3e66 Jan 19 02:52:10.088: INFO: ebs-csi-node-vnlk5 started at 2023-01-19 02:33:41 +0000 UTC (0+3 container statuses recorded) Jan 19 02:52:10.088: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:52:10.088: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:52:10.088: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:52:10.088: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-46kbx started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.088: INFO: netserver-1 started at 2023-01-19 02:48:53 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container webserver ready: false, restart count 0 Jan 19 02:52:10.088: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-jq8pp started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.088: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-wm87d started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.088: INFO: coredns-559769c974-jhsx5 started at 2023-01-19 02:34:10 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container coredns ready: true, restart count 0 Jan 19 02:52:10.088: INFO: hostexec-i-02d86c0c31a5b3e66-6k2cs started at 2023-01-19 02:47:23 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:52:10.088: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hgwmq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.088: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-thtlz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0 Jan 19 02:52:10.088: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gqbwh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.088: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-njqx8 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.088: INFO: cilium-dpz9q started at 2023-01-19 02:33:41 +0000 UTC (1+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:52:10.088: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:52:10.088: INFO: netserver-1 started at 2023-01-19 02:47:20 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container webserver ready: true, restart count 0 Jan 19 02:52:10.088: INFO: pod-subpath-test-preprovisionedpv-9h8j started at 2023-01-19 02:47:41 +0000 UTC (1+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Init container init-volume-preprovisionedpv-9h8j ready: false, restart count 0 Jan 19 02:52:10.088: INFO: Container test-container-subpath-preprovisionedpv-9h8j ready: false, restart count 0 Jan 19 02:52:10.088: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4pps started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.088: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-r25l2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.088: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hkqgk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.088: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.351: INFO: Latency metrics for node i-02d86c0c31a5b3e66 Jan 19 02:52:10.351: INFO: Logging node info for node i-08066f65509d69679 Jan 19 02:52:10.415: INFO: Node Info: &Node{ObjectMeta:{i-08066f65509d69679 0be3effa-655e-4b68-9a19-46c9ab83ba9a 19761 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08066f65509d69679 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-08066f65509d69679 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.217 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1190":"i-08066f65509d69679","ebs.csi.aws.com":"i-08066f65509d69679"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:48:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:48:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-08066f65509d69679,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:48:43 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:48:43 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:48:43 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:48:43 +0000 UTC,LastTransitionTime:2023-01-19 02:33:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.217,},NodeAddress{Type:ExternalIP,Address:52.35.165.136,},NodeAddress{Type:InternalDNS,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-35-165-136.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ef74bd259aa6181a8189c00469b84,SystemUUID:ec2ef74b-d259-aa61-81a8-189c00469b84,BootID:14a8f3be-4273-41bf-906d-a4c0fdb82ba0,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1190^873e76ca-97a3-11ed-b258-d2540af1607e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1190^873e76ca-97a3-11ed-b258-d2540af1607e,DevicePath:,},},Config:nil,},} Jan 19 02:52:10.415: INFO: Logging kubelet events for node i-08066f65509d69679 Jan 19 02:52:10.480: INFO: Logging pods the kubelet thinks is on node i-08066f65509d69679 Jan 19 02:52:10.551: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z4wjr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.551: INFO: agnhost-primary-t6mr6 started at 2023-01-19 02:52:03 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container agnhost-primary ready: false, restart count 0 Jan 19 02:52:10.551: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-sshfj started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.551: INFO: httpd started at 2023-01-19 02:52:05 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container httpd ready: false, restart count 0 Jan 19 02:52:10.551: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:42:03 +0000 UTC (0+7 container statuses recorded) Jan 19 02:52:10.551: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 02:52:10.551: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 02:52:10.551: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 02:52:10.551: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 19 02:52:10.551: INFO: Container hostpath ready: true, restart count 0 Jan 19 02:52:10.551: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:52:10.551: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:52:10.551: INFO: ebs-csi-node-szxtn started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded) Jan 19 02:52:10.551: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:52:10.551: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:52:10.551: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:52:10.551: INFO: configmap-client started at 2023-01-19 02:51:42 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container configmap-client ready: false, restart count 0 Jan 19 02:52:10.551: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-266nr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.551: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-cqpsv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.551: INFO: cilium-c7s4l started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:52:10.551: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:52:10.551: INFO: netserver-2 started at 2023-01-19 02:48:53 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container webserver ready: false, restart count 0 Jan 19 02:52:10.551: INFO: test-recreate-deployment-795566c5cb-6zd9w started at 2023-01-19 02:47:08 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container agnhost ready: false, restart count 0 Jan 19 02:52:10.551: INFO: pod-1 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container donothing ready: true, restart count 0 Jan 19 02:52:10.551: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-qr89m started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.551: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5mxxc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.551: INFO: rc-test-2jq8d started at 2023-01-19 02:47:08 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container rc-test ready: false, restart count 0 Jan 19 02:52:10.551: INFO: hairpin started at 2023-01-19 02:51:24 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container agnhost-container ready: false, restart count 0 Jan 19 02:52:10.551: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5prrc started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.551: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dvwqc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.551: INFO: inline-volume-tester-kg7wv started at 2023-01-19 02:46:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:52:10.551: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-tvhph started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.551: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-49t56 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:10.551: INFO: netserver-2 started at 2023-01-19 02:47:20 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container webserver ready: false, restart count 0 Jan 19 02:52:10.551: INFO: fail-once-local-txdfv started at 2023-01-19 02:41:41 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container c ready: false, restart count 0 Jan 19 02:52:10.551: INFO: pod-5dace810-a072-4286-ae39-bfe4a92fa46a started at 2023-01-19 02:51:36 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:10.551: INFO: Container test-container ready: false, restart count 0 Jan 19 02:52:10.850: INFO: Latency metrics for node i-08066f65509d69679 Jan 19 02:52:10.850: INFO: Logging node info for node i-098a14e8a4aca3f52 Jan 19 02:52:10.913: INFO: Node Info: &Node{ObjectMeta:{i-098a14e8a4aca3f52 7d2548e6-f0b4-43c4-880f-93f669b42eab 19982 0 2023-01-19 02:32:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-098a14e8a4aca3f52 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.164 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-098a14e8a4aca3f52"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 02:32:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-19 02:32:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:32:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 02:49:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-098a14e8a4aca3f52,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:49:37 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:49:37 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:49:37 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:49:37 +0000 UTC,LastTransitionTime:2023-01-19 02:32:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.164,},NodeAddress{Type:ExternalIP,Address:35.89.228.171,},NodeAddress{Type:InternalDNS,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-89-228-171.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2da2cd6ae96e63652bd883a94f495c,SystemUUID:ec2da2cd-6ae9-6e63-652b-d883a94f495c,BootID:7a95f25a-dfd5-459e-b4a5-db275a1b4e67,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191755,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821707,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965792,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 02:52:10.914: INFO: Logging kubelet events for node i-098a14e8a4aca3f52 Jan 19 02:52:10.980: INFO: Logging pods the kubelet thinks is on node i-098a14e8a4aca3f52 Jan 19 02:52:11.049: INFO: cilium-knt4k started at 2023-01-19 02:32:40 +0000 UTC (1+1 container statuses recorded) Jan 19 02:52:11.049: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:52:11.049: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:52:11.049: INFO: aws-cloud-controller-manager-4c7k7 started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.049: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 19 02:52:11.049: INFO: kops-controller-rkkdt started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.049: INFO: Container kops-controller ready: true, restart count 0 Jan 19 02:52:11.049: INFO: etcd-manager-events-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.049: INFO: Container etcd-manager ready: true, restart count 0 Jan 19 02:52:11.049: INFO: etcd-manager-main-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.049: INFO: Container etcd-manager ready: true, restart count 0 Jan 19 02:52:11.049: INFO: kube-apiserver-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+2 container statuses recorded) Jan 19 02:52:11.049: INFO: Container healthcheck ready: true, restart count 0 Jan 19 02:52:11.049: INFO: Container kube-apiserver ready: true, restart count 1 Jan 19 02:52:11.049: INFO: ebs-csi-node-trsl9 started at 2023-01-19 02:32:40 +0000 UTC (0+3 container statuses recorded) Jan 19 02:52:11.049: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:52:11.049: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:52:11.049: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:52:11.049: INFO: dns-controller-74d4646d88-9znsr started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.049: INFO: Container dns-controller ready: true, restart count 0 Jan 19 02:52:11.049: INFO: kube-controller-manager-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.049: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 19 02:52:11.049: INFO: kube-scheduler-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.049: INFO: Container kube-scheduler ready: true, restart count 0 Jan 19 02:52:11.049: INFO: cilium-operator-6f8d6c4bf-tr54z started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.049: INFO: Container cilium-operator ready: true, restart count 0 Jan 19 02:52:11.049: INFO: ebs-csi-controller-89bddb897-vfp22 started at 2023-01-19 02:32:43 +0000 UTC (0+5 container statuses recorded) Jan 19 02:52:11.049: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 02:52:11.049: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 02:52:11.049: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 02:52:11.049: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:52:11.049: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:52:11.278: INFO: Latency metrics for node i-098a14e8a4aca3f52 Jan 19 02:52:11.278: INFO: Logging node info for node i-0f8b7f8eacf81cd58 Jan 19 02:52:11.341: INFO: Node Info: &Node{ObjectMeta:{i-0f8b7f8eacf81cd58 969780cc-600f-4d79-80fa-2e681c67e470 19339 0 2023-01-19 02:33:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f8b7f8eacf81cd58 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-0f8b7f8eacf81cd58 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f8b7f8eacf81cd58"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:47:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-19 02:47:38 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0f8b7f8eacf81cd58,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:47:12 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:47:12 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:47:12 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:47:12 +0000 UTC,LastTransitionTime:2023-01-19 02:33:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.113,},NodeAddress{Type:ExternalIP,Address:54.188.219.55,},NodeAddress{Type:InternalDNS,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-188-219-55.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec296be3bda6a5cf5f1cfc033b1bb6bb,SystemUUID:ec296be3-bda6-a5cf-5f1c-fc033b1bb6bb,BootID:2cccdc7f-1458-4e66-9053-d2f4c0f3fc70,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00293629c9f01aed3 kubernetes.io/csi/ebs.csi.aws.com^vol-082942bdcba78ee31 kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-082942bdcba78ee31,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00293629c9f01aed3,DevicePath:,},},Config:nil,},} Jan 19 02:52:11.341: INFO: Logging kubelet events for node i-0f8b7f8eacf81cd58 Jan 19 02:52:11.406: INFO: Logging pods the kubelet thinks is on node i-0f8b7f8eacf81cd58 Jan 19 02:52:11.477: INFO: pod-subpath-test-inlinevolume-ck6t started at 2023-01-19 02:48:33 +0000 UTC (1+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Init container init-volume-inlinevolume-ck6t ready: false, restart count 0 Jan 19 02:52:11.477: INFO: Container test-container-subpath-inlinevolume-ck6t ready: false, restart count 0 Jan 19 02:52:11.477: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4hdh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:11.477: INFO: inline-volume-tester-g8cw8 started at 2023-01-19 02:46:37 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:52:11.477: INFO: fail-once-local-szfzl started at 2023-01-19 02:47:02 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container c ready: false, restart count 0 Jan 19 02:52:11.477: INFO: pod-2 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container donothing ready: false, restart count 0 Jan 19 02:52:11.477: INFO: rc-test-qn447 started at 2023-01-19 02:46:39 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container rc-test ready: true, restart count 0 Jan 19 02:52:11.477: INFO: inline-volume-tester-m6c6d started at 2023-01-19 02:47:11 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:52:11.477: INFO: pod-update-activedeadlineseconds-025da2a6-1f98-4401-8573-c4874882421b started at 2023-01-19 02:51:18 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container pause ready: false, restart count 0 Jan 19 02:52:11.477: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8cnst started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:11.477: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-t8z58 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:11.477: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-72jsz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:11.477: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8vqd9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:11.477: INFO: hostexec-i-0f8b7f8eacf81cd58-x92jz started at 2023-01-19 02:52:02 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:52:11.477: INFO: pod-87600900-ab09-4695-a4b1-f510a9918667 started at 2023-01-19 02:46:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container write-pod ready: false, restart count 0 Jan 19 02:52:11.477: INFO: cilium-mpc7m started at 2023-01-19 02:33:37 +0000 UTC (1+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:52:11.477: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:52:11.477: INFO: pod-52b7b2e9-035c-4ed1-affb-05db28ee100e started at 2023-01-19 02:51:34 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container test-container ready: false, restart count 0 Jan 19 02:52:11.477: INFO: netserver-3 started at 2023-01-19 02:47:20 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container webserver ready: false, restart count 0 Jan 19 02:52:11.477: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dw974 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:11.477: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hb6r2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:11.477: INFO: ebs-csi-node-x2rds started at 2023-01-19 02:33:37 +0000 UTC (0+3 container statuses recorded) Jan 19 02:52:11.477: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:52:11.477: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:52:11.477: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:52:11.477: INFO: suspend-true-to-false-gvdhj started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container c ready: false, restart count 0 Jan 19 02:52:11.477: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-bd6fk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:11.477: INFO: fail-once-local-llx45 started at 2023-01-19 02:41:03 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container c ready: false, restart count 1 Jan 19 02:52:11.477: INFO: pod-0 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container donothing ready: false, restart count 0 Jan 19 02:52:11.477: INFO: fail-once-local-k868g started at 2023-01-19 02:41:03 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container c ready: false, restart count 1 Jan 19 02:52:11.477: INFO: suspend-true-to-false-qkh4c started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container c ready: false, restart count 0 Jan 19 02:52:11.477: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-c8gns started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:11.477: INFO: suspend-true-to-false-s5btk started at 2023-01-19 02:42:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container c ready: false, restart count 0 Jan 19 02:52:11.477: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-m7587 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:52:11.477: INFO: netserver-3 started at 2023-01-19 02:48:53 +0000 UTC (0+1 container statuses recorded) Jan 19 02:52:11.477: INFO: Container webserver ready: true, restart count 0 Jan 19 02:52:11.720: INFO: Latency metrics for node i-0f8b7f8eacf81cd58 [DeferCleanup (Each)] [sig-apps] Deployment tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "deployment-9563" for this suite. �[38;5;243m01/19/23 02:52:11.72�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDisruptionController\sshould\sobserve\sPodDisruptionBudget\sstatus\supdated\s\[Conformance\]$'
test/e2e/apps/disruption.go:580
k8s.io/kubernetes/test/e2e/apps.waitForPodsOrDie({0x8022ee8?, 0xc000523d40}, {0xc0037c1270, 0xf}, 0x3)
test/e2e/apps/disruption.go:580 +0x167
k8s.io/kubernetes/test/e2e/apps.glob..func6.4()
test/e2e/apps/disruption.go:145 +0xdc
[BeforeEach] [sig-apps] DisruptionController
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 02:47:39.665�[0m
Jan 19 02:47:39.665: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename disruption �[38;5;243m01/19/23 02:47:39.666�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 02:47:39.864�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 02:47:39.994�[0m
[BeforeEach] [sig-apps] DisruptionController
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] DisruptionController
test/e2e/apps/disruption.go:72
[It] should observe PodDisruptionBudget status updated [Conformance]
test/e2e/apps/disruption.go:141
�[1mSTEP:�[0m Waiting for the pdb to be processed �[38;5;243m01/19/23 02:47:40.193�[0m
�[1mSTEP:�[0m Waiting for all pods to be running �[38;5;243m01/19/23 02:47:40.464�[0m
Jan 19 02:47:40.530: INFO: running pods: 0 < 3
Jan 19 02:47:42.597: INFO: running pods: 0 < 3
Jan 19 02:47:44.597: INFO: running pods: 0 < 3
Jan 19 02:47:46.597: INFO: running pods: 0 < 3
Jan 19 02:47:48.598: INFO: running pods: 0 < 3
Jan 19 02:47:50.597: INFO: running pods: 0 < 3
Jan 19 02:47:52.598: INFO: running pods: 0 < 3
Jan 19 02:47:54.598: INFO: running pods: 0 < 3
Jan 19 02:47:56.598: INFO: running pods: 0 < 3
Jan 19 02:47:58.597: INFO: running pods: 0 < 3
Jan 19 02:48:00.597: INFO: running pods: 0 < 3
Jan 19 02:48:02.598: INFO: running pods: 0 < 3
Jan 19 02:48:04.597: INFO: running pods: 0 < 3
Jan 19 02:48:06.597: INFO: running pods: 0 < 3
Jan 19 02:48:08.597: INFO: running pods: 0 < 3
Jan 19 02:48:10.597: INFO: running pods: 0 < 3
Jan 19 02:48:12.598: INFO: running pods: 0 < 3
Jan 19 02:48:14.598: INFO: running pods: 0 < 3
Jan 19 02:48:16.597: INFO: running pods: 0 < 3
Jan 19 02:48:18.598: INFO: running pods: 0 < 3
Jan 19 02:48:20.597: INFO: running pods: 0 < 3
Jan 19 02:48:22.597: INFO: running pods: 0 < 3
Jan 19 02:48:24.597: INFO: running pods: 0 < 3
Jan 19 02:48:26.598: INFO: running pods: 0 < 3
Jan 19 02:48:28.598: INFO: running pods: 0 < 3
Jan 19 02:48:30.598: INFO: running pods: 0 < 3
Jan 19 02:48:32.598: INFO: running pods: 0 < 3
Jan 19 02:48:34.597: INFO: running pods: 0 < 3
Jan 19 02:48:36.598: INFO: running pods: 0 < 3
Jan 19 02:48:38.597: INFO: running pods: 0 < 3
Jan 19 02:48:40.597: INFO: running pods: 0 < 3
Jan 19 02:48:42.598: INFO: running pods: 0 < 3
Jan 19 02:48:44.597: INFO: running pods: 0 < 3
Jan 19 02:48:46.598: INFO: running pods: 0 < 3
Jan 19 02:48:48.597: INFO: running pods: 0 < 3
Jan 19 02:48:50.598: INFO: running pods: 1 < 3
Jan 19 02:48:52.598: INFO: running pods: 1 < 3
Jan 19 02:48:54.597: INFO: running pods: 1 < 3
Jan 19 02:48:56.597: INFO: running pods: 1 < 3
Jan 19 02:48:58.597: INFO: running pods: 1 < 3
Jan 19 02:49:00.598: INFO: running pods: 1 < 3
Jan 19 02:49:02.597: INFO: running pods: 1 < 3
Jan 19 02:49:04.598: INFO: running pods: 1 < 3
Jan 19 02:49:06.597: INFO: running pods: 1 < 3
Jan 19 02:49:08.598: INFO: running pods: 1 < 3
Jan 19 02:49:10.597: INFO: running pods: 1 < 3
Jan 19 02:49:12.598: INFO: running pods: 1 < 3
Jan 19 02:49:14.597: INFO: running pods: 1 < 3
Jan 19 02:49:16.597: INFO: running pods: 1 < 3
Jan 19 02:49:18.597: INFO: running pods: 1 < 3
Jan 19 02:49:20.597: INFO: running pods: 1 < 3
Jan 19 02:49:22.597: INFO: running pods: 1 < 3
Jan 19 02:49:24.603: INFO: running pods: 1 < 3
Jan 19 02:49:26.597: INFO: running pods: 1 < 3
Jan 19 02:49:28.597: INFO: running pods: 1 < 3
Jan 19 02:49:30.597: INFO: running pods: 1 < 3
Jan 19 02:49:32.597: INFO: running pods: 1 < 3
Jan 19 02:49:34.598: INFO: running pods: 1 < 3
Jan 19 02:49:36.597: INFO: running pods: 1 < 3
Jan 19 02:49:38.597: INFO: running pods: 1 < 3
Jan 19 02:49:40.597: INFO: running pods: 1 < 3
Jan 19 02:49:42.597: INFO: running pods: 1 < 3
Jan 19 02:49:44.597: INFO: running pods: 1 < 3
Jan 19 02:49:46.598: INFO: running pods: 1 < 3
Jan 19 02:49:48.597: INFO: running pods: 1 < 3
Jan 19 02:49:50.597: INFO: running pods: 1 < 3
Jan 19 02:49:52.597: INFO: running pods: 1 < 3
Jan 19 02:49:54.597: INFO: running pods: 1 < 3
Jan 19 02:49:56.597: INFO: running pods: 1 < 3
Jan 19 02:49:58.597: INFO: running pods: 1 < 3
Jan 19 02:50:00.598: INFO: running pods: 1 < 3
Jan 19 02:50:02.597: INFO: running pods: 1 < 3
Jan 19 02:50:04.598: INFO: running pods: 1 < 3
Jan 19 02:50:06.597: INFO: running pods: 1 < 3
Jan 19 02:50:08.597: INFO: running pods: 1 < 3
Jan 19 02:50:10.597: INFO: running pods: 1 < 3
Jan 19 02:50:12.597: INFO: running pods: 1 < 3
Jan 19 02:50:14.597: INFO: running pods: 1 < 3
Jan 19 02:50:16.598: INFO: running pods: 1 < 3
Jan 19 02:50:18.597: INFO: running pods: 1 < 3
Jan 19 02:50:20.597: INFO: running pods: 1 < 3
Jan 19 02:50:22.598: INFO: running pods: 1 < 3
Jan 19 02:50:24.597: INFO: running pods: 1 < 3
Jan 19 02:50:26.597: INFO: running pods: 1 < 3
Jan 19 02:50:28.597: INFO: running pods: 1 < 3
Jan 19 02:50:30.597: INFO: running pods: 1 < 3
Jan 19 02:50:32.597: INFO: running pods: 1 < 3
Jan 19 02:50:34.597: INFO: running pods: 1 < 3
Jan 19 02:50:36.598: INFO: running pods: 1 < 3
Jan 19 02:50:38.596: INFO: running pods: 1 < 3
Jan 19 02:50:40.595: INFO: running pods: 1 < 3
Jan 19 02:50:42.595: INFO: running pods: 1 < 3
Jan 19 02:50:44.595: INFO: running pods: 1 < 3
Jan 19 02:50:46.595: INFO: running pods: 1 < 3
Jan 19 02:50:48.595: INFO: running pods: 1 < 3
Jan 19 02:50:50.596: INFO: running pods: 1 < 3
Jan 19 02:50:52.595: INFO: running pods: 1 < 3
Jan 19 02:50:54.595: INFO: running pods: 1 < 3
Jan 19 02:50:56.595: INFO: running pods: 1 < 3
Jan 19 02:50:58.598: INFO: running pods: 1 < 3
Jan 19 02:51:00.595: INFO: running pods: 1 < 3
Jan 19 02:51:02.597: INFO: running pods: 1 < 3
Jan 19 02:51:04.595: INFO: running pods: 1 < 3
Jan 19 02:51:06.596: INFO: running pods: 1 < 3
Jan 19 02:51:08.595: INFO: running pods: 1 < 3
Jan 19 02:51:10.596: INFO: running pods: 1 < 3
Jan 19 02:51:12.596: INFO: running pods: 1 < 3
Jan 19 02:51:14.595: INFO: running pods: 1 < 3
Jan 19 02:51:16.595: INFO: running pods: 1 < 3
Jan 19 02:51:18.595: INFO: running pods: 1 < 3
Jan 19 02:51:20.595: INFO: running pods: 1 < 3
Jan 19 02:51:22.595: INFO: running pods: 1 < 3
Jan 19 02:51:24.595: INFO: running pods: 1 < 3
Jan 19 02:51:26.595: INFO: running pods: 1 < 3
Jan 19 02:51:28.596: INFO: running pods: 1 < 3
Jan 19 02:51:30.595: INFO: running pods: 1 < 3
Jan 19 02:51:32.596: INFO: running pods: 1 < 3
Jan 19 02:51:34.595: INFO: running pods: 1 < 3
Jan 19 02:51:36.595: INFO: running pods: 1 < 3
Jan 19 02:51:38.594: INFO: running pods: 1 < 3
Jan 19 02:51:40.595: INFO: running pods: 1 < 3
Jan 19 02:51:42.594: INFO: running pods: 1 < 3
Jan 19 02:51:44.595: INFO: running pods: 1 < 3
Jan 19 02:51:46.595: INFO: running pods: 1 < 3
Jan 19 02:51:48.595: INFO: running pods: 1 < 3
Jan 19 02:51:50.596: INFO: running pods: 1 < 3
Jan 19 02:51:52.596: INFO: running pods: 1 < 3
Jan 19 02:51:54.596: INFO: running pods: 1 < 3
Jan 19 02:51:56.596: INFO: running pods: 1 < 3
Jan 19 02:51:58.596: INFO: running pods: 1 < 3
Jan 19 02:52:00.596: INFO: running pods: 1 < 3
Jan 19 02:52:02.596: INFO: running pods: 1 < 3
Jan 19 02:52:04.596: INFO: running pods: 1 < 3
Jan 19 02:52:06.596: INFO: running pods: 1 < 3
Jan 19 02:52:08.597: INFO: running pods: 1 < 3
Jan 19 02:52:10.596: INFO: running pods: 1 < 3
Jan 19 02:52:12.596: INFO: running pods: 1 < 3
Jan 19 02:52:14.596: INFO: running pods: 1 < 3
Jan 19 02:52:16.597: INFO: running pods: 1 < 3
Jan 19 02:52:18.595: INFO: running pods: 1 < 3
Jan 19 02:52:20.596: INFO: running pods: 1 < 3
Jan 19 02:52:22.596: INFO: running pods: 1 < 3
Jan 19 02:52:24.596: INFO: running pods: 1 < 3
Jan 19 02:52:26.596: INFO: running pods: 1 < 3
Jan 19 02:52:28.595: INFO: running pods: 1 < 3
Jan 19 02:52:30.596: INFO: running pods: 1 < 3
Jan 19 02:52:32.596: INFO: running pods: 1 < 3
Jan 19 02:52:34.596: INFO: running pods: 1 < 3
Jan 19 02:52:36.595: INFO: running pods: 1 < 3
Jan 19 02:52:38.596: INFO: running pods: 1 < 3
Jan 19 02:52:40.596: INFO: running pods: 1 < 3
Jan 19 02:52:42.596: INFO: running pods: 1 < 3
Jan 19 02:52:44.595: INFO: running pods: 1 < 3
Jan 19 02:52:46.594: INFO: running pods: 1 < 3
Jan 19 02:52:48.594: INFO: running pods: 1 < 3
Jan 19 02:52:50.594: INFO: running pods: 1 < 3
Jan 19 02:52:52.595: INFO: running pods: 1 < 3
Jan 19 02:52:54.595: INFO: running pods: 1 < 3
Jan 19 02:52:56.595: INFO: running pods: 1 < 3
Jan 19 02:52:58.595: INFO: running pods: 1 < 3
Jan 19 02:53:00.594: INFO: running pods: 1 < 3
Jan 19 02:53:02.595: INFO: running pods: 1 < 3
Jan 19 02:53:04.594: INFO: running pods: 1 < 3
Jan 19 02:53:06.594: INFO: running pods: 1 < 3
Jan 19 02:53:08.595: INFO: running pods: 1 < 3
Jan 19 02:53:10.594: INFO: running pods: 1 < 3
Jan 19 02:53:12.594: INFO: running pods: 1 < 3
Jan 19 02:53:14.594: INFO: running pods: 1 < 3
Jan 19 02:53:16.595: INFO: running pods: 1 < 3
Jan 19 02:53:18.594: INFO: running pods: 1 < 3
Jan 19 02:53:20.594: INFO: running pods: 1 < 3
Jan 19 02:53:22.595: INFO: running pods: 1 < 3
Jan 19 02:53:24.595: INFO: running pods: 1 < 3
Jan 19 02:53:26.595: INFO: running pods: 1 < 3
Jan 19 02:53:28.595: INFO: running pods: 1 < 3
Jan 19 02:53:30.594: INFO: running pods: 1 < 3
Jan 19 02:53:32.595: INFO: running pods: 1 < 3
Jan 19 02:53:34.595: INFO: running pods: 1 < 3
Jan 19 02:53:36.595: INFO: running pods: 1 < 3
Jan 19 02:53:38.595: INFO: running pods: 1 < 3
Jan 19 02:53:40.595: INFO: running pods: 1 < 3
Jan 19 02:53:42.595: INFO: running pods: 1 < 3
Jan 19 02:53:44.595: INFO: running pods: 1 < 3
Jan 19 02:53:46.595: INFO: running pods: 1 < 3
Jan 19 02:53:48.595: INFO: running pods: 1 < 3
Jan 19 02:53:50.594: INFO: running pods: 1 < 3
Jan 19 02:53:52.594: INFO: running pods: 1 < 3
Jan 19 02:53:54.594: INFO: running pods: 1 < 3
Jan 19 02:53:56.594: INFO: running pods: 1 < 3
Jan 19 02:53:58.594: INFO: running pods: 1 < 3
Jan 19 02:54:00.594: INFO: running pods: 1 < 3
Jan 19 02:54:02.594: INFO: running pods: 1 < 3
Jan 19 02:54:04.595: INFO: running pods: 1 < 3
Jan 19 02:54:06.595: INFO: running pods: 1 < 3
Jan 19 02:54:08.594: INFO: running pods: 1 < 3
Jan 19 02:54:10.595: INFO: running pods: 1 < 3
Jan 19 02:54:12.595: INFO: running pods: 1 < 3
Jan 19 02:54:14.595: INFO: running pods: 1 < 3
Jan 19 02:54:16.598: INFO: running pods: 1 < 3
Jan 19 02:54:18.594: INFO: running pods: 1 < 3
Jan 19 02:54:20.595: INFO: running pods: 1 < 3
Jan 19 02:54:22.595: INFO: running pods: 1 < 3
Jan 19 02:54:24.596: INFO: running pods: 1 < 3
Jan 19 02:54:26.595: INFO: running pods: 1 < 3
Jan 19 02:54:28.595: INFO: running pods: 1 < 3
Jan 19 02:54:30.595: INFO: running pods: 1 < 3
Jan 19 02:54:32.595: INFO: running pods: 1 < 3
Jan 19 02:54:34.595: INFO: running pods: 1 < 3
Jan 19 02:54:36.595: INFO: running pods: 1 < 3
Jan 19 02:54:38.595: INFO: running pods: 1 < 3
Jan 19 02:54:40.594: INFO: running pods: 1 < 3
Jan 19 02:54:42.595: INFO: running pods: 1 < 3
Jan 19 02:54:44.596: INFO: running pods: 1 < 3
Jan 19 02:54:46.595: INFO: running pods: 2 < 3
Jan 19 02:54:48.595: INFO: running pods: 2 < 3
Jan 19 02:54:50.594: INFO: running pods: 2 < 3
Jan 19 02:54:52.595: INFO: running pods: 2 < 3
Jan 19 02:54:54.595: INFO: running pods: 2 < 3
Jan 19 02:54:56.595: INFO: running pods: 2 < 3
Jan 19 02:54:58.595: INFO: running pods: 2 < 3
Jan 19 02:55:00.595: INFO: running pods: 2 < 3
Jan 19 02:55:02.595: INFO: running pods: 2 < 3
Jan 19 02:55:04.595: INFO: running pods: 2 < 3
Jan 19 02:55:06.595: INFO: running pods: 2 < 3
Jan 19 02:55:08.595: INFO: running pods: 2 < 3
Jan 19 02:55:10.594: INFO: running pods: 2 < 3
Jan 19 02:55:12.595: INFO: running pods: 2 < 3
Jan 19 02:55:14.594: INFO: running pods: 2 < 3
Jan 19 02:55:16.595: INFO: running pods: 2 < 3
Jan 19 02:55:18.594: INFO: running pods: 2 < 3
Jan 19 02:55:20.595: INFO: running pods: 2 < 3
Jan 19 02:55:22.595: INFO: running pods: 2 < 3
Jan 19 02:55:24.594: INFO: running pods: 2 < 3
Jan 19 02:55:26.595: INFO: running pods: 2 < 3
Jan 19 02:55:28.594: INFO: running pods: 2 < 3
Jan 19 02:55:30.595: INFO: running pods: 2 < 3
Jan 19 02:55:32.594: INFO: running pods: 2 < 3
Jan 19 02:55:34.595: INFO: running pods: 2 < 3
Jan 19 02:55:36.595: INFO: running pods: 2 < 3
Jan 19 02:55:38.594: INFO: running pods: 2 < 3
Jan 19 02:55:40.594: INFO: running pods: 2 < 3
Jan 19 02:55:42.595: INFO: running pods: 2 < 3
Jan 19 02:55:44.594: INFO: running pods: 2 < 3
Jan 19 02:55:46.594: INFO: running pods: 2 < 3
Jan 19 02:55:48.595: INFO: running pods: 2 < 3
Jan 19 02:55:50.594: INFO: running pods: 2 < 3
Jan 19 02:55:52.595: INFO: running pods: 2 < 3
Jan 19 02:55:54.595: INFO: running pods: 2 < 3
Jan 19 02:55:56.595: INFO: running pods: 2 < 3
Jan 19 02:55:58.596: INFO: running pods: 2 < 3
Jan 19 02:56:00.595: INFO: running pods: 2 < 3
Jan 19 02:56:02.595: INFO: running pods: 2 < 3
Jan 19 02:56:04.594: INFO: running pods: 2 < 3
Jan 19 02:56:06.594: INFO: running pods: 2 < 3
Jan 19 02:56:08.595: INFO: running pods: 2 < 3
Jan 19 02:56:10.594: INFO: running pods: 2 < 3
Jan 19 02:56:12.597: INFO: running pods: 2 < 3
Jan 19 02:56:14.595: INFO: running pods: 2 < 3
Jan 19 02:56:16.595: INFO: running pods: 2 < 3
Jan 19 02:56:18.594: INFO: running pods: 2 < 3
Jan 19 02:56:20.594: INFO: running pods: 2 < 3
Jan 19 02:56:22.595: INFO: running pods: 2 < 3
Jan 19 02:56:24.594: INFO: running pods: 2 < 3
Jan 19 02:56:26.595: INFO: running pods: 2 < 3
Jan 19 02:56:28.594: INFO: running pods: 2 < 3
Jan 19 02:56:30.595: INFO: running pods: 2 < 3
Jan 19 02:56:32.597: INFO: running pods: 2 < 3
Jan 19 02:56:34.595: INFO: running pods: 2 < 3
Jan 19 02:56:36.594: INFO: running pods: 2 < 3
Jan 19 02:56:38.594: INFO: running pods: 2 < 3
Jan 19 02:56:40.594: INFO: running pods: 2 < 3
Jan 19 02:56:42.594: INFO: running pods: 2 < 3
Jan 19 02:56:44.595: INFO: running pods: 2 < 3
Jan 19 02:56:46.594: INFO: running pods: 2 < 3
Jan 19 02:56:48.594: INFO: running pods: 2 < 3
Jan 19 02:56:50.595: INFO: running pods: 2 < 3
Jan 19 02:56:52.595: INFO: running pods: 2 < 3
Jan 19 02:56:54.595: INFO: running pods: 2 < 3
Jan 19 02:56:56.594: INFO: running pods: 2 < 3
Jan 19 02:56:58.593: INFO: running pods: 2 < 3
Jan 19 02:57:00.594: INFO: running pods: 2 < 3
Jan 19 02:57:02.593: INFO: running pods: 2 < 3
Jan 19 02:57:04.595: INFO: running pods: 2 < 3
Jan 19 02:57:06.593: INFO: running pods: 2 < 3
Jan 19 02:57:08.593: INFO: running pods: 2 < 3
Jan 19 02:57:10.593: INFO: running pods: 2 < 3
Jan 19 02:57:12.593: INFO: running pods: 2 < 3
Jan 19 02:57:14.594: INFO: running pods: 2 < 3
Jan 19 02:57:16.595: INFO: running pods: 2 < 3
Jan 19 02:57:18.593: INFO: running pods: 2 < 3
Jan 19 02:57:20.593: INFO: running pods: 2 < 3
Jan 19 02:57:22.593: INFO: running pods: 2 < 3
Jan 19 02:57:24.593: INFO: running pods: 2 < 3
Jan 19 02:57:26.594: INFO: running pods: 2 < 3
Jan 19 02:57:28.593: INFO: running pods: 2 < 3
Jan 19 02:57:30.595: INFO: running pods: 2 < 3
Jan 19 02:57:32.594: INFO: running pods: 2 < 3
Jan 19 02:57:34.593: INFO: running pods: 2 < 3
Jan 19 02:57:36.593: INFO: running pods: 2 < 3
Jan 19 02:57:38.593: INFO: running pods: 2 < 3
Jan 19 02:57:40.593: INFO: running pods: 2 < 3
Jan 19 02:57:40.655: INFO: running pods: 2 < 3
Jan 19 02:57:40.655: INFO: Unexpected error: Waiting for pods in namespace "disruption-2088" to be ready:
<*errors.errorString | 0xc0001ef9f0>: {
s: "timed out waiting for the condition",
}
Jan 19 02:57:40.655: FAIL: Waiting for pods in namespace "disruption-2088" to be ready: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.waitForPodsOrDie({0x8022ee8?, 0xc000523d40}, {0xc0037c1270, 0xf}, 0x3)
test/e2e/apps/disruption.go:580 +0x167
k8s.io/kubernetes/test/e2e/apps.glob..func6.4()
test/e2e/apps/disruption.go:145 +0xdc
[AfterEach] [sig-apps] DisruptionController
test/e2e/framework/node/init/init.go:32
Jan 19 02:57:40.655: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] DisruptionController
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] DisruptionController
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 02:57:40.718�[0m
�[1mSTEP:�[0m Collecting events from namespace "disruption-2088". �[38;5;243m01/19/23 02:57:40.718�[0m
�[1mSTEP:�[0m Found 32 events. �[38;5;243m01/19/23 02:57:40.782�[0m
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:47:40 +0000 UTC - event for foo: {controllermanager } NoPods: No matching pods found
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:47:40 +0000 UTC - event for pod-0: {default-scheduler } Scheduled: Successfully assigned disruption-2088/pod-0 to i-0f8b7f8eacf81cd58
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:47:40 +0000 UTC - event for pod-0: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "61febe4a82888b6b40d4c7c20f0a577f92f9a2e28e3122d8daefae6d5f518c7e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:47:40 +0000 UTC - event for pod-1: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2fc4cd8e8bdaca4925728bf23e2096d52df883b997aeb84378d87631a7a6e67f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:47:40 +0000 UTC - event for pod-1: {default-scheduler } Scheduled: Successfully assigned disruption-2088/pod-1 to i-08066f65509d69679
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:47:40 +0000 UTC - event for pod-2: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d2bb4d85e87835b73e209840613197c7f481084736dd9f3ac0b6dbea004d61af": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:47:40 +0000 UTC - event for pod-2: {default-scheduler } Scheduled: Successfully assigned disruption-2088/pod-2 to i-0f8b7f8eacf81cd58
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:47:52 +0000 UTC - event for pod-1: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b0c99f4d18049a3d0866f07a89870151811eadb37f5523e06d54536006680a3b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:47:52 +0000 UTC - event for pod-2: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1b63001ec8531e702652b2f080d3fbd8f212ffbcba1aba08174acfbfdd72f4c6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:47:53 +0000 UTC - event for pod-0: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0d3ed89c820c8c1bfde5cc5e03cf46218df9e2da8910e00f64ad1b7dd4030840": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:05 +0000 UTC - event for pod-1: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b15bc403ffa26198c278ba83abd265066d0ef7677ecada8833e160f764dd951e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:05 +0000 UTC - event for pod-2: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ac63d8bf2f054b27f28214174ab97072dcecb7cc5856084244f0fb831cc43a60": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:07 +0000 UTC - event for pod-0: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "75f55ea5dca308588a794e956bf784bd058414994b2964001438564b840dc18b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:18 +0000 UTC - event for pod-2: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a6b4ba382a0f15304c1629bdd3baf9deec7ec2178c1539dbc6f8b56794279bd6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:20 +0000 UTC - event for pod-0: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6954323300a8bd3baf444978f1bdd48e577090c805f1078ed53ea7813e349d36": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:20 +0000 UTC - event for pod-1: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cd2c4e15cbca94b1de8271ef3d679d0d8ade2ba3f304527c7f28cffaa8bb9373": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:31 +0000 UTC - event for pod-1: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "921b3c3a7092f0e695178cee8c5e504f4d465f1426c306aedfd04beba125a931": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:32 +0000 UTC - event for pod-0: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b0d5d11e22675dcac51ec5b8bacb3bd4066c29e0f9feeaabf42e59db613a4db1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:33 +0000 UTC - event for pod-2: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "34c786c8bab8d382d999aa7fdbd5caf8cb8ab65deb8811854aba488fa1381cd4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:44 +0000 UTC - event for pod-2: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8acd86304966d1f2ee853fb1450aaa083cf06095be4a507416f47b9a58a1873d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:47 +0000 UTC - event for pod-0: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "57811b083819086e1b955fb8a443295496c72c50b018428715316af92f64056c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:48 +0000 UTC - event for pod-1: {kubelet i-08066f65509d69679} Started: Started container donothing
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:48 +0000 UTC - event for pod-1: {kubelet i-08066f65509d69679} Created: Created container donothing
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:48:48 +0000 UTC - event for pod-1: {kubelet i-08066f65509d69679} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:49:00 +0000 UTC - event for pod-0: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4e9d59ba901cad83004ebfbcff84fdeceaaff8a25ba58e59ca94f103104ed699": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:49:00 +0000 UTC - event for pod-2: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "89cba9aa0e95a549eead2610423478f8ac5fef571592507264766d649272a36f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:49:14 +0000 UTC - event for pod-2: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e0ee5d6e3fd49068604fde583324f5be7d7f523affb1d1ba50afa3d38a1cedee": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:49:15 +0000 UTC - event for pod-0: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a793d6423185bcb0eb3c1af5b7e923e20bc0755f0cae5cc0a977a9cc9e755b3b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:49:25 +0000 UTC - event for pod-2: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3b6bda5babe06eeb8400dbb1acf7d5e7d28d2b646685662f9e79aceac72f91bd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:49:27 +0000 UTC - event for pod-0: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8a381da9c4f60a1b9ed5941f34f4667061c4ef374b19b1667654a01738e7abd9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:49:38 +0000 UTC - event for pod-0: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6bf167ef10ef2bf9bba25c3704c0f01b3d2156af9a5fe802400a53b7ee96f727": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.783: INFO: At 2023-01-19 02:49:38 +0000 UTC - event for pod-2: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "12c7f132f5b320954b84e750e3dc78920661330cd5d7d120a27e6ac2ddf6d34c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:57:40.844: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 19 02:57:40.844: INFO: pod-0 i-0f8b7f8eacf81cd58 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:40 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:54:45 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:54:45 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:40 +0000 UTC }]
Jan 19 02:57:40.844: INFO: pod-1 i-08066f65509d69679 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:40 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:48:48 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:48:48 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:40 +0000 UTC }]
Jan 19 02:57:40.844: INFO: pod-2 i-0f8b7f8eacf81cd58 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:40 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:40 +0000 UTC ContainersNotReady containers with unready status: [donothing]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:40 +0000 UTC ContainersNotReady containers with unready status: [donothing]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:40 +0000 UTC }]
Jan 19 02:57:40.844: INFO:
Jan 19 02:57:41.037: INFO: Unable to fetch disruption-2088/pod-2/donothing logs: the server rejected our request for an unknown reason (get pods pod-2)
Jan 19 02:57:41.100: INFO:
Logging node info for node i-023e074b52731ec5a
Jan 19 02:57:41.161: INFO: Node Info: &Node{ObjectMeta:{i-023e074b52731ec5a e961fee7-3382-47b0-8744-433e44345d0f 22429 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-023e074b52731ec5a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-023e074b52731ec5a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.43 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-023e074b52731ec5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:56:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-023e074b52731ec5a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:47 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.43,},NodeAddress{Type:ExternalIP,Address:35.163.72.25,},NodeAddress{Type:InternalDNS,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-163-72-25.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2fdc458699464b606b9fca6747bb8e,SystemUUID:ec2fdc45-8699-464b-606b-9fca6747bb8e,BootID:c860ef30-1fd7-41be-b096-79723bc17c52,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 02:57:41.162: INFO:
Logging kubelet events for node i-023e074b52731ec5a
Jan 19 02:57:41.226: INFO:
Logging pods the kubelet thinks is on node i-023e074b52731ec5a
Jan 19 02:57:41.295: INFO: ebs-csi-node-txkj8 started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:57:41.295: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:57:41.295: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:57:41.295: INFO: hostexec-i-023e074b52731ec5a-54hsp started at 2023-01-19 02:53:57 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:57:41.295: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-k7tm4 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.295: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-rbxbc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.295: INFO: rs-s55zq started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container donothing ready: false, restart count 0
Jan 19 02:57:41.295: INFO: csi-mockplugin-0 started at 2023-01-19 02:55:03 +0000 UTC (0+4 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container busybox ready: false, restart count 0
Jan 19 02:57:41.295: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 02:57:41.295: INFO: Container driver-registrar ready: false, restart count 0
Jan 19 02:57:41.295: INFO: Container mock ready: false, restart count 0
Jan 19 02:57:41.295: INFO: pod-f913f52a-0733-4789-84b9-c3b5ee6db936 started at 2023-01-19 02:57:26 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container write-pod ready: false, restart count 0
Jan 19 02:57:41.295: INFO: coredns-559769c974-tc4gk started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container coredns ready: true, restart count 0
Jan 19 02:57:41.295: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gzrm9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.295: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-px9wv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0
Jan 19 02:57:41.295: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-kmq27 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.295: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nlzkq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.295: INFO: pod-274dfb82-42ec-4da2-a13a-f44e2e02e8e0 started at 2023-01-19 02:56:53 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container write-pod ready: false, restart count 0
Jan 19 02:57:41.295: INFO: hostexec-i-023e074b52731ec5a-jb4p2 started at 2023-01-19 02:57:19 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:57:41.295: INFO: cilium-4xgjg started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:57:41.295: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:57:41.295: INFO: coredns-autoscaler-7cb5c5b969-pkb4q started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container autoscaler ready: true, restart count 0
Jan 19 02:57:41.295: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z97mx started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.295: INFO: rs-8nq4k started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container donothing ready: false, restart count 0
Jan 19 02:57:41.295: INFO: pod-d9db111b-e3ea-492e-8d92-f800d7e5eb72 started at 2023-01-19 02:54:00 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container write-pod ready: true, restart count 0
Jan 19 02:57:41.295: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dzctr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.295: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nztbv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.295: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-fqdth started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.295: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.559: INFO:
Latency metrics for node i-023e074b52731ec5a
Jan 19 02:57:41.559: INFO:
Logging node info for node i-02d86c0c31a5b3e66
Jan 19 02:57:41.621: INFO: Node Info: &Node{ObjectMeta:{i-02d86c0c31a5b3e66 2b72ee85-8a44-46ad-89d8-94df5d455adf 21681 0 2023-01-19 02:33:41 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02d86c0c31a5b3e66 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-02d86c0c31a5b3e66 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.52.66 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3594":"i-02d86c0c31a5b3e66","ebs.csi.aws.com":"i-02d86c0c31a5b3e66"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:54:17 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:54:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-02d86c0c31a5b3e66,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.52.66,},NodeAddress{Type:ExternalIP,Address:54.218.213.176,},NodeAddress{Type:InternalDNS,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-218-213-176.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2854d64f7363e92b7b006397583f0a,SystemUUID:ec2854d6-4f73-63e9-2b7b-006397583f0a,BootID:a64d8535-a0a2-421b-b474-ed26b967c37a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-3594^900045cd-97a4-11ed-af43-d6e7a8e15f2d kubernetes.io/csi/csi-hostpath-ephemeral-3594^90009a58-97a4-11ed-af43-d6e7a8e15f2d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3594^90009a58-97a4-11ed-af43-d6e7a8e15f2d,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3594^900045cd-97a4-11ed-af43-d6e7a8e15f2d,DevicePath:,},},Config:nil,},}
Jan 19 02:57:41.622: INFO:
Logging kubelet events for node i-02d86c0c31a5b3e66
Jan 19 02:57:41.686: INFO:
Logging pods the kubelet thinks is on node i-02d86c0c31a5b3e66
Jan 19 02:57:41.756: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hkqgk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.756: INFO: inline-volume-tester-7nwl6 started at 2023-01-19 02:54:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:57:41.756: INFO: exec-volume-test-preprovisionedpv-9wvb started at 2023-01-19 02:56:57 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container exec-container-preprovisionedpv-9wvb ready: false, restart count 0
Jan 19 02:57:41.756: INFO: ebs-csi-node-vnlk5 started at 2023-01-19 02:33:41 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:57:41.756: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:57:41.756: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:57:41.756: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-46kbx started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.756: INFO: rs-ltlhr started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container donothing ready: false, restart count 0
Jan 19 02:57:41.756: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:53:05 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:57:41.756: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:57:41.756: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:57:41.756: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 19 02:57:41.756: INFO: Container hostpath ready: true, restart count 0
Jan 19 02:57:41.756: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:57:41.756: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:57:41.756: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-jq8pp started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.756: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-wm87d started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.756: INFO: coredns-559769c974-jhsx5 started at 2023-01-19 02:34:10 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container coredns ready: true, restart count 0
Jan 19 02:57:41.756: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hgwmq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.756: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-thtlz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.756: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gqbwh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.756: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-njqx8 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.756: INFO: cilium-dpz9q started at 2023-01-19 02:33:41 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:57:41.756: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:57:41.756: INFO: hostexec-i-02d86c0c31a5b3e66-c6b9d started at 2023-01-19 02:56:47 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:57:41.756: INFO: rs-gztrr started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container donothing ready: false, restart count 0
Jan 19 02:57:41.756: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4pps started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:41.756: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-r25l2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:41.756: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:42.017: INFO:
Latency metrics for node i-02d86c0c31a5b3e66
Jan 19 02:57:42.017: INFO:
Logging node info for node i-08066f65509d69679
Jan 19 02:57:42.079: INFO: Node Info: &Node{ObjectMeta:{i-08066f65509d69679 0be3effa-655e-4b68-9a19-46c9ab83ba9a 23010 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08066f65509d69679 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-08066f65509d69679 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.217 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08066f65509d69679"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:57:13 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:57:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-08066f65509d69679,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:13 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:13 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:13 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:57:13 +0000 UTC,LastTransitionTime:2023-01-19 02:33:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.217,},NodeAddress{Type:ExternalIP,Address:52.35.165.136,},NodeAddress{Type:InternalDNS,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-35-165-136.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ef74bd259aa6181a8189c00469b84,SystemUUID:ec2ef74b-d259-aa61-81a8-189c00469b84,BootID:14a8f3be-4273-41bf-906d-a4c0fdb82ba0,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0605a173a7f86b39e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0605a173a7f86b39e,DevicePath:,},},Config:nil,},}
Jan 19 02:57:42.079: INFO:
Logging kubelet events for node i-08066f65509d69679
Jan 19 02:57:42.144: INFO:
Logging pods the kubelet thinks is on node i-08066f65509d69679
Jan 19 02:57:42.222: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dvwqc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:42.222: INFO: pod-subpath-test-inlinevolume-fq8p started at 2023-01-19 02:52:44 +0000 UTC (1+2 container statuses recorded)
Jan 19 02:57:42.222: INFO: Init container test-init-subpath-inlinevolume-fq8p ready: false, restart count 0
Jan 19 02:57:42.222: INFO: Container test-container-subpath-inlinevolume-fq8p ready: false, restart count 0
Jan 19 02:57:42.222: INFO: Container test-container-volume-inlinevolume-fq8p ready: false, restart count 0
Jan 19 02:57:42.222: INFO: inline-volume-tester-dq7cv started at 2023-01-19 02:56:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:57:42.222: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-tvhph started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:42.222: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-49t56 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:42.222: INFO: pod-secrets-33c93402-1aa1-44cc-a43f-3e0a2cd8d580 started at 2023-01-19 02:57:39 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container secret-test ready: false, restart count 0
Jan 19 02:57:42.222: INFO: rs-6h9rl started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container donothing ready: false, restart count 0
Jan 19 02:57:42.222: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-sshfj started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:42.222: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z4wjr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:42.222: INFO: ebs-csi-node-szxtn started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:57:42.222: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:57:42.222: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:57:42.222: INFO: labelsupdate23aafa88-3d8f-462e-9cbe-2d3fc1b93938 started at 2023-01-19 02:57:09 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container client-container ready: false, restart count 0
Jan 19 02:57:42.222: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-266nr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:42.222: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-cqpsv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.222: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:42.222: INFO: cilium-c7s4l started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:57:42.223: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:57:42.223: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:57:42.223: INFO: dns-test-5098d2f6-a28d-40cc-b7a7-f87066d5e580 started at 2023-01-19 02:56:50 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:57:42.223: INFO: Container jessie-querier ready: false, restart count 0
Jan 19 02:57:42.223: INFO: Container querier ready: false, restart count 0
Jan 19 02:57:42.223: INFO: Container webserver ready: false, restart count 0
Jan 19 02:57:42.223: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-qr89m started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.223: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:42.223: INFO: rs-cgwkr started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.223: INFO: Container donothing ready: false, restart count 0
Jan 19 02:57:42.223: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5mxxc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.223: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:42.223: INFO: pod-1 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.223: INFO: Container donothing ready: true, restart count 0
Jan 19 02:57:42.223: INFO: rs-fql89 started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.223: INFO: Container donothing ready: false, restart count 0
Jan 19 02:57:42.223: INFO: externalname-service-f9p78 started at 2023-01-19 02:56:07 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.223: INFO: Container externalname-service ready: false, restart count 0
Jan 19 02:57:42.223: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:56:32 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:57:42.223: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 02:57:42.223: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 02:57:42.223: INFO: Container csi-resizer ready: false, restart count 0
Jan 19 02:57:42.223: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 19 02:57:42.223: INFO: Container hostpath ready: false, restart count 0
Jan 19 02:57:42.223: INFO: Container liveness-probe ready: false, restart count 0
Jan 19 02:57:42.223: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 19 02:57:42.223: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5prrc started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.223: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:42.223: INFO: sample-webhook-deployment-865554f4d9-m42tj started at 2023-01-19 02:57:37 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.223: INFO: Container sample-webhook ready: false, restart count 0
Jan 19 02:57:42.498: INFO:
Latency metrics for node i-08066f65509d69679
Jan 19 02:57:42.498: INFO:
Logging node info for node i-098a14e8a4aca3f52
Jan 19 02:57:42.560: INFO: Node Info: &Node{ObjectMeta:{i-098a14e8a4aca3f52 7d2548e6-f0b4-43c4-880f-93f669b42eab 21756 0 2023-01-19 02:32:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-098a14e8a4aca3f52 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.164 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-098a14e8a4aca3f52"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 02:32:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-19 02:32:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:32:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 02:54:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-098a14e8a4aca3f52,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.164,},NodeAddress{Type:ExternalIP,Address:35.89.228.171,},NodeAddress{Type:InternalDNS,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-89-228-171.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2da2cd6ae96e63652bd883a94f495c,SystemUUID:ec2da2cd-6ae9-6e63-652b-d883a94f495c,BootID:7a95f25a-dfd5-459e-b4a5-db275a1b4e67,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191755,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821707,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965792,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 02:57:42.560: INFO:
Logging kubelet events for node i-098a14e8a4aca3f52
Jan 19 02:57:42.624: INFO:
Logging pods the kubelet thinks is on node i-098a14e8a4aca3f52
Jan 19 02:57:42.692: INFO: kube-controller-manager-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.692: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 19 02:57:42.692: INFO: kube-scheduler-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.692: INFO: Container kube-scheduler ready: true, restart count 0
Jan 19 02:57:42.692: INFO: cilium-operator-6f8d6c4bf-tr54z started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.692: INFO: Container cilium-operator ready: true, restart count 0
Jan 19 02:57:42.692: INFO: ebs-csi-controller-89bddb897-vfp22 started at 2023-01-19 02:32:43 +0000 UTC (0+5 container statuses recorded)
Jan 19 02:57:42.692: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:57:42.692: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:57:42.692: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:57:42.692: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:57:42.692: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:57:42.692: INFO: dns-controller-74d4646d88-9znsr started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.692: INFO: Container dns-controller ready: true, restart count 0
Jan 19 02:57:42.692: INFO: kops-controller-rkkdt started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.692: INFO: Container kops-controller ready: true, restart count 0
Jan 19 02:57:42.692: INFO: etcd-manager-events-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.692: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 02:57:42.692: INFO: etcd-manager-main-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.692: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 02:57:42.692: INFO: kube-apiserver-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+2 container statuses recorded)
Jan 19 02:57:42.692: INFO: Container healthcheck ready: true, restart count 0
Jan 19 02:57:42.692: INFO: Container kube-apiserver ready: true, restart count 1
Jan 19 02:57:42.692: INFO: ebs-csi-node-trsl9 started at 2023-01-19 02:32:40 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:57:42.692: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:57:42.692: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:57:42.692: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:57:42.692: INFO: cilium-knt4k started at 2023-01-19 02:32:40 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:57:42.692: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:57:42.692: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:57:42.692: INFO: aws-cloud-controller-manager-4c7k7 started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:42.692: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 19 02:57:42.928: INFO:
Latency metrics for node i-098a14e8a4aca3f52
Jan 19 02:57:42.928: INFO:
Logging node info for node i-0f8b7f8eacf81cd58
Jan 19 02:57:42.992: INFO: Node Info: &Node{ObjectMeta:{i-0f8b7f8eacf81cd58 969780cc-600f-4d79-80fa-2e681c67e470 22781 0 2023-01-19 02:33:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f8b7f8eacf81cd58 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-0f8b7f8eacf81cd58 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f8b7f8eacf81cd58"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:57:03 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:57:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0f8b7f8eacf81cd58,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.113,},NodeAddress{Type:ExternalIP,Address:54.188.219.55,},NodeAddress{Type:InternalDNS,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-188-219-55.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec296be3bda6a5cf5f1cfc033b1bb6bb,SystemUUID:ec296be3-bda6-a5cf-5f1c-fc033b1bb6bb,BootID:2cccdc7f-1458-4e66-9053-d2f4c0f3fc70,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a,DevicePath:,},},Config:nil,},}
Jan 19 02:57:42.993: INFO:
Logging kubelet events for node i-0f8b7f8eacf81cd58
Jan 19 02:57:43.057: INFO:
Logging pods the kubelet thinks is on node i-0f8b7f8eacf81cd58
Jan 19 02:57:43.127: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4hdh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:43.127: INFO: csi-mockplugin-0 started at 2023-01-19 02:57:13 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 02:57:43.127: INFO: Container driver-registrar ready: false, restart count 0
Jan 19 02:57:43.127: INFO: Container mock ready: false, restart count 0
Jan 19 02:57:43.127: INFO: pod-2 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container donothing ready: false, restart count 0
Jan 19 02:57:43.127: INFO: inline-volume-tester-m6c6d started at 2023-01-19 02:47:11 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:57:43.127: INFO: httpd started at 2023-01-19 02:57:22 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container httpd ready: false, restart count 0
Jan 19 02:57:43.127: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8cnst started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:43.127: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-t8z58 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:43.127: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-72jsz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:43.127: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8vqd9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:43.127: INFO: cilium-mpc7m started at 2023-01-19 02:33:37 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:57:43.127: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:57:43.127: INFO: rs-cltdf started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container donothing ready: false, restart count 0
Jan 19 02:57:43.127: INFO: dns-test-b47ec622-3c9e-4a50-8572-e5911975e43a started at 2023-01-19 02:54:10 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container jessie-querier ready: false, restart count 0
Jan 19 02:57:43.127: INFO: Container querier ready: false, restart count 0
Jan 19 02:57:43.127: INFO: Container webserver ready: false, restart count 0
Jan 19 02:57:43.127: INFO: externalname-service-cr8rp started at 2023-01-19 02:56:07 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container externalname-service ready: false, restart count 0
Jan 19 02:57:43.127: INFO: e2e-test-httpd-pod started at 2023-01-19 02:57:35 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container e2e-test-httpd-pod ready: false, restart count 0
Jan 19 02:57:43.127: INFO: agnhost-primary-l5zgv started at 2023-01-19 02:56:50 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container agnhost-primary ready: false, restart count 0
Jan 19 02:57:43.127: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dw974 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:43.127: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hb6r2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:43.127: INFO: rs-nsjcr started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container donothing ready: false, restart count 0
Jan 19 02:57:43.127: INFO: rs-zhl54 started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container donothing ready: true, restart count 0
Jan 19 02:57:43.127: INFO: ebs-csi-node-x2rds started at 2023-01-19 02:33:37 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:57:43.127: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:57:43.127: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:57:43.127: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-bd6fk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:43.127: INFO: pod-0 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container donothing ready: true, restart count 0
Jan 19 02:57:43.127: INFO: alpine-nnp-true-8e79b682-81e8-4275-8808-5233e6af5e8c started at 2023-01-19 02:57:30 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container alpine-nnp-true-8e79b682-81e8-4275-8808-5233e6af5e8c ready: false, restart count 0
Jan 19 02:57:43.127: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-c8gns started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:43.127: INFO: pod-ready started at 2023-01-19 02:56:58 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container pod-readiness-gate ready: false, restart count 0
Jan 19 02:57:43.127: INFO: csi-mockplugin-attacher-0 started at 2023-01-19 02:57:13 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 02:57:43.127: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-m7587 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:57:43.127: INFO: probe-test-126ae020-cadf-4777-bb25-ed14ee1ae642 started at 2023-01-19 02:56:42 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:57:43.127: INFO: Container probe-test-126ae020-cadf-4777-bb25-ed14ee1ae642 ready: false, restart count 0
Jan 19 02:57:43.416: INFO:
Latency metrics for node i-0f8b7f8eacf81cd58
[DeferCleanup (Each)] [sig-apps] DisruptionController
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "disruption-2088" for this suite. �[38;5;243m01/19/23 02:57:43.417�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sJob\sshould\snot\screate\spods\swhen\screated\sin\ssuspend\sstate$'
test/e2e/apps/job.go:310 k8s.io/kubernetes/test/e2e/apps.glob..func7.5() test/e2e/apps/job.go:310 +0x5f9from junit_01.xml
[BeforeEach] [sig-apps] Job set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 02:41:56.413�[0m Jan 19 02:41:56.413: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename job �[38;5;243m01/19/23 02:41:56.414�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 02:41:56.598�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 02:41:56.719�[0m [BeforeEach] [sig-apps] Job test/e2e/framework/metrics/init/init.go:31 [It] should not create pods when created in suspend state test/e2e/apps/job.go:275 �[1mSTEP:�[0m Creating a job with suspend=true �[38;5;243m01/19/23 02:41:56.84�[0m �[1mSTEP:�[0m Ensuring pods aren't created for job �[38;5;243m01/19/23 02:41:56.902�[0m �[1mSTEP:�[0m Checking Job status to observe Suspended state �[38;5;243m01/19/23 02:42:27.024�[0m �[1mSTEP:�[0m Updating the job with suspend=false �[38;5;243m01/19/23 02:42:27.085�[0m �[1mSTEP:�[0m Waiting for job to complete �[38;5;243m01/19/23 02:42:27.15�[0m Jan 19 02:57:27.272: INFO: Unexpected error: failed to ensure job completion in namespace: job-4899: <*errors.errorString | 0xc00016fa80>: { s: "timed out waiting for the condition", } Jan 19 02:57:27.273: FAIL: failed to ensure job completion in namespace: job-4899: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func7.5() test/e2e/apps/job.go:310 +0x5f9 [AfterEach] [sig-apps] Job test/e2e/framework/node/init/init.go:32 Jan 19 02:57:27.273: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] Job test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-apps] Job dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 02:57:27.335�[0m �[1mSTEP:�[0m Collecting events from namespace "job-4899". �[38;5;243m01/19/23 02:57:27.336�[0m �[1mSTEP:�[0m Found 32 events. �[38;5;243m01/19/23 02:57:27.398�[0m Jan 19 02:57:27.398: INFO: At 2023-01-19 02:41:56 +0000 UTC - event for suspend-true-to-false: {job-controller } Suspended: Job suspended Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:27 +0000 UTC - event for suspend-true-to-false: {job-controller } SuccessfulCreate: Created pod: suspend-true-to-false-gvdhj Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:27 +0000 UTC - event for suspend-true-to-false: {job-controller } SuccessfulCreate: Created pod: suspend-true-to-false-qkh4c Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:27 +0000 UTC - event for suspend-true-to-false: {job-controller } Resumed: Job resumed Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:27 +0000 UTC - event for suspend-true-to-false-gvdhj: {default-scheduler } Scheduled: Successfully assigned job-4899/suspend-true-to-false-gvdhj to i-0f8b7f8eacf81cd58 Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:27 +0000 UTC - event for suspend-true-to-false-gvdhj: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3cbbf60f3bf08d46c11f92bac00244c1af0daf615b17d17246d48ea3ccc3ac4e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:27 +0000 UTC - event for suspend-true-to-false-qkh4c: {default-scheduler } Scheduled: Successfully assigned job-4899/suspend-true-to-false-qkh4c to i-0f8b7f8eacf81cd58 Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:27 +0000 UTC - event for suspend-true-to-false-qkh4c: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8c391c49690f1c3d1e07441e361bb4bc8a77ede9b164a17902a0134b71fc06d8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:41 +0000 UTC - event for suspend-true-to-false-gvdhj: {kubelet i-0f8b7f8eacf81cd58} Created: Created container c Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:41 +0000 UTC - event for suspend-true-to-false-gvdhj: {kubelet i-0f8b7f8eacf81cd58} Started: Started container c Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:41 +0000 UTC - event for suspend-true-to-false-gvdhj: {kubelet i-0f8b7f8eacf81cd58} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:41 +0000 UTC - event for suspend-true-to-false-qkh4c: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "251999e2acc7376a668221f3105c73b016fce2f8cb262cf05ed713fe0c12facc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:45 +0000 UTC - event for suspend-true-to-false: {job-controller } SuccessfulCreate: Created pod: suspend-true-to-false-s5btk Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:45 +0000 UTC - event for suspend-true-to-false-s5btk: {default-scheduler } Scheduled: Successfully assigned job-4899/suspend-true-to-false-s5btk to i-0f8b7f8eacf81cd58 Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:45 +0000 UTC - event for suspend-true-to-false-s5btk: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9635a824f70acc2528996a317b54b8d45d4a19b59d388ef7e79346c825e5cfb5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:42:55 +0000 UTC - event for suspend-true-to-false-qkh4c: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "78d53e863028a021db90a5e470a549b89533c503ab19062cc760dbcca07d5ab3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:43:00 +0000 UTC - event for suspend-true-to-false-s5btk: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e1a390e20602fe98a321496e2d1ee399ac7b61e7a7e3ce29331f352210f3fa05": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:43:06 +0000 UTC - event for suspend-true-to-false-qkh4c: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d028e652cd59f55c9c9dd23f1092a1e1bd485e5189bae2b34b0e091572bd4533": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:43:14 +0000 UTC - event for suspend-true-to-false-s5btk: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6d7e66776b89485fe1bb9b57303940803e20d25585bfb00e3878b973e423a106": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:43:21 +0000 UTC - event for suspend-true-to-false-qkh4c: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d8bc35074cde0d16642e0e33430cb99eba4884093fd4edfa9d1601f894b3d5b4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:43:26 +0000 UTC - event for suspend-true-to-false-s5btk: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "aae4af84d8fd1f3e6298d9c94cc0fbcb3ccf67b7ab5fb2e7d15e72fe6a396cc6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:43:35 +0000 UTC - event for suspend-true-to-false-qkh4c: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2f834b6abdccb2c09b815b6b15141f51772e24051a13b13cc29d99577b179ace": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:43:38 +0000 UTC - event for suspend-true-to-false-s5btk: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a00fc771c733a9d8c7bacd74779fc5a56d6048c0a1fb5e86af651d1564522158": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:43:49 +0000 UTC - event for suspend-true-to-false-qkh4c: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "816fcd21cd8915eb158ec64274377f90cae2684f591d44e099f9ec1e6126eb94": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:43:53 +0000 UTC - event for suspend-true-to-false-s5btk: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c23ebc1f1311f4f17660681c0909e8220b7c520b9e332ee809f84c609ca18d4f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:44:03 +0000 UTC - event for suspend-true-to-false-qkh4c: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4c74b56032685c401e53603b8585ad2383fdbfe54b64bc1ce72a80fae004a2fa": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:44:06 +0000 UTC - event for suspend-true-to-false-s5btk: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "265ef5b00f03fafebe5f346e37c750d50a23fb328df4cdedb8172aedfe2a2a67": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:44:15 +0000 UTC - event for suspend-true-to-false-qkh4c: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e0ef49e0cf0f36b19062b18ebf0d9373a7a3391bd378133ed69ebdb915f83f0a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:44:17 +0000 UTC - event for suspend-true-to-false-s5btk: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "67096fb71b792c5b1664ae088dca8581c49060f689433c3090c8fef5d818e9b1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:44:29 +0000 UTC - event for suspend-true-to-false-qkh4c: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9208c10b737e8f35d1fc5e3f781efdcb0bb6fcfc702537db63240d49f23509a2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:44:31 +0000 UTC - event for suspend-true-to-false-s5btk: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "82bc578be50c913f0161c76054a4763c854a206c9d0d188c10a889f38d5d3ef3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.398: INFO: At 2023-01-19 02:44:43 +0000 UTC - event for suspend-true-to-false-s5btk: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "300801735241ee1a9c5beb25d5245f609261046c71d5951d7f4a596e9d84fb8b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:27.459: INFO: POD NODE PHASE GRACE CONDITIONS Jan 19 02:57:27.459: INFO: suspend-true-to-false-gvdhj i-0f8b7f8eacf81cd58 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:27 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:27 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:27 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:27 +0000 UTC }] Jan 19 02:57:27.459: INFO: suspend-true-to-false-qkh4c i-0f8b7f8eacf81cd58 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:27 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:27 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:27 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:27 +0000 UTC }] Jan 19 02:57:27.459: INFO: suspend-true-to-false-s5btk i-0f8b7f8eacf81cd58 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:45 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:45 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:45 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:42:45 +0000 UTC }] Jan 19 02:57:27.459: INFO: Jan 19 02:57:27.585: INFO: Unable to fetch job-4899/suspend-true-to-false-qkh4c/c logs: the server rejected our request for an unknown reason (get pods suspend-true-to-false-qkh4c) Jan 19 02:57:27.647: INFO: Unable to fetch job-4899/suspend-true-to-false-s5btk/c logs: the server rejected our request for an unknown reason (get pods suspend-true-to-false-s5btk) Jan 19 02:57:27.709: INFO: Logging node info for node i-023e074b52731ec5a Jan 19 02:57:27.770: INFO: Node Info: &Node{ObjectMeta:{i-023e074b52731ec5a e961fee7-3382-47b0-8744-433e44345d0f 22429 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-023e074b52731ec5a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-023e074b52731ec5a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.43 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-023e074b52731ec5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:56:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-023e074b52731ec5a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:47 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.43,},NodeAddress{Type:ExternalIP,Address:35.163.72.25,},NodeAddress{Type:InternalDNS,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-163-72-25.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2fdc458699464b606b9fca6747bb8e,SystemUUID:ec2fdc45-8699-464b-606b-9fca6747bb8e,BootID:c860ef30-1fd7-41be-b096-79723bc17c52,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 02:57:27.771: INFO: Logging kubelet events for node i-023e074b52731ec5a Jan 19 02:57:27.835: INFO: Logging pods the kubelet thinks is on node i-023e074b52731ec5a Jan 19 02:57:27.908: INFO: pod-274dfb82-42ec-4da2-a13a-f44e2e02e8e0 started at 2023-01-19 02:56:53 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container write-pod ready: false, restart count 0 Jan 19 02:57:27.908: INFO: hostexec-i-023e074b52731ec5a-jb4p2 started at 2023-01-19 02:57:19 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:57:27.908: INFO: coredns-559769c974-tc4gk started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container coredns ready: true, restart count 0 Jan 19 02:57:27.908: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gzrm9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:27.908: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-px9wv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0 Jan 19 02:57:27.908: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-kmq27 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:27.908: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nlzkq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:27.908: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z97mx started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:27.908: INFO: cilium-4xgjg started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:57:27.908: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:57:27.908: INFO: coredns-autoscaler-7cb5c5b969-pkb4q started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container autoscaler ready: true, restart count 0 Jan 19 02:57:27.908: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nztbv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:27.908: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-fqdth started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:27.908: INFO: rs-8nq4k started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:27.908: INFO: pod-d9db111b-e3ea-492e-8d92-f800d7e5eb72 started at 2023-01-19 02:54:00 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container write-pod ready: true, restart count 0 Jan 19 02:57:27.908: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dzctr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:27.908: INFO: csi-mockplugin-0 started at 2023-01-19 02:55:03 +0000 UTC (0+4 container statuses recorded) Jan 19 02:57:27.908: INFO: Container busybox ready: false, restart count 0 Jan 19 02:57:27.908: INFO: Container csi-provisioner ready: false, restart count 0 Jan 19 02:57:27.908: INFO: Container driver-registrar ready: false, restart count 0 Jan 19 02:57:27.908: INFO: Container mock ready: false, restart count 0 Jan 19 02:57:27.908: INFO: pod-f913f52a-0733-4789-84b9-c3b5ee6db936 started at 2023-01-19 02:57:26 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container write-pod ready: false, restart count 0 Jan 19 02:57:27.908: INFO: ebs-csi-node-txkj8 started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded) Jan 19 02:57:27.908: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:57:27.908: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:57:27.908: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:57:27.908: INFO: hostexec-i-023e074b52731ec5a-54hsp started at 2023-01-19 02:53:57 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:57:27.908: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-k7tm4 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:27.908: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-rbxbc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:27.908: INFO: rs-s55zq started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:27.908: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:28.219: INFO: Latency metrics for node i-023e074b52731ec5a Jan 19 02:57:28.219: INFO: Logging node info for node i-02d86c0c31a5b3e66 Jan 19 02:57:28.281: INFO: Node Info: &Node{ObjectMeta:{i-02d86c0c31a5b3e66 2b72ee85-8a44-46ad-89d8-94df5d455adf 21681 0 2023-01-19 02:33:41 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02d86c0c31a5b3e66 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-02d86c0c31a5b3e66 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.52.66 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3594":"i-02d86c0c31a5b3e66","ebs.csi.aws.com":"i-02d86c0c31a5b3e66"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:54:17 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:54:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-02d86c0c31a5b3e66,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.52.66,},NodeAddress{Type:ExternalIP,Address:54.218.213.176,},NodeAddress{Type:InternalDNS,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-218-213-176.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2854d64f7363e92b7b006397583f0a,SystemUUID:ec2854d6-4f73-63e9-2b7b-006397583f0a,BootID:a64d8535-a0a2-421b-b474-ed26b967c37a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-3594^900045cd-97a4-11ed-af43-d6e7a8e15f2d kubernetes.io/csi/csi-hostpath-ephemeral-3594^90009a58-97a4-11ed-af43-d6e7a8e15f2d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3594^90009a58-97a4-11ed-af43-d6e7a8e15f2d,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3594^900045cd-97a4-11ed-af43-d6e7a8e15f2d,DevicePath:,},},Config:nil,},} Jan 19 02:57:28.281: INFO: Logging kubelet events for node i-02d86c0c31a5b3e66 Jan 19 02:57:28.344: INFO: Logging pods the kubelet thinks is on node i-02d86c0c31a5b3e66 Jan 19 02:57:28.412: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-r25l2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.412: INFO: cilium-dpz9q started at 2023-01-19 02:33:41 +0000 UTC (1+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:57:28.412: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:57:28.412: INFO: hostexec-i-02d86c0c31a5b3e66-c6b9d started at 2023-01-19 02:56:47 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:57:28.412: INFO: rs-gztrr started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:28.412: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4pps started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.412: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hkqgk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.412: INFO: inline-volume-tester-7nwl6 started at 2023-01-19 02:54:17 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:57:28.412: INFO: exec-volume-test-preprovisionedpv-9wvb started at 2023-01-19 02:56:57 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container exec-container-preprovisionedpv-9wvb ready: false, restart count 0 Jan 19 02:57:28.412: INFO: ebs-csi-node-vnlk5 started at 2023-01-19 02:33:41 +0000 UTC (0+3 container statuses recorded) Jan 19 02:57:28.412: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:57:28.412: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:57:28.412: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:57:28.412: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-46kbx started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.412: INFO: rs-ltlhr started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:28.412: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:53:05 +0000 UTC (0+7 container statuses recorded) Jan 19 02:57:28.412: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 02:57:28.412: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 02:57:28.412: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 02:57:28.412: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 19 02:57:28.412: INFO: Container hostpath ready: true, restart count 0 Jan 19 02:57:28.412: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:57:28.412: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:57:28.412: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-jq8pp started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.412: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-wm87d started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.412: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gqbwh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.412: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-njqx8 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.412: INFO: coredns-559769c974-jhsx5 started at 2023-01-19 02:34:10 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container coredns ready: true, restart count 0 Jan 19 02:57:28.412: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hgwmq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.412: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-thtlz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.412: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.698: INFO: Latency metrics for node i-02d86c0c31a5b3e66 Jan 19 02:57:28.698: INFO: Logging node info for node i-08066f65509d69679 Jan 19 02:57:28.759: INFO: Node Info: &Node{ObjectMeta:{i-08066f65509d69679 0be3effa-655e-4b68-9a19-46c9ab83ba9a 23010 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08066f65509d69679 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-08066f65509d69679 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.217 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-08066f65509d69679"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:57:13 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:57:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-08066f65509d69679,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:13 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:13 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:13 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:57:13 +0000 UTC,LastTransitionTime:2023-01-19 02:33:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.217,},NodeAddress{Type:ExternalIP,Address:52.35.165.136,},NodeAddress{Type:InternalDNS,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-35-165-136.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ef74bd259aa6181a8189c00469b84,SystemUUID:ec2ef74b-d259-aa61-81a8-189c00469b84,BootID:14a8f3be-4273-41bf-906d-a4c0fdb82ba0,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0605a173a7f86b39e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0605a173a7f86b39e,DevicePath:,},},Config:nil,},} Jan 19 02:57:28.759: INFO: Logging kubelet events for node i-08066f65509d69679 Jan 19 02:57:28.823: INFO: Logging pods the kubelet thinks is on node i-08066f65509d69679 Jan 19 02:57:28.892: INFO: pod-1 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container donothing ready: true, restart count 0 Jan 19 02:57:28.892: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-qr89m started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.892: INFO: rs-cgwkr started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:28.892: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5mxxc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.892: INFO: rs-fql89 started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:28.892: INFO: externalname-service-f9p78 started at 2023-01-19 02:56:07 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container externalname-service ready: false, restart count 0 Jan 19 02:57:28.892: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:56:32 +0000 UTC (0+7 container statuses recorded) Jan 19 02:57:28.892: INFO: Container csi-attacher ready: false, restart count 0 Jan 19 02:57:28.892: INFO: Container csi-provisioner ready: false, restart count 0 Jan 19 02:57:28.892: INFO: Container csi-resizer ready: false, restart count 0 Jan 19 02:57:28.892: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 19 02:57:28.892: INFO: Container hostpath ready: false, restart count 0 Jan 19 02:57:28.892: INFO: Container liveness-probe ready: false, restart count 0 Jan 19 02:57:28.892: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 19 02:57:28.892: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5prrc started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.892: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dvwqc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.892: INFO: pod-subpath-test-inlinevolume-fq8p started at 2023-01-19 02:52:44 +0000 UTC (1+2 container statuses recorded) Jan 19 02:57:28.892: INFO: Init container test-init-subpath-inlinevolume-fq8p ready: false, restart count 0 Jan 19 02:57:28.892: INFO: Container test-container-subpath-inlinevolume-fq8p ready: false, restart count 0 Jan 19 02:57:28.892: INFO: Container test-container-volume-inlinevolume-fq8p ready: false, restart count 0 Jan 19 02:57:28.892: INFO: inline-volume-tester-dq7cv started at 2023-01-19 02:56:59 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:57:28.892: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-tvhph started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.892: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-49t56 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.892: INFO: rs-6h9rl started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:28.892: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-sshfj started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.892: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z4wjr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.892: INFO: pod-0 started at 2023-01-19 02:52:12 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:28.892: INFO: ebs-csi-node-szxtn started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded) Jan 19 02:57:28.892: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:57:28.892: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:57:28.892: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:57:28.892: INFO: labelsupdate23aafa88-3d8f-462e-9cbe-2d3fc1b93938 started at 2023-01-19 02:57:09 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container client-container ready: false, restart count 0 Jan 19 02:57:28.892: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-266nr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.892: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-cqpsv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:28.892: INFO: cilium-c7s4l started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded) Jan 19 02:57:28.892: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:57:28.892: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:57:28.892: INFO: dns-test-5098d2f6-a28d-40cc-b7a7-f87066d5e580 started at 2023-01-19 02:56:50 +0000 UTC (0+3 container statuses recorded) Jan 19 02:57:28.892: INFO: Container jessie-querier ready: false, restart count 0 Jan 19 02:57:28.892: INFO: Container querier ready: false, restart count 0 Jan 19 02:57:28.892: INFO: Container webserver ready: false, restart count 0 Jan 19 02:57:29.144: INFO: Latency metrics for node i-08066f65509d69679 Jan 19 02:57:29.144: INFO: Logging node info for node i-098a14e8a4aca3f52 Jan 19 02:57:29.205: INFO: Node Info: &Node{ObjectMeta:{i-098a14e8a4aca3f52 7d2548e6-f0b4-43c4-880f-93f669b42eab 21756 0 2023-01-19 02:32:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-098a14e8a4aca3f52 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.164 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-098a14e8a4aca3f52"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 02:32:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-19 02:32:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:32:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 02:54:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-098a14e8a4aca3f52,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.164,},NodeAddress{Type:ExternalIP,Address:35.89.228.171,},NodeAddress{Type:InternalDNS,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-89-228-171.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2da2cd6ae96e63652bd883a94f495c,SystemUUID:ec2da2cd-6ae9-6e63-652b-d883a94f495c,BootID:7a95f25a-dfd5-459e-b4a5-db275a1b4e67,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191755,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821707,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965792,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 02:57:29.206: INFO: Logging kubelet events for node i-098a14e8a4aca3f52 Jan 19 02:57:29.269: INFO: Logging pods the kubelet thinks is on node i-098a14e8a4aca3f52 Jan 19 02:57:29.336: INFO: kube-controller-manager-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.336: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 19 02:57:29.336: INFO: kube-scheduler-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.336: INFO: Container kube-scheduler ready: true, restart count 0 Jan 19 02:57:29.336: INFO: cilium-operator-6f8d6c4bf-tr54z started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.336: INFO: Container cilium-operator ready: true, restart count 0 Jan 19 02:57:29.336: INFO: ebs-csi-controller-89bddb897-vfp22 started at 2023-01-19 02:32:43 +0000 UTC (0+5 container statuses recorded) Jan 19 02:57:29.336: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 02:57:29.336: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 02:57:29.336: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 02:57:29.336: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:57:29.336: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:57:29.336: INFO: dns-controller-74d4646d88-9znsr started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.336: INFO: Container dns-controller ready: true, restart count 0 Jan 19 02:57:29.336: INFO: etcd-manager-events-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.336: INFO: Container etcd-manager ready: true, restart count 0 Jan 19 02:57:29.336: INFO: etcd-manager-main-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.336: INFO: Container etcd-manager ready: true, restart count 0 Jan 19 02:57:29.336: INFO: kube-apiserver-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+2 container statuses recorded) Jan 19 02:57:29.336: INFO: Container healthcheck ready: true, restart count 0 Jan 19 02:57:29.336: INFO: Container kube-apiserver ready: true, restart count 1 Jan 19 02:57:29.336: INFO: ebs-csi-node-trsl9 started at 2023-01-19 02:32:40 +0000 UTC (0+3 container statuses recorded) Jan 19 02:57:29.336: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:57:29.336: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:57:29.336: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:57:29.336: INFO: cilium-knt4k started at 2023-01-19 02:32:40 +0000 UTC (1+1 container statuses recorded) Jan 19 02:57:29.336: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:57:29.336: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:57:29.336: INFO: aws-cloud-controller-manager-4c7k7 started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.336: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 19 02:57:29.336: INFO: kops-controller-rkkdt started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.336: INFO: Container kops-controller ready: true, restart count 0 Jan 19 02:57:29.570: INFO: Latency metrics for node i-098a14e8a4aca3f52 Jan 19 02:57:29.570: INFO: Logging node info for node i-0f8b7f8eacf81cd58 Jan 19 02:57:29.631: INFO: Node Info: &Node{ObjectMeta:{i-0f8b7f8eacf81cd58 969780cc-600f-4d79-80fa-2e681c67e470 22781 0 2023-01-19 02:33:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f8b7f8eacf81cd58 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-0f8b7f8eacf81cd58 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f8b7f8eacf81cd58"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:57:03 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:57:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0f8b7f8eacf81cd58,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.113,},NodeAddress{Type:ExternalIP,Address:54.188.219.55,},NodeAddress{Type:InternalDNS,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-188-219-55.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec296be3bda6a5cf5f1cfc033b1bb6bb,SystemUUID:ec296be3-bda6-a5cf-5f1c-fc033b1bb6bb,BootID:2cccdc7f-1458-4e66-9053-d2f4c0f3fc70,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a,DevicePath:,},},Config:nil,},} Jan 19 02:57:29.631: INFO: Logging kubelet events for node i-0f8b7f8eacf81cd58 Jan 19 02:57:29.702: INFO: Logging pods the kubelet thinks is on node i-0f8b7f8eacf81cd58 Jan 19 02:57:29.776: INFO: pod-0 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container donothing ready: true, restart count 0 Jan 19 02:57:29.776: INFO: ebs-csi-node-x2rds started at 2023-01-19 02:33:37 +0000 UTC (0+3 container statuses recorded) Jan 19 02:57:29.776: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:57:29.776: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:57:29.776: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:57:29.776: INFO: suspend-true-to-false-gvdhj started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container c ready: false, restart count 0 Jan 19 02:57:29.776: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-bd6fk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:29.776: INFO: pod-subpath-test-preprovisionedpv-n92q started at 2023-01-19 02:52:41 +0000 UTC (1+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Init container init-volume-preprovisionedpv-n92q ready: true, restart count 0 Jan 19 02:57:29.776: INFO: Container test-container-subpath-preprovisionedpv-n92q ready: false, restart count 0 Jan 19 02:57:29.776: INFO: pod-ready started at 2023-01-19 02:56:58 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container pod-readiness-gate ready: false, restart count 0 Jan 19 02:57:29.776: INFO: csi-mockplugin-attacher-0 started at 2023-01-19 02:57:13 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container csi-attacher ready: false, restart count 0 Jan 19 02:57:29.776: INFO: suspend-true-to-false-qkh4c started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container c ready: false, restart count 0 Jan 19 02:57:29.776: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-c8gns started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:29.776: INFO: suspend-true-to-false-s5btk started at 2023-01-19 02:42:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container c ready: false, restart count 0 Jan 19 02:57:29.776: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-m7587 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:29.776: INFO: probe-test-126ae020-cadf-4777-bb25-ed14ee1ae642 started at 2023-01-19 02:56:42 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container probe-test-126ae020-cadf-4777-bb25-ed14ee1ae642 ready: false, restart count 0 Jan 19 02:57:29.776: INFO: pod-2 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:29.776: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4hdh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:29.776: INFO: csi-mockplugin-0 started at 2023-01-19 02:57:13 +0000 UTC (0+3 container statuses recorded) Jan 19 02:57:29.776: INFO: Container csi-provisioner ready: false, restart count 0 Jan 19 02:57:29.776: INFO: Container driver-registrar ready: false, restart count 0 Jan 19 02:57:29.776: INFO: Container mock ready: false, restart count 0 Jan 19 02:57:29.776: INFO: inline-volume-tester-m6c6d started at 2023-01-19 02:47:11 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:57:29.776: INFO: httpd started at 2023-01-19 02:57:22 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container httpd ready: false, restart count 0 Jan 19 02:57:29.776: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8vqd9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:29.776: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8cnst started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:29.776: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-t8z58 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:29.776: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-72jsz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:29.776: INFO: externalname-service-cr8rp started at 2023-01-19 02:56:07 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container externalname-service ready: false, restart count 0 Jan 19 02:57:29.776: INFO: cilium-mpc7m started at 2023-01-19 02:33:37 +0000 UTC (1+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:57:29.776: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:57:29.776: INFO: rs-cltdf started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:29.776: INFO: dns-test-b47ec622-3c9e-4a50-8572-e5911975e43a started at 2023-01-19 02:54:10 +0000 UTC (0+3 container statuses recorded) Jan 19 02:57:29.776: INFO: Container jessie-querier ready: false, restart count 0 Jan 19 02:57:29.776: INFO: Container querier ready: false, restart count 0 Jan 19 02:57:29.776: INFO: Container webserver ready: false, restart count 0 Jan 19 02:57:29.776: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hb6r2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:29.776: INFO: rs-nsjcr started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:29.776: INFO: rs-zhl54 started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:29.776: INFO: hostexec-i-0f8b7f8eacf81cd58-wmb8f started at 2023-01-19 02:52:25 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:57:29.776: INFO: agnhost-primary-l5zgv started at 2023-01-19 02:56:50 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container agnhost-primary ready: false, restart count 0 Jan 19 02:57:29.776: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dw974 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:29.776: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:30.018: INFO: Latency metrics for node i-0f8b7f8eacf81cd58 [DeferCleanup (Each)] [sig-apps] Job tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "job-4899" for this suite. �[38;5;243m01/19/23 02:57:30.018�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sJob\sshould\srun\sa\sjob\sto\scompletion\swhen\stasks\ssometimes\sfail\sand\sare\slocally\srestarted\s\[Conformance\]$'
test/e2e/apps/job.go:439 k8s.io/kubernetes/test/e2e/apps.glob..func7.9() test/e2e/apps/job.go:439 +0x267from junit_01.xml
[BeforeEach] [sig-apps] Job set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 02:41:02.672�[0m Jan 19 02:41:02.672: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename job �[38;5;243m01/19/23 02:41:02.673�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 02:41:02.873�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 02:41:03.004�[0m [BeforeEach] [sig-apps] Job test/e2e/framework/metrics/init/init.go:31 [It] should run a job to completion when tasks sometimes fail and are locally restarted [Conformance] test/e2e/apps/job.go:426 �[1mSTEP:�[0m Creating a job �[38;5;243m01/19/23 02:41:03.134�[0m �[1mSTEP:�[0m Ensuring job reaches completions �[38;5;243m01/19/23 02:41:03.204�[0m Jan 19 02:56:03.332: INFO: Unexpected error: failed to ensure job completion in namespace: job-1912: <*errors.errorString | 0xc0001c5930>: { s: "timed out waiting for the condition", } Jan 19 02:56:03.332: FAIL: failed to ensure job completion in namespace: job-1912: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func7.9() test/e2e/apps/job.go:439 +0x267 [AfterEach] [sig-apps] Job test/e2e/framework/node/init/init.go:32 Jan 19 02:56:03.332: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] Job test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-apps] Job dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 02:56:03.398�[0m �[1mSTEP:�[0m Collecting events from namespace "job-1912". �[38;5;243m01/19/23 02:56:03.398�[0m �[1mSTEP:�[0m Found 43 events. �[38;5;243m01/19/23 02:56:03.463�[0m Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:03 +0000 UTC - event for fail-once-local: {job-controller } SuccessfulCreate: Created pod: fail-once-local-llx45 Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:03 +0000 UTC - event for fail-once-local: {job-controller } SuccessfulCreate: Created pod: fail-once-local-k868g Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:03 +0000 UTC - event for fail-once-local-k868g: {default-scheduler } Scheduled: Successfully assigned job-1912/fail-once-local-k868g to i-0f8b7f8eacf81cd58 Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:03 +0000 UTC - event for fail-once-local-llx45: {default-scheduler } Scheduled: Successfully assigned job-1912/fail-once-local-llx45 to i-0f8b7f8eacf81cd58 Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:04 +0000 UTC - event for fail-once-local-k868g: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "239621cc0d7f8e80728774eaa19dd2cddc571b6c6f8064a736ddf10bb86220d9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:04 +0000 UTC - event for fail-once-local-llx45: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a700cf6e0cc676495cc320e960cd902edef97bc0b2dbbdf123d2960a65c8fe50": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:16 +0000 UTC - event for fail-once-local-k868g: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0567bb05f1df072a8e46e330164dbc258813e33a37d86b2da03149320cc354e6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:19 +0000 UTC - event for fail-once-local-llx45: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "13555f4c56c078391ad9cfbe86792491b2950d43046fcfda2fa0578b62ca69b1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:28 +0000 UTC - event for fail-once-local-k868g: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "220f90843425d90e536ec0ca692d867f9a60f963bc9fb8ffbdf041368decec11": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:35 +0000 UTC - event for fail-once-local-llx45: {kubelet i-0f8b7f8eacf81cd58} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:35 +0000 UTC - event for fail-once-local-llx45: {kubelet i-0f8b7f8eacf81cd58} Created: Created container c Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:36 +0000 UTC - event for fail-once-local-llx45: {kubelet i-0f8b7f8eacf81cd58} Started: Started container c Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:41 +0000 UTC - event for fail-once-local: {job-controller } SuccessfulCreate: Created pod: fail-once-local-txdfv Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:41 +0000 UTC - event for fail-once-local-txdfv: {default-scheduler } Scheduled: Successfully assigned job-1912/fail-once-local-txdfv to i-08066f65509d69679 Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:42 +0000 UTC - event for fail-once-local-k868g: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1619b3be07905b78a83ebd873eb347bd123886391eb58c056d17d94f86ecfe6d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:42 +0000 UTC - event for fail-once-local-txdfv: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "642177a60ade4f694ca835697f3f43f9eab2c1b89e60fb6371ec1f481bb24e1d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:53 +0000 UTC - event for fail-once-local-txdfv: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ed8122d30624e2ec9f3205de8c35e1d8d0fdf31dbbef45778fb860a6cf74d080": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:41:55 +0000 UTC - event for fail-once-local-k868g: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5dc9b2cf858e5d81259491983d49ec22bbffa39fbf517c6c2dc146f4ed6ba406": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:42:05 +0000 UTC - event for fail-once-local-txdfv: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "42a30a4c15e0b572356ce93e8068316169cc85b141f3696010202b3195749bdd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:42:08 +0000 UTC - event for fail-once-local-k868g: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "61af321bf54656d177ba76fdbc39296a2c765b3aa57f2b76aa175ccdf586ac60": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:42:20 +0000 UTC - event for fail-once-local-txdfv: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "84f943ffae0acdee7f6b357b9dbf38cd026b92e6adfaa7a9cbf1383aa12a636a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:42:22 +0000 UTC - event for fail-once-local-k868g: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "36bef045e889f716953546ff5ea7b104c7abd5393988b7390b9a4efc970218bd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:42:33 +0000 UTC - event for fail-once-local-txdfv: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f9c299b051e37da4519f96a2cf05d44040a35c2b4d9a4fe91cec69fca76be113": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:42:37 +0000 UTC - event for fail-once-local-k868g: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "478470b79c2c8e84d967a135e5f166af06725918c875f0f37d90b373efd1dba7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:42:46 +0000 UTC - event for fail-once-local-txdfv: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "40dd69a66e9b93bfc5d41162c9fd2d2c39cc5d061d0f905405aafc4dc5133c70": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:42:48 +0000 UTC - event for fail-once-local-k868g: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d6daeff3e208a12784eef0cadc91afdae4af4410533cda92aef9fa129e11390f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:43:01 +0000 UTC - event for fail-once-local-k868g: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1b5804cbf08c961f2af93066bd96ee9e16e3ae0aec2ee45d0d022293605c02e1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:43:01 +0000 UTC - event for fail-once-local-txdfv: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "52553b8c8506df89fc96b78c233f77949a4de00432a7691814ff249cbba19b43": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:43:14 +0000 UTC - event for fail-once-local-txdfv: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "164c6a9acddcb223d9c295ebfac89258c06018db1a79a17f200d475d07600bad": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:43:28 +0000 UTC - event for fail-once-local-txdfv: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "25fd825cc2428fb4fe3240e81c0a0ac46ed1c0873f0144893174419139d55cf4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:43:39 +0000 UTC - event for fail-once-local-txdfv: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6b26b19891712e4c4e028cb9d55d423096f80d4f1f2c2ffb63fdc6fd357bfbcd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:47:02 +0000 UTC - event for fail-once-local: {job-controller } SuccessfulCreate: Created pod: fail-once-local-szfzl Jan 19 02:56:03.463: INFO: At 2023-01-19 02:47:02 +0000 UTC - event for fail-once-local-szfzl: {default-scheduler } Scheduled: Successfully assigned job-1912/fail-once-local-szfzl to i-0f8b7f8eacf81cd58 Jan 19 02:56:03.463: INFO: At 2023-01-19 02:47:03 +0000 UTC - event for fail-once-local-szfzl: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2920df8968832b9402b3eccc9a9525e6f445885e0bda75f66037d12fb42e9856": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:47:13 +0000 UTC - event for fail-once-local-szfzl: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "973386e10208dc2188bae3c8eec6f23a972d2937dac403268ef842a3c3930646": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:47:24 +0000 UTC - event for fail-once-local-szfzl: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2f97838e3510fcdefcfaab4debdca1d986b9b162d5bed3d46868914530962d17": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:47:36 +0000 UTC - event for fail-once-local-szfzl: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "73a7071785b7811192cd2692c2fb49dace4cdef0b4b6ef9816fee10d3e6238f3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:47:51 +0000 UTC - event for fail-once-local-szfzl: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "74eea6f97c848eac9064dd4f1b080f7730ed536c8611cc3bcc8446338f46cccb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:48:02 +0000 UTC - event for fail-once-local-szfzl: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "87ad10e8f8c43405072d6290c4c054c079ee480ac1625095646e397ab3e09677": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:48:17 +0000 UTC - event for fail-once-local-szfzl: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "23bc924af9d2a777332327e2c8daaabcf523ae2e9592533c3f7f430f5ceceeb0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:48:31 +0000 UTC - event for fail-once-local-szfzl: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "afc2f779719ac751c931b2032564314454af07974758b120ac67169aabaedc9a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:48:44 +0000 UTC - event for fail-once-local-szfzl: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "941db95c7cbcd38f8dae1e3d52b3e7ff534adfa4a2663ecd4b6be02b342c9581": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.463: INFO: At 2023-01-19 02:48:58 +0000 UTC - event for fail-once-local-szfzl: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "43af278925f1925b6cfdf58bdff894b8288ea6c05ed4406a6af7b8ae99d25c4f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:56:03.528: INFO: POD NODE PHASE GRACE CONDITIONS Jan 19 02:56:03.528: INFO: fail-once-local-k868g i-0f8b7f8eacf81cd58 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:03 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:03 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:03 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:03 +0000 UTC }] Jan 19 02:56:03.528: INFO: fail-once-local-llx45 i-0f8b7f8eacf81cd58 Succeeded [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:03 +0000 UTC PodCompleted } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:03 +0000 UTC PodCompleted } {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:03 +0000 UTC PodCompleted } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:03 +0000 UTC }] Jan 19 02:56:03.528: INFO: fail-once-local-szfzl i-0f8b7f8eacf81cd58 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:02 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:02 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:47:02 +0000 UTC }] Jan 19 02:56:03.528: INFO: fail-once-local-txdfv i-08066f65509d69679 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:41 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:41 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:41 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:41:41 +0000 UTC }] Jan 19 02:56:03.528: INFO: Jan 19 02:56:03.723: INFO: Unable to fetch job-1912/fail-once-local-szfzl/c logs: the server rejected our request for an unknown reason (get pods fail-once-local-szfzl) Jan 19 02:56:03.788: INFO: Unable to fetch job-1912/fail-once-local-txdfv/c logs: the server rejected our request for an unknown reason (get pods fail-once-local-txdfv) Jan 19 02:56:03.856: INFO: Logging node info for node i-023e074b52731ec5a Jan 19 02:56:03.920: INFO: Node Info: &Node{ObjectMeta:{i-023e074b52731ec5a e961fee7-3382-47b0-8744-433e44345d0f 20482 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-023e074b52731ec5a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-023e074b52731ec5a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.43 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1903":"i-023e074b52731ec5a","ebs.csi.aws.com":"i-023e074b52731ec5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:51:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-023e074b52731ec5a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:47 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.43,},NodeAddress{Type:ExternalIP,Address:35.163.72.25,},NodeAddress{Type:InternalDNS,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-163-72-25.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2fdc458699464b606b9fca6747bb8e,SystemUUID:ec2fdc45-8699-464b-606b-9fca6747bb8e,BootID:c860ef30-1fd7-41be-b096-79723bc17c52,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 02:56:03.921: INFO: Logging kubelet events for node i-023e074b52731ec5a Jan 19 02:56:03.986: INFO: Logging pods the kubelet thinks is on node i-023e074b52731ec5a Jan 19 02:56:04.121: INFO: pod-subpath-test-preprovisionedpv-7z5f started at 2023-01-19 02:53:56 +0000 UTC (2+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Init container init-volume-preprovisionedpv-7z5f ready: false, restart count 0 Jan 19 02:56:04.121: INFO: Init container test-init-volume-preprovisionedpv-7z5f ready: false, restart count 0 Jan 19 02:56:04.121: INFO: Container test-container-subpath-preprovisionedpv-7z5f ready: false, restart count 0 Jan 19 02:56:04.121: INFO: pod-d9db111b-e3ea-492e-8d92-f800d7e5eb72 started at 2023-01-19 02:54:00 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container write-pod ready: false, restart count 0 Jan 19 02:56:04.121: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dzctr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.121: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nztbv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.121: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-fqdth started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.121: INFO: ebs-csi-node-txkj8 started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded) Jan 19 02:56:04.121: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:56:04.121: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:56:04.121: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:56:04.121: INFO: hostexec-i-023e074b52731ec5a-54hsp started at 2023-01-19 02:53:57 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:56:04.121: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-k7tm4 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.121: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-rbxbc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.121: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:51:28 +0000 UTC (0+7 container statuses recorded) Jan 19 02:56:04.121: INFO: Container csi-attacher ready: false, restart count 0 Jan 19 02:56:04.121: INFO: Container csi-provisioner ready: false, restart count 0 Jan 19 02:56:04.121: INFO: Container csi-resizer ready: false, restart count 0 Jan 19 02:56:04.121: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 19 02:56:04.121: INFO: Container hostpath ready: false, restart count 0 Jan 19 02:56:04.121: INFO: Container liveness-probe ready: false, restart count 0 Jan 19 02:56:04.121: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 19 02:56:04.121: INFO: csi-mockplugin-0 started at 2023-01-19 02:55:03 +0000 UTC (0+4 container statuses recorded) Jan 19 02:56:04.121: INFO: Container busybox ready: false, restart count 0 Jan 19 02:56:04.121: INFO: Container csi-provisioner ready: false, restart count 0 Jan 19 02:56:04.121: INFO: Container driver-registrar ready: false, restart count 0 Jan 19 02:56:04.121: INFO: Container mock ready: false, restart count 0 Jan 19 02:56:04.121: INFO: coredns-559769c974-tc4gk started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container coredns ready: true, restart count 0 Jan 19 02:56:04.121: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gzrm9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.121: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-px9wv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0 Jan 19 02:56:04.121: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-kmq27 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.121: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nlzkq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.121: INFO: inline-volume-tester-drdvw started at 2023-01-19 02:41:27 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:56:04.121: INFO: cilium-4xgjg started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:56:04.121: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:56:04.121: INFO: coredns-autoscaler-7cb5c5b969-pkb4q started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container autoscaler ready: true, restart count 0 Jan 19 02:56:04.121: INFO: hostexec-i-023e074b52731ec5a-7pkmp started at 2023-01-19 02:53:40 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:56:04.121: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:41:27 +0000 UTC (0+7 container statuses recorded) Jan 19 02:56:04.121: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 02:56:04.121: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 02:56:04.121: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 02:56:04.121: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 19 02:56:04.121: INFO: Container hostpath ready: true, restart count 0 Jan 19 02:56:04.121: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:56:04.121: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:56:04.121: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z97mx started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.121: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.385: INFO: Latency metrics for node i-023e074b52731ec5a Jan 19 02:56:04.385: INFO: Logging node info for node i-02d86c0c31a5b3e66 Jan 19 02:56:04.449: INFO: Node Info: &Node{ObjectMeta:{i-02d86c0c31a5b3e66 2b72ee85-8a44-46ad-89d8-94df5d455adf 21681 0 2023-01-19 02:33:41 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02d86c0c31a5b3e66 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-02d86c0c31a5b3e66 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.52.66 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3594":"i-02d86c0c31a5b3e66","ebs.csi.aws.com":"i-02d86c0c31a5b3e66"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:54:17 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:54:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-02d86c0c31a5b3e66,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.52.66,},NodeAddress{Type:ExternalIP,Address:54.218.213.176,},NodeAddress{Type:InternalDNS,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-218-213-176.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2854d64f7363e92b7b006397583f0a,SystemUUID:ec2854d6-4f73-63e9-2b7b-006397583f0a,BootID:a64d8535-a0a2-421b-b474-ed26b967c37a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-3594^900045cd-97a4-11ed-af43-d6e7a8e15f2d kubernetes.io/csi/csi-hostpath-ephemeral-3594^90009a58-97a4-11ed-af43-d6e7a8e15f2d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3594^90009a58-97a4-11ed-af43-d6e7a8e15f2d,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3594^900045cd-97a4-11ed-af43-d6e7a8e15f2d,DevicePath:,},},Config:nil,},} Jan 19 02:56:04.450: INFO: Logging kubelet events for node i-02d86c0c31a5b3e66 Jan 19 02:56:04.517: INFO: Logging pods the kubelet thinks is on node i-02d86c0c31a5b3e66 Jan 19 02:56:04.587: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4pps started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.587: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.587: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-r25l2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.587: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.587: INFO: cilium-dpz9q started at 2023-01-19 02:33:41 +0000 UTC (1+1 container statuses recorded) Jan 19 02:56:04.587: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:56:04.587: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:56:04.587: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hkqgk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.587: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.587: INFO: inline-volume-tester-7nwl6 started at 2023-01-19 02:54:17 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.587: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:56:04.587: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:53:05 +0000 UTC (0+7 container statuses recorded) Jan 19 02:56:04.587: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 02:56:04.587: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 02:56:04.587: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 02:56:04.587: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 19 02:56:04.587: INFO: Container hostpath ready: true, restart count 0 Jan 19 02:56:04.587: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:56:04.588: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:56:04.588: INFO: ebs-csi-node-vnlk5 started at 2023-01-19 02:33:41 +0000 UTC (0+3 container statuses recorded) Jan 19 02:56:04.588: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:56:04.588: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:56:04.588: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:56:04.588: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-46kbx started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.588: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.588: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-jq8pp started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.588: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.588: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-wm87d started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.588: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.588: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-thtlz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.588: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.588: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gqbwh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.588: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.588: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-njqx8 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.588: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.588: INFO: coredns-559769c974-jhsx5 started at 2023-01-19 02:34:10 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.588: INFO: Container coredns ready: true, restart count 0 Jan 19 02:56:04.588: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hgwmq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:04.588: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:04.878: INFO: Latency metrics for node i-02d86c0c31a5b3e66 Jan 19 02:56:04.878: INFO: Logging node info for node i-08066f65509d69679 Jan 19 02:56:04.942: INFO: Node Info: &Node{ObjectMeta:{i-08066f65509d69679 0be3effa-655e-4b68-9a19-46c9ab83ba9a 21453 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08066f65509d69679 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-08066f65509d69679 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.217 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1190":"i-08066f65509d69679","ebs.csi.aws.com":"i-08066f65509d69679"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:48:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:53:49 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-08066f65509d69679,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:53:49 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:53:49 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:53:49 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:53:49 +0000 UTC,LastTransitionTime:2023-01-19 02:33:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.217,},NodeAddress{Type:ExternalIP,Address:52.35.165.136,},NodeAddress{Type:InternalDNS,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-35-165-136.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ef74bd259aa6181a8189c00469b84,SystemUUID:ec2ef74b-d259-aa61-81a8-189c00469b84,BootID:14a8f3be-4273-41bf-906d-a4c0fdb82ba0,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1190^873e76ca-97a3-11ed-b258-d2540af1607e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1190^873e76ca-97a3-11ed-b258-d2540af1607e,DevicePath:,},},Config:nil,},} Jan 19 02:56:04.942: INFO: Logging kubelet events for node i-08066f65509d69679 Jan 19 02:56:05.008: INFO: Logging pods the kubelet thinks is on node i-08066f65509d69679 Jan 19 02:56:05.092: INFO: cilium-c7s4l started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:56:05.092: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:56:05.092: INFO: pod-1 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container donothing ready: true, restart count 0 Jan 19 02:56:05.092: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-qr89m started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:05.092: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5mxxc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:05.092: INFO: rc-test-2jq8d started at 2023-01-19 02:47:08 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container rc-test ready: false, restart count 0 Jan 19 02:56:05.092: INFO: hairpin started at 2023-01-19 02:51:24 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container agnhost-container ready: false, restart count 0 Jan 19 02:56:05.092: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5prrc started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:05.092: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dvwqc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:05.092: INFO: inline-volume-tester-kg7wv started at 2023-01-19 02:46:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:56:05.092: INFO: pod-subpath-test-inlinevolume-fq8p started at 2023-01-19 02:52:44 +0000 UTC (1+2 container statuses recorded) Jan 19 02:56:05.092: INFO: Init container test-init-subpath-inlinevolume-fq8p ready: false, restart count 0 Jan 19 02:56:05.092: INFO: Container test-container-subpath-inlinevolume-fq8p ready: false, restart count 0 Jan 19 02:56:05.092: INFO: Container test-container-volume-inlinevolume-fq8p ready: false, restart count 0 Jan 19 02:56:05.092: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-tvhph started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:05.092: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-49t56 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:05.092: INFO: fail-once-local-txdfv started at 2023-01-19 02:41:41 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container c ready: false, restart count 0 Jan 19 02:56:05.092: INFO: pod-5dace810-a072-4286-ae39-bfe4a92fa46a started at 2023-01-19 02:51:36 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container test-container ready: false, restart count 0 Jan 19 02:56:05.092: INFO: agnhost-primary-t6mr6 started at 2023-01-19 02:52:03 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container agnhost-primary ready: false, restart count 0 Jan 19 02:56:05.092: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-sshfj started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:05.092: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z4wjr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:05.092: INFO: pod-0 started at 2023-01-19 02:52:12 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container donothing ready: false, restart count 0 Jan 19 02:56:05.092: INFO: ebs-csi-node-szxtn started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded) Jan 19 02:56:05.092: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:56:05.092: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:56:05.092: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:56:05.092: INFO: configmap-client started at 2023-01-19 02:51:42 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container configmap-client ready: false, restart count 0 Jan 19 02:56:05.092: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-266nr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:05.092: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-cqpsv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:05.092: INFO: httpd started at 2023-01-19 02:52:05 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.092: INFO: Container httpd ready: false, restart count 0 Jan 19 02:56:05.092: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:42:03 +0000 UTC (0+7 container statuses recorded) Jan 19 02:56:05.092: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 02:56:05.092: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 02:56:05.092: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 02:56:05.092: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 19 02:56:05.092: INFO: Container hostpath ready: true, restart count 0 Jan 19 02:56:05.092: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:56:05.092: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:56:05.410: INFO: Latency metrics for node i-08066f65509d69679 Jan 19 02:56:05.410: INFO: Logging node info for node i-098a14e8a4aca3f52 Jan 19 02:56:05.474: INFO: Node Info: &Node{ObjectMeta:{i-098a14e8a4aca3f52 7d2548e6-f0b4-43c4-880f-93f669b42eab 21756 0 2023-01-19 02:32:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-098a14e8a4aca3f52 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.164 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-098a14e8a4aca3f52"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 02:32:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-19 02:32:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:32:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 02:54:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-098a14e8a4aca3f52,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:54:43 +0000 UTC,LastTransitionTime:2023-01-19 02:32:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.164,},NodeAddress{Type:ExternalIP,Address:35.89.228.171,},NodeAddress{Type:InternalDNS,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-89-228-171.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2da2cd6ae96e63652bd883a94f495c,SystemUUID:ec2da2cd-6ae9-6e63-652b-d883a94f495c,BootID:7a95f25a-dfd5-459e-b4a5-db275a1b4e67,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191755,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821707,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965792,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 02:56:05.475: INFO: Logging kubelet events for node i-098a14e8a4aca3f52 Jan 19 02:56:05.541: INFO: Logging pods the kubelet thinks is on node i-098a14e8a4aca3f52 Jan 19 02:56:05.611: INFO: cilium-operator-6f8d6c4bf-tr54z started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.611: INFO: Container cilium-operator ready: true, restart count 0 Jan 19 02:56:05.611: INFO: ebs-csi-controller-89bddb897-vfp22 started at 2023-01-19 02:32:43 +0000 UTC (0+5 container statuses recorded) Jan 19 02:56:05.611: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 02:56:05.611: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 02:56:05.611: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 02:56:05.611: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:56:05.611: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:56:05.611: INFO: dns-controller-74d4646d88-9znsr started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.611: INFO: Container dns-controller ready: true, restart count 0 Jan 19 02:56:05.611: INFO: kube-controller-manager-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.611: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 19 02:56:05.611: INFO: kube-scheduler-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.611: INFO: Container kube-scheduler ready: true, restart count 0 Jan 19 02:56:05.611: INFO: kube-apiserver-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+2 container statuses recorded) Jan 19 02:56:05.611: INFO: Container healthcheck ready: true, restart count 0 Jan 19 02:56:05.611: INFO: Container kube-apiserver ready: true, restart count 1 Jan 19 02:56:05.611: INFO: ebs-csi-node-trsl9 started at 2023-01-19 02:32:40 +0000 UTC (0+3 container statuses recorded) Jan 19 02:56:05.611: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:56:05.611: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:56:05.611: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:56:05.611: INFO: cilium-knt4k started at 2023-01-19 02:32:40 +0000 UTC (1+1 container statuses recorded) Jan 19 02:56:05.611: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:56:05.611: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:56:05.611: INFO: aws-cloud-controller-manager-4c7k7 started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.611: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 19 02:56:05.611: INFO: kops-controller-rkkdt started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.611: INFO: Container kops-controller ready: true, restart count 0 Jan 19 02:56:05.611: INFO: etcd-manager-events-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.611: INFO: Container etcd-manager ready: true, restart count 0 Jan 19 02:56:05.611: INFO: etcd-manager-main-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:05.611: INFO: Container etcd-manager ready: true, restart count 0 Jan 19 02:56:05.848: INFO: Latency metrics for node i-098a14e8a4aca3f52 Jan 19 02:56:05.848: INFO: Logging node info for node i-0f8b7f8eacf81cd58 Jan 19 02:56:05.912: INFO: Node Info: &Node{ObjectMeta:{i-0f8b7f8eacf81cd58 969780cc-600f-4d79-80fa-2e681c67e470 21787 0 2023-01-19 02:33:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f8b7f8eacf81cd58 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-0f8b7f8eacf81cd58 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f8b7f8eacf81cd58"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:54:50 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:54:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0f8b7f8eacf81cd58,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:50 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:50 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:50 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:54:50 +0000 UTC,LastTransitionTime:2023-01-19 02:33:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.113,},NodeAddress{Type:ExternalIP,Address:54.188.219.55,},NodeAddress{Type:InternalDNS,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-188-219-55.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec296be3bda6a5cf5f1cfc033b1bb6bb,SystemUUID:ec296be3-bda6-a5cf-5f1c-fc033b1bb6bb,BootID:2cccdc7f-1458-4e66-9053-d2f4c0f3fc70,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00293629c9f01aed3 kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00293629c9f01aed3,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a,DevicePath:,},},Config:nil,},} Jan 19 02:56:05.912: INFO: Logging kubelet events for node i-0f8b7f8eacf81cd58 Jan 19 02:56:05.978: INFO: Logging pods the kubelet thinks is on node i-0f8b7f8eacf81cd58 Jan 19 02:56:06.051: INFO: rc-test-qn447 started at 2023-01-19 02:46:39 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container rc-test ready: true, restart count 0 Jan 19 02:56:06.051: INFO: inline-volume-tester-m6c6d started at 2023-01-19 02:47:11 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:56:06.051: INFO: pod-3fa88a33-3e62-47c0-8c83-7da7fa62fd26 started at 2023-01-19 02:52:11 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container write-pod ready: false, restart count 0 Jan 19 02:56:06.051: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8cnst started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:06.051: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-t8z58 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:06.051: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-72jsz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:06.051: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8vqd9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:06.051: INFO: hostexec-i-0f8b7f8eacf81cd58-x92jz started at 2023-01-19 02:52:02 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:56:06.051: INFO: pod-87600900-ab09-4695-a4b1-f510a9918667 started at 2023-01-19 02:46:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container write-pod ready: false, restart count 0 Jan 19 02:56:06.051: INFO: cilium-mpc7m started at 2023-01-19 02:33:37 +0000 UTC (1+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:56:06.051: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:56:06.051: INFO: pod-52b7b2e9-035c-4ed1-affb-05db28ee100e started at 2023-01-19 02:51:34 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container test-container ready: false, restart count 0 Jan 19 02:56:06.051: INFO: dns-test-b47ec622-3c9e-4a50-8572-e5911975e43a started at 2023-01-19 02:54:10 +0000 UTC (0+3 container statuses recorded) Jan 19 02:56:06.051: INFO: Container jessie-querier ready: false, restart count 0 Jan 19 02:56:06.051: INFO: Container querier ready: false, restart count 0 Jan 19 02:56:06.051: INFO: Container webserver ready: false, restart count 0 Jan 19 02:56:06.051: INFO: hostexec-i-0f8b7f8eacf81cd58-wmb8f started at 2023-01-19 02:52:25 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:56:06.051: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dw974 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:06.051: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hb6r2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:06.051: INFO: ebs-csi-node-x2rds started at 2023-01-19 02:33:37 +0000 UTC (0+3 container statuses recorded) Jan 19 02:56:06.051: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:56:06.051: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:56:06.051: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:56:06.051: INFO: suspend-true-to-false-gvdhj started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container c ready: false, restart count 0 Jan 19 02:56:06.051: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-bd6fk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:06.051: INFO: fail-once-local-llx45 started at 2023-01-19 02:41:03 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container c ready: false, restart count 1 Jan 19 02:56:06.051: INFO: pod-0 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container donothing ready: true, restart count 0 Jan 19 02:56:06.051: INFO: fail-once-local-k868g started at 2023-01-19 02:41:03 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container c ready: false, restart count 1 Jan 19 02:56:06.051: INFO: suspend-true-to-false-qkh4c started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container c ready: false, restart count 0 Jan 19 02:56:06.051: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-c8gns started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:06.051: INFO: suspend-true-to-false-s5btk started at 2023-01-19 02:42:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container c ready: false, restart count 0 Jan 19 02:56:06.051: INFO: pod-subpath-test-preprovisionedpv-n92q started at 2023-01-19 02:52:41 +0000 UTC (1+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Init container init-volume-preprovisionedpv-n92q ready: false, restart count 0 Jan 19 02:56:06.051: INFO: Container test-container-subpath-preprovisionedpv-n92q ready: false, restart count 0 Jan 19 02:56:06.051: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-m7587 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:06.051: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4hdh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:56:06.051: INFO: fail-once-local-szfzl started at 2023-01-19 02:47:02 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container c ready: false, restart count 0 Jan 19 02:56:06.051: INFO: pod-2 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded) Jan 19 02:56:06.051: INFO: Container donothing ready: false, restart count 0 Jan 19 02:56:06.309: INFO: Latency metrics for node i-0f8b7f8eacf81cd58 [DeferCleanup (Each)] [sig-apps] Job tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "job-1912" for this suite. �[38;5;243m01/19/23 02:56:06.309�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sPort\sforwarding\sWith\sa\sserver\slistening\son\s0\.0\.0\.0\sshould\ssupport\sforwarding\sover\swebsockets$'
test/e2e/kubectl/portforward.go:372
k8s.io/kubernetes/test/e2e/kubectl.doTestOverWebSockets({0x75c24b2, 0x7}, 0xc000f13b30)
test/e2e/kubectl/portforward.go:372 +0x2af
k8s.io/kubernetes/test/e2e/kubectl.glob..func2.1.3()
test/e2e/kubectl/portforward.go:471 +0x29
[BeforeEach] [sig-cli] Kubectl Port forwarding
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 02:46:30.173�[0m
Jan 19 02:46:30.173: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename port-forwarding �[38;5;243m01/19/23 02:46:30.174�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 02:46:30.373�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 02:46:30.5�[0m
[BeforeEach] [sig-cli] Kubectl Port forwarding
test/e2e/framework/metrics/init/init.go:31
[It] should support forwarding over websockets
test/e2e/kubectl/portforward.go:470
Jan 19 02:46:30.627: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Creating the pod �[38;5;243m01/19/23 02:46:30.628�[0m
Jan 19 02:46:30.696: INFO: Waiting up to 5m0s for pod "pfpod" in namespace "port-forwarding-859" to be "running and ready"
Jan 19 02:46:30.760: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 64.12276ms
Jan 19 02:46:30.760: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:32.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2.128904694s
Jan 19 02:46:32.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:34.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4.129473799s
Jan 19 02:46:34.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:36.824: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 6.128365507s
Jan 19 02:46:36.824: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:38.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 8.129367192s
Jan 19 02:46:38.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:40.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 10.129532396s
Jan 19 02:46:40.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:42.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 12.128965713s
Jan 19 02:46:42.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:44.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 14.129801832s
Jan 19 02:46:44.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:46.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 16.128961694s
Jan 19 02:46:46.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:48.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 18.128910669s
Jan 19 02:46:48.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:50.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 20.129714204s
Jan 19 02:46:50.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:52.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 22.128871728s
Jan 19 02:46:52.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:54.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 24.129286593s
Jan 19 02:46:54.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:56.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 26.12941418s
Jan 19 02:46:56.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:46:58.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 28.129444067s
Jan 19 02:46:58.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:00.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 30.129654199s
Jan 19 02:47:00.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:02.831: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 32.135202501s
Jan 19 02:47:02.831: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:04.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 34.129309503s
Jan 19 02:47:04.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:06.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 36.128879063s
Jan 19 02:47:06.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:08.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 38.130205785s
Jan 19 02:47:08.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:10.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 40.12879935s
Jan 19 02:47:10.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:12.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 42.129638537s
Jan 19 02:47:12.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:14.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 44.129968807s
Jan 19 02:47:14.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:16.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 46.129207585s
Jan 19 02:47:16.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:18.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 48.129369876s
Jan 19 02:47:18.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:20.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 50.129218276s
Jan 19 02:47:20.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:22.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 52.128996634s
Jan 19 02:47:22.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:24.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 54.129244018s
Jan 19 02:47:24.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:26.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 56.128451496s
Jan 19 02:47:26.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:28.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 58.129570938s
Jan 19 02:47:28.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:30.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.129295495s
Jan 19 02:47:30.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:32.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.129069939s
Jan 19 02:47:32.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:34.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.128910857s
Jan 19 02:47:34.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:36.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.128538672s
Jan 19 02:47:36.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:38.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.128607999s
Jan 19 02:47:38.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:40.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.129495631s
Jan 19 02:47:40.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:42.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.128637311s
Jan 19 02:47:42.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:44.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.12884752s
Jan 19 02:47:44.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:46.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.129648237s
Jan 19 02:47:46.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:48.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.129575017s
Jan 19 02:47:48.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:50.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.129573409s
Jan 19 02:47:50.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:52.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.129087621s
Jan 19 02:47:52.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:54.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.129032683s
Jan 19 02:47:54.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:56.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.129009425s
Jan 19 02:47:56.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:47:58.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.129649438s
Jan 19 02:47:58.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:00.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.129440482s
Jan 19 02:48:00.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:02.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.129639989s
Jan 19 02:48:02.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:04.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.128868842s
Jan 19 02:48:04.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:06.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.12935763s
Jan 19 02:48:06.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:08.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.129633889s
Jan 19 02:48:08.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:10.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.128858941s
Jan 19 02:48:10.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:12.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.128999926s
Jan 19 02:48:12.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:14.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.128847445s
Jan 19 02:48:14.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:16.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.129023277s
Jan 19 02:48:16.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:18.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.129134747s
Jan 19 02:48:18.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:20.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.129641927s
Jan 19 02:48:20.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:22.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.129043025s
Jan 19 02:48:22.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:24.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.12977445s
Jan 19 02:48:24.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:26.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.128891296s
Jan 19 02:48:26.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:28.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.128898371s
Jan 19 02:48:28.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:30.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.129846128s
Jan 19 02:48:30.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:32.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.130338078s
Jan 19 02:48:32.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:34.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.128957059s
Jan 19 02:48:34.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:36.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.128954931s
Jan 19 02:48:36.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:38.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.129230788s
Jan 19 02:48:38.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:40.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.130188339s
Jan 19 02:48:40.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:42.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.128901496s
Jan 19 02:48:42.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:44.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.128815794s
Jan 19 02:48:44.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:46.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.12863731s
Jan 19 02:48:46.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:48.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.129426139s
Jan 19 02:48:48.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:50.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.128452086s
Jan 19 02:48:50.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:52.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.129166222s
Jan 19 02:48:52.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:54.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.128546891s
Jan 19 02:48:54.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:56.824: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.128368114s
Jan 19 02:48:56.824: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:48:58.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.128608469s
Jan 19 02:48:58.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:00.827: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.131258361s
Jan 19 02:49:00.827: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:02.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.129283191s
Jan 19 02:49:02.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:04.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.128630118s
Jan 19 02:49:04.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:06.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.129336975s
Jan 19 02:49:06.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:08.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.129380637s
Jan 19 02:49:08.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:10.824: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.128380994s
Jan 19 02:49:10.824: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:12.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.128635108s
Jan 19 02:49:12.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:14.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.129563309s
Jan 19 02:49:14.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:16.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.129364161s
Jan 19 02:49:16.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:18.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.129644554s
Jan 19 02:49:18.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:20.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.129212134s
Jan 19 02:49:20.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:22.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.129335895s
Jan 19 02:49:22.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:24.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.12870929s
Jan 19 02:49:24.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:26.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.129530962s
Jan 19 02:49:26.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:28.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.128482464s
Jan 19 02:49:28.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:30.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.129240011s
Jan 19 02:49:30.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:32.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.128972477s
Jan 19 02:49:32.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:34.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.129629065s
Jan 19 02:49:34.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:36.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.1293401s
Jan 19 02:49:36.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:38.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.12957484s
Jan 19 02:49:38.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:40.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.129447063s
Jan 19 02:49:40.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:42.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.129319222s
Jan 19 02:49:42.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:44.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.129496323s
Jan 19 02:49:44.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:46.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.129312748s
Jan 19 02:49:46.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:48.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.129728221s
Jan 19 02:49:48.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:50.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.12922457s
Jan 19 02:49:50.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:52.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.128510393s
Jan 19 02:49:52.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:54.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.128844768s
Jan 19 02:49:54.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:56.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.129252203s
Jan 19 02:49:56.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:49:58.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.12962282s
Jan 19 02:49:58.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:00.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.129541401s
Jan 19 02:50:00.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:02.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.129119259s
Jan 19 02:50:02.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:04.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.129201886s
Jan 19 02:50:04.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:06.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.129671808s
Jan 19 02:50:06.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:08.830: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.133627894s
Jan 19 02:50:08.830: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:10.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.129652242s
Jan 19 02:50:10.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:12.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.128605912s
Jan 19 02:50:12.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:14.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.129399888s
Jan 19 02:50:14.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:16.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.128439376s
Jan 19 02:50:16.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:18.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.129420791s
Jan 19 02:50:18.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:20.828: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.131656761s
Jan 19 02:50:20.828: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:22.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.129186834s
Jan 19 02:50:22.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:24.827: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.130994684s
Jan 19 02:50:24.827: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:26.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.129709799s
Jan 19 02:50:26.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:28.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.129810088s
Jan 19 02:50:28.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:30.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.128714362s
Jan 19 02:50:30.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:32.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.129264209s
Jan 19 02:50:32.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:34.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.128667695s
Jan 19 02:50:34.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:36.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.128501081s
Jan 19 02:50:36.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:38.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.128852861s
Jan 19 02:50:38.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:40.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.129565938s
Jan 19 02:50:40.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:42.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.128885486s
Jan 19 02:50:42.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:44.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.128670855s
Jan 19 02:50:44.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:46.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.12847853s
Jan 19 02:50:46.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:48.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.129550233s
Jan 19 02:50:48.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:50.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.128608816s
Jan 19 02:50:50.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:52.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.128827918s
Jan 19 02:50:52.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:54.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.129373053s
Jan 19 02:50:54.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:56.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.129649151s
Jan 19 02:50:56.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:50:58.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.129302656s
Jan 19 02:50:58.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:00.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.129434796s
Jan 19 02:51:00.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:02.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.128684256s
Jan 19 02:51:02.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:04.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.129290001s
Jan 19 02:51:04.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:06.827: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.130775232s
Jan 19 02:51:06.827: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:08.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.12870998s
Jan 19 02:51:08.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:10.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.128714908s
Jan 19 02:51:10.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:12.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.129719709s
Jan 19 02:51:12.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:14.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.129479173s
Jan 19 02:51:14.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:16.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.128764151s
Jan 19 02:51:16.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:18.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.128844698s
Jan 19 02:51:18.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:20.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.129489144s
Jan 19 02:51:20.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:22.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.128577325s
Jan 19 02:51:22.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:24.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.129560598s
Jan 19 02:51:24.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:26.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.129898615s
Jan 19 02:51:26.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:28.826: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.130307291s
Jan 19 02:51:28.826: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:30.825: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.128720697s
Jan 19 02:51:30.825: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:30.891: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.19444484s
Jan 19 02:51:30.891: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 19 02:51:30.891: FAIL: Pod did not start running: timed out while waiting for pod port-forwarding-859/pfpod to be running and ready
Full Stack Trace
k8s.io/kubernetes/test/e2e/kubectl.doTestOverWebSockets({0x75c24b2, 0x7}, 0xc000f13b30)
test/e2e/kubectl/portforward.go:372 +0x2af
k8s.io/kubernetes/test/e2e/kubectl.glob..func2.1.3()
test/e2e/kubectl/portforward.go:471 +0x29
[AfterEach] [sig-cli] Kubectl Port forwarding
test/e2e/framework/node/init/init.go:32
Jan 19 02:51:30.891: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/19/23 02:51:30.961�[0m
�[1mSTEP:�[0m Collecting events from namespace "port-forwarding-859". �[38;5;243m01/19/23 02:51:30.961�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/19/23 02:51:31.029�[0m
Jan 19 02:51:31.030: INFO: At 2023-01-19 02:46:30 +0000 UTC - event for pfpod: {default-scheduler } Scheduled: Successfully assigned port-forwarding-859/pfpod to i-0f8b7f8eacf81cd58
Jan 19 02:51:31.030: INFO: At 2023-01-19 02:46:31 +0000 UTC - event for pfpod: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4852379b1998ec5b07095d65ed4df18fd60bad50c89b8dd339505703ba6eaf91": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:51:31.030: INFO: At 2023-01-19 02:46:45 +0000 UTC - event for pfpod: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9cb1eac2f9dbea556b54ad04401df0f637edc6c6c5fa86f82d8fe65ec05ec5b4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:51:31.030: INFO: At 2023-01-19 02:46:57 +0000 UTC - event for pfpod: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7fbc22b65140edde6c399e6e0f970b16839ae9a2715c7358e731d23f48164c25": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:51:31.030: INFO: At 2023-01-19 02:47:11 +0000 UTC - event for pfpod: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "de951810639bb205e8910427d80707ce07be79012ad3a22deb814b876aa8a76d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:51:31.030: INFO: At 2023-01-19 02:47:26 +0000 UTC - event for pfpod: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4f51dbf43105387c14b8d873b865668f990434694d4ca2ad62c89bed9671c0a5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:51:31.030: INFO: At 2023-01-19 02:47:41 +0000 UTC - event for pfpod: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "eb3eb79c60234ddd02e92a97875eb435f4bda98ab682d2120e3cdfcc12aaafa0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:51:31.030: INFO: At 2023-01-19 02:47:56 +0000 UTC - event for pfpod: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f5cab5b45399cef2849436d9e111f979351d25f961bd30b739388a76bfa9c88c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:51:31.030: INFO: At 2023-01-19 02:48:10 +0000 UTC - event for pfpod: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2a1b969d8eb241f4097503c95bfaea4242f43197ac306a5fefd0716a212071e7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:51:31.030: INFO: At 2023-01-19 02:48:23 +0000 UTC - event for pfpod: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "180729321e905721259fcb90087bf3adc35393cd421bfb8df4ec1429f24b3829": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:51:31.030: INFO: At 2023-01-19 02:48:35 +0000 UTC - event for pfpod: {kubelet i-0f8b7f8eacf81cd58} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fba483bf4dc57d0669a7f4c7ca5b4924cfdcbf65a579fc87554abe4605bc627b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 19 02:51:31.095: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 19 02:51:31.095: INFO: pfpod i-0f8b7f8eacf81cd58 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:46:30 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:46:30 +0000 UTC ContainersNotReady containers with unready status: [readiness portforwardtester]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:46:30 +0000 UTC ContainersNotReady containers with unready status: [readiness portforwardtester]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:46:30 +0000 UTC }]
Jan 19 02:51:31.095: INFO:
Jan 19 02:51:31.171: INFO: Unable to fetch port-forwarding-859/pfpod/readiness logs: the server rejected our request for an unknown reason (get pods pfpod)
Jan 19 02:51:31.238: INFO: Unable to fetch port-forwarding-859/pfpod/portforwardtester logs: the server rejected our request for an unknown reason (get pods pfpod)
Jan 19 02:51:31.303: INFO:
Logging node info for node i-023e074b52731ec5a
Jan 19 02:51:31.367: INFO: Node Info: &Node{ObjectMeta:{i-023e074b52731ec5a e961fee7-3382-47b0-8744-433e44345d0f 20482 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-023e074b52731ec5a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-023e074b52731ec5a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.43 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1903":"i-023e074b52731ec5a","ebs.csi.aws.com":"i-023e074b52731ec5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:51:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-023e074b52731ec5a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:51:28 +0000 UTC,LastTransitionTime:2023-01-19 02:33:47 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.43,},NodeAddress{Type:ExternalIP,Address:35.163.72.25,},NodeAddress{Type:InternalDNS,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-163-72-25.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2fdc458699464b606b9fca6747bb8e,SystemUUID:ec2fdc45-8699-464b-606b-9fca6747bb8e,BootID:c860ef30-1fd7-41be-b096-79723bc17c52,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 02:51:31.367: INFO:
Logging kubelet events for node i-023e074b52731ec5a
Jan 19 02:51:31.434: INFO:
Logging pods the kubelet thinks is on node i-023e074b52731ec5a
Jan 19 02:51:31.508: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dzctr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.508: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nztbv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.508: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-fqdth started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.508: INFO: hostexec-i-023e074b52731ec5a-ltg8q started at 2023-01-19 02:47:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:51:31.508: INFO: netserver-0 started at 2023-01-19 02:47:20 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container webserver ready: false, restart count 0
Jan 19 02:51:31.508: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-k7tm4 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.508: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-rbxbc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.508: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:51:28 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container csi-attacher ready: false, restart count 0
Jan 19 02:51:31.508: INFO: Container csi-provisioner ready: false, restart count 0
Jan 19 02:51:31.508: INFO: Container csi-resizer ready: false, restart count 0
Jan 19 02:51:31.508: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 19 02:51:31.508: INFO: Container hostpath ready: false, restart count 0
Jan 19 02:51:31.508: INFO: Container liveness-probe ready: false, restart count 0
Jan 19 02:51:31.508: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 19 02:51:31.508: INFO: ebs-csi-node-txkj8 started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:51:31.508: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:51:31.508: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:51:31.508: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gzrm9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.508: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-px9wv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0
Jan 19 02:51:31.508: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-kmq27 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.508: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nlzkq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.508: INFO: netserver-0 started at 2023-01-19 02:48:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container webserver ready: false, restart count 0
Jan 19 02:51:31.508: INFO: inline-volume-tester-drdvw started at 2023-01-19 02:41:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:51:31.508: INFO: coredns-559769c974-tc4gk started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container coredns ready: true, restart count 0
Jan 19 02:51:31.508: INFO: coredns-autoscaler-7cb5c5b969-pkb4q started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container autoscaler ready: true, restart count 0
Jan 19 02:51:31.508: INFO: affinity-clusterip-timeout-4hdhw started at 2023-01-19 02:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container affinity-clusterip-timeout ready: false, restart count 0
Jan 19 02:51:31.508: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:41:27 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:51:31.508: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:51:31.508: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:51:31.508: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 19 02:51:31.508: INFO: Container hostpath ready: true, restart count 0
Jan 19 02:51:31.508: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:51:31.508: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:51:31.508: INFO: pod-974aa149-9cd4-4da3-9d1f-c61d49a3ba6c started at 2023-01-19 02:47:56 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container write-pod ready: false, restart count 0
Jan 19 02:51:31.508: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z97mx started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.508: INFO: cilium-4xgjg started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:51:31.508: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:51:31.508: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:51:31.777: INFO:
Latency metrics for node i-023e074b52731ec5a
Jan 19 02:51:31.777: INFO:
Logging node info for node i-02d86c0c31a5b3e66
Jan 19 02:51:31.842: INFO: Node Info: &Node{ObjectMeta:{i-02d86c0c31a5b3e66 2b72ee85-8a44-46ad-89d8-94df5d455adf 19010 0 2023-01-19 02:33:41 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02d86c0c31a5b3e66 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-02d86c0c31a5b3e66 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.52.66 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-02d86c0c31a5b3e66"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:47:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-02d86c0c31a5b3e66,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:46 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:46 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:46:46 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:46:46 +0000 UTC,LastTransitionTime:2023-01-19 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.52.66,},NodeAddress{Type:ExternalIP,Address:54.218.213.176,},NodeAddress{Type:InternalDNS,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-218-213-176.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2854d64f7363e92b7b006397583f0a,SystemUUID:ec2854d6-4f73-63e9-2b7b-006397583f0a,BootID:a64d8535-a0a2-421b-b474-ed26b967c37a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 02:51:31.843: INFO:
Logging kubelet events for node i-02d86c0c31a5b3e66
Jan 19 02:51:31.909: INFO:
Logging pods the kubelet thinks is on node i-02d86c0c31a5b3e66
Jan 19 02:51:31.980: INFO: ebs-csi-node-vnlk5 started at 2023-01-19 02:33:41 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:51:31.980: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:51:31.980: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:51:31.980: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-46kbx started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.980: INFO: netserver-1 started at 2023-01-19 02:48:53 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container webserver ready: false, restart count 0
Jan 19 02:51:31.980: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-jq8pp started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.980: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-wm87d started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.980: INFO: coredns-559769c974-jhsx5 started at 2023-01-19 02:34:10 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container coredns ready: true, restart count 0
Jan 19 02:51:31.980: INFO: hostexec-i-02d86c0c31a5b3e66-6k2cs started at 2023-01-19 02:47:23 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:51:31.980: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hgwmq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.980: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-thtlz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0
Jan 19 02:51:31.980: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gqbwh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.980: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-njqx8 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.980: INFO: affinity-clusterip-timeout-c9tph started at 2023-01-19 02:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container affinity-clusterip-timeout ready: true, restart count 0
Jan 19 02:51:31.980: INFO: cilium-dpz9q started at 2023-01-19 02:33:41 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:51:31.980: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:51:31.980: INFO: netserver-1 started at 2023-01-19 02:47:20 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container webserver ready: true, restart count 0
Jan 19 02:51:31.980: INFO: pod-subpath-test-preprovisionedpv-9h8j started at 2023-01-19 02:47:41 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Init container init-volume-preprovisionedpv-9h8j ready: false, restart count 0
Jan 19 02:51:31.980: INFO: Container test-container-subpath-preprovisionedpv-9h8j ready: false, restart count 0
Jan 19 02:51:31.980: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4pps started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.980: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-r25l2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:31.980: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hkqgk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:31.980: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:32.244: INFO:
Latency metrics for node i-02d86c0c31a5b3e66
Jan 19 02:51:32.244: INFO:
Logging node info for node i-08066f65509d69679
Jan 19 02:51:32.308: INFO: Node Info: &Node{ObjectMeta:{i-08066f65509d69679 0be3effa-655e-4b68-9a19-46c9ab83ba9a 19761 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08066f65509d69679 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-08066f65509d69679 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.217 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1190":"i-08066f65509d69679","ebs.csi.aws.com":"i-08066f65509d69679"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:48:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:48:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-08066f65509d69679,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:48:43 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:48:43 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:48:43 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:48:43 +0000 UTC,LastTransitionTime:2023-01-19 02:33:48 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.217,},NodeAddress{Type:ExternalIP,Address:52.35.165.136,},NodeAddress{Type:InternalDNS,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-08066f65509d69679.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-52-35-165-136.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2ef74bd259aa6181a8189c00469b84,SystemUUID:ec2ef74b-d259-aa61-81a8-189c00469b84,BootID:14a8f3be-4273-41bf-906d-a4c0fdb82ba0,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1190^873e76ca-97a3-11ed-b258-d2540af1607e],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1190^873e76ca-97a3-11ed-b258-d2540af1607e,DevicePath:,},},Config:nil,},}
Jan 19 02:51:32.309: INFO:
Logging kubelet events for node i-08066f65509d69679
Jan 19 02:51:32.375: INFO:
Logging pods the kubelet thinks is on node i-08066f65509d69679
Jan 19 02:51:32.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-49t56 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:32.447: INFO: netserver-2 started at 2023-01-19 02:47:20 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container webserver ready: false, restart count 0
Jan 19 02:51:32.447: INFO: fail-once-local-txdfv started at 2023-01-19 02:41:41 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container c ready: false, restart count 0
Jan 19 02:51:32.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-sshfj started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:32.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z4wjr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:32.447: INFO: ebs-csi-node-szxtn started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:51:32.447: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:51:32.447: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:51:32.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-266nr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:32.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-cqpsv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:32.447: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:42:03 +0000 UTC (0+7 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:51:32.447: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:51:32.447: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:51:32.447: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 19 02:51:32.447: INFO: Container hostpath ready: true, restart count 0
Jan 19 02:51:32.447: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:51:32.447: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:51:32.447: INFO: cilium-c7s4l started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:51:32.447: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:51:32.447: INFO: hostexec-i-08066f65509d69679-cctkr started at 2023-01-19 02:46:57 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container agnhost-container ready: true, restart count 0
Jan 19 02:51:32.447: INFO: netserver-2 started at 2023-01-19 02:48:53 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container webserver ready: false, restart count 0
Jan 19 02:51:32.447: INFO: pod-1 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container donothing ready: true, restart count 0
Jan 19 02:51:32.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-qr89m started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:32.447: INFO: pod-61f30e3f-9edf-4b8b-9c26-6b3a7ec98892 started at 2023-01-19 02:47:00 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container write-pod ready: false, restart count 0
Jan 19 02:51:32.447: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5mxxc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:32.447: INFO: rc-test-2jq8d started at 2023-01-19 02:47:08 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container rc-test ready: false, restart count 0
Jan 19 02:51:32.447: INFO: test-recreate-deployment-795566c5cb-6zd9w started at 2023-01-19 02:47:08 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.447: INFO: Container agnhost ready: false, restart count 0
Jan 19 02:51:32.447: INFO: hairpin started at 2023-01-19 02:51:24 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.448: INFO: Container agnhost-container ready: false, restart count 0
Jan 19 02:51:32.448: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-5prrc started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.448: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:32.448: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dvwqc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.448: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:32.448: INFO: inline-volume-tester-kg7wv started at 2023-01-19 02:46:52 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.448: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:51:32.448: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-tvhph started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.448: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:32.777: INFO:
Latency metrics for node i-08066f65509d69679
Jan 19 02:51:32.777: INFO:
Logging node info for node i-098a14e8a4aca3f52
Jan 19 02:51:32.842: INFO: Node Info: &Node{ObjectMeta:{i-098a14e8a4aca3f52 7d2548e6-f0b4-43c4-880f-93f669b42eab 19982 0 2023-01-19 02:32:15 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-098a14e8a4aca3f52 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:us-west-2a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.34.164 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-098a14e8a4aca3f52"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-19 02:32:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-19 02:32:43 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:32:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:32:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-19 02:49:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-098a14e8a4aca3f52,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3889451008 0} {<nil>} 3798292Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3784593408 0} {<nil>} 3695892Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:49:37 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:49:37 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:49:37 +0000 UTC,LastTransitionTime:2023-01-19 02:32:13 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:49:37 +0000 UTC,LastTransitionTime:2023-01-19 02:32:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.34.164,},NodeAddress{Type:ExternalIP,Address:35.89.228.171,},NodeAddress{Type:InternalDNS,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-098a14e8a4aca3f52.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-89-228-171.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2da2cd6ae96e63652bd883a94f495c,SystemUUID:ec2da2cd-6ae9-6e63-652b-d883a94f495c,BootID:7a95f25a-dfd5-459e-b4a5-db275a1b4e67,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.26.0-beta.2],SizeBytes:43191755,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.26.0-beta.2],SizeBytes:42821707,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.26.0-beta.2],SizeBytes:4965792,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 19 02:51:32.842: INFO:
Logging kubelet events for node i-098a14e8a4aca3f52
Jan 19 02:51:32.909: INFO:
Logging pods the kubelet thinks is on node i-098a14e8a4aca3f52
Jan 19 02:51:32.980: INFO: ebs-csi-node-trsl9 started at 2023-01-19 02:32:40 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:51:32.980: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:51:32.980: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:51:32.980: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:51:32.980: INFO: cilium-knt4k started at 2023-01-19 02:32:40 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:51:32.980: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:51:32.980: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:51:32.980: INFO: aws-cloud-controller-manager-4c7k7 started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.980: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 19 02:51:32.980: INFO: kops-controller-rkkdt started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.980: INFO: Container kops-controller ready: true, restart count 0
Jan 19 02:51:32.980: INFO: etcd-manager-events-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.980: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 02:51:32.980: INFO: etcd-manager-main-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.980: INFO: Container etcd-manager ready: true, restart count 0
Jan 19 02:51:32.980: INFO: kube-apiserver-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+2 container statuses recorded)
Jan 19 02:51:32.980: INFO: Container healthcheck ready: true, restart count 0
Jan 19 02:51:32.980: INFO: Container kube-apiserver ready: true, restart count 1
Jan 19 02:51:32.980: INFO: ebs-csi-controller-89bddb897-vfp22 started at 2023-01-19 02:32:43 +0000 UTC (0+5 container statuses recorded)
Jan 19 02:51:32.980: INFO: Container csi-attacher ready: true, restart count 0
Jan 19 02:51:32.980: INFO: Container csi-provisioner ready: true, restart count 0
Jan 19 02:51:32.980: INFO: Container csi-resizer ready: true, restart count 0
Jan 19 02:51:32.980: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:51:32.980: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:51:32.980: INFO: dns-controller-74d4646d88-9znsr started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.980: INFO: Container dns-controller ready: true, restart count 0
Jan 19 02:51:32.980: INFO: kube-controller-manager-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.980: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 19 02:51:32.980: INFO: kube-scheduler-i-098a14e8a4aca3f52 started at 2023-01-19 02:31:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.980: INFO: Container kube-scheduler ready: true, restart count 0
Jan 19 02:51:32.980: INFO: cilium-operator-6f8d6c4bf-tr54z started at 2023-01-19 02:32:43 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:32.980: INFO: Container cilium-operator ready: true, restart count 0
Jan 19 02:51:33.230: INFO:
Latency metrics for node i-098a14e8a4aca3f52
Jan 19 02:51:33.230: INFO:
Logging node info for node i-0f8b7f8eacf81cd58
Jan 19 02:51:33.295: INFO: Node Info: &Node{ObjectMeta:{i-0f8b7f8eacf81cd58 969780cc-600f-4d79-80fa-2e681c67e470 19339 0 2023-01-19 02:33:36 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f8b7f8eacf81cd58 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-0f8b7f8eacf81cd58 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.63.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f8b7f8eacf81cd58"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:47:12 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-19 02:47:38 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-0f8b7f8eacf81cd58,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:47:12 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:47:12 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:47:12 +0000 UTC,LastTransitionTime:2023-01-19 02:33:36 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:47:12 +0000 UTC,LastTransitionTime:2023-01-19 02:33:49 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.63.113,},NodeAddress{Type:ExternalIP,Address:54.188.219.55,},NodeAddress{Type:InternalDNS,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f8b7f8eacf81cd58.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-188-219-55.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec296be3bda6a5cf5f1cfc033b1bb6bb,SystemUUID:ec296be3-bda6-a5cf-5f1c-fc033b1bb6bb,BootID:2cccdc7f-1458-4e66-9053-d2f4c0f3fc70,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-00293629c9f01aed3 kubernetes.io/csi/ebs.csi.aws.com^vol-082942bdcba78ee31 kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0df93fe97dfae9e8a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ef5d266bdea052e0,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-082942bdcba78ee31,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-00293629c9f01aed3,DevicePath:,},},Config:nil,},}
Jan 19 02:51:33.295: INFO:
Logging kubelet events for node i-0f8b7f8eacf81cd58
Jan 19 02:51:33.362: INFO:
Logging pods the kubelet thinks is on node i-0f8b7f8eacf81cd58
Jan 19 02:51:33.435: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8cnst started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:33.435: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-t8z58 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:33.435: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-72jsz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:33.435: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-8vqd9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:33.435: INFO: pod1 started at 2023-01-19 02:46:59 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container agnhost-container ready: false, restart count 0
Jan 19 02:51:33.435: INFO: cilium-mpc7m started at 2023-01-19 02:33:37 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 19 02:51:33.435: INFO: Container cilium-agent ready: true, restart count 0
Jan 19 02:51:33.435: INFO: netserver-3 started at 2023-01-19 02:47:20 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container webserver ready: false, restart count 0
Jan 19 02:51:33.435: INFO: metadata-volume-5c901350-6147-464b-81a0-c6c252932bda started at 2023-01-19 02:51:17 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container client-container ready: false, restart count 0
Jan 19 02:51:33.435: INFO: affinity-clusterip-timeout-sflx7 started at 2023-01-19 02:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container affinity-clusterip-timeout ready: false, restart count 0
Jan 19 02:51:33.435: INFO: pod-87600900-ab09-4695-a4b1-f510a9918667 started at 2023-01-19 02:46:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container write-pod ready: false, restart count 0
Jan 19 02:51:33.435: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dw974 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:33.435: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hb6r2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:33.435: INFO: ebs-csi-node-x2rds started at 2023-01-19 02:33:37 +0000 UTC (0+3 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container ebs-plugin ready: true, restart count 0
Jan 19 02:51:33.435: INFO: Container liveness-probe ready: true, restart count 0
Jan 19 02:51:33.435: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 19 02:51:33.435: INFO: suspend-true-to-false-gvdhj started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container c ready: false, restart count 0
Jan 19 02:51:33.435: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-bd6fk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:33.435: INFO: fail-once-local-llx45 started at 2023-01-19 02:41:03 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container c ready: false, restart count 1
Jan 19 02:51:33.435: INFO: pod-0 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container donothing ready: false, restart count 0
Jan 19 02:51:33.435: INFO: suspend-true-to-false-qkh4c started at 2023-01-19 02:42:27 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container c ready: false, restart count 0
Jan 19 02:51:33.435: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-c8gns started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:33.435: INFO: suspend-true-to-false-s5btk started at 2023-01-19 02:42:45 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container c ready: false, restart count 0
Jan 19 02:51:33.435: INFO: fail-once-local-k868g started at 2023-01-19 02:41:03 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container c ready: false, restart count 1
Jan 19 02:51:33.435: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-m7587 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:33.435: INFO: pfpod started at 2023-01-19 02:46:30 +0000 UTC (0+2 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container portforwardtester ready: false, restart count 0
Jan 19 02:51:33.435: INFO: Container readiness ready: false, restart count 0
Jan 19 02:51:33.435: INFO: netserver-3 started at 2023-01-19 02:48:53 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container webserver ready: false, restart count 0
Jan 19 02:51:33.435: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4hdh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0
Jan 19 02:51:33.435: INFO: inline-volume-tester-g8cw8 started at 2023-01-19 02:46:37 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:51:33.435: INFO: fail-once-local-szfzl started at 2023-01-19 02:47:02 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container c ready: false, restart count 0
Jan 19 02:51:33.435: INFO: pod-2 started at 2023-01-19 02:47:40 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container donothing ready: false, restart count 0
Jan 19 02:51:33.435: INFO: pod-subpath-test-inlinevolume-ck6t started at 2023-01-19 02:48:33 +0000 UTC (1+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Init container init-volume-inlinevolume-ck6t ready: false, restart count 0
Jan 19 02:51:33.435: INFO: Container test-container-subpath-inlinevolume-ck6t ready: false, restart count 0
Jan 19 02:51:33.435: INFO: rc-test-qn447 started at 2023-01-19 02:46:39 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container rc-test ready: true, restart count 0
Jan 19 02:51:33.435: INFO: inline-volume-tester-m6c6d started at 2023-01-19 02:47:11 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 19 02:51:33.435: INFO: pod-update-activedeadlineseconds-025da2a6-1f98-4401-8573-c4874882421b started at 2023-01-19 02:51:18 +0000 UTC (0+1 container statuses recorded)
Jan 19 02:51:33.435: INFO: Container pause ready: false, restart count 0
Jan 19 02:51:33.695: INFO:
Latency metrics for node i-0f8b7f8eacf81cd58
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "port-forwarding-859" for this suite. �[38;5;243m01/19/23 02:51:33.695�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sKubectl\sdescribe\sshould\scheck\sif\skubectl\sdescribe\sprints\srelevant\sinformation\sfor\src\sand\spods\s\s\[Conformance\]$'
test/e2e/kubectl/kubectl.go:288 k8s.io/kubernetes/test/e2e/kubectl.glob..func1.4(0x1) test/e2e/kubectl/kubectl.go:288 +0x13b k8s.io/kubernetes/test/e2e/kubectl.glob..func1.19.1() test/e2e/kubectl/kubectl.go:1284 +0x237
[BeforeEach] [sig-cli] Kubectl client set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/19/23 02:52:02.579�[0m Jan 19 02:52:02.579: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/19/23 02:52:02.58�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/19/23 02:52:02.779�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/19/23 02:52:02.908�[0m [BeforeEach] [sig-cli] Kubectl client test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-cli] Kubectl client test/e2e/kubectl/kubectl.go:274 [It] should check if kubectl describe prints relevant information for rc and pods [Conformance] test/e2e/kubectl/kubectl.go:1276 Jan 19 02:52:03.037: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/ed525d0c-97a0-11ed-824d-f64c9135b4ea/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9493 create -f -' Jan 19 02:52:03.554: INFO: stderr: "" Jan 19 02:52:03.554: INFO: stdout: "replicationcontroller/agnhost-primary created\n" Jan 19 02:52:03.554: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/ed525d0c-97a0-11ed-824d-f64c9135b4ea/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-deb10-k26-ko26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9493 create -f -' Jan 19 02:52:04.037: INFO: stderr: "" Jan 19 02:52:04.037: INFO: stdout: "service/agnhost-primary created\n" �[1mSTEP:�[0m Waiting for Agnhost primary to start. �[38;5;243m01/19/23 02:52:04.037�[0m Jan 19 02:52:05.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:05.103: INFO: Found 0 / 1 Jan 19 02:52:06.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:06.103: INFO: Found 0 / 1 Jan 19 02:52:07.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:07.103: INFO: Found 0 / 1 Jan 19 02:52:08.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:08.104: INFO: Found 0 / 1 Jan 19 02:52:09.105: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:09.105: INFO: Found 0 / 1 Jan 19 02:52:10.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:10.104: INFO: Found 0 / 1 Jan 19 02:52:11.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:11.103: INFO: Found 0 / 1 Jan 19 02:52:12.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:12.103: INFO: Found 0 / 1 Jan 19 02:52:13.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:13.103: INFO: Found 0 / 1 Jan 19 02:52:14.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:14.104: INFO: Found 0 / 1 Jan 19 02:52:15.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:15.104: INFO: Found 0 / 1 Jan 19 02:52:16.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:16.103: INFO: Found 0 / 1 Jan 19 02:52:17.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:17.104: INFO: Found 0 / 1 Jan 19 02:52:18.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:18.104: INFO: Found 0 / 1 Jan 19 02:52:19.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:19.103: INFO: Found 0 / 1 Jan 19 02:52:20.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:20.104: INFO: Found 0 / 1 Jan 19 02:52:21.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:21.104: INFO: Found 0 / 1 Jan 19 02:52:22.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:22.103: INFO: Found 0 / 1 Jan 19 02:52:23.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:23.103: INFO: Found 0 / 1 Jan 19 02:52:24.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:24.104: INFO: Found 0 / 1 Jan 19 02:52:25.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:25.104: INFO: Found 0 / 1 Jan 19 02:52:26.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:26.104: INFO: Found 0 / 1 Jan 19 02:52:27.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:27.104: INFO: Found 0 / 1 Jan 19 02:52:28.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:28.104: INFO: Found 0 / 1 Jan 19 02:52:29.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:29.104: INFO: Found 0 / 1 Jan 19 02:52:30.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:30.103: INFO: Found 0 / 1 Jan 19 02:52:31.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:31.104: INFO: Found 0 / 1 Jan 19 02:52:32.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:32.103: INFO: Found 0 / 1 Jan 19 02:52:33.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:33.104: INFO: Found 0 / 1 Jan 19 02:52:34.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:34.103: INFO: Found 0 / 1 Jan 19 02:52:35.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:35.104: INFO: Found 0 / 1 Jan 19 02:52:36.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:36.104: INFO: Found 0 / 1 Jan 19 02:52:37.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:37.104: INFO: Found 0 / 1 Jan 19 02:52:38.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:38.103: INFO: Found 0 / 1 Jan 19 02:52:39.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:39.103: INFO: Found 0 / 1 Jan 19 02:52:40.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:40.104: INFO: Found 0 / 1 Jan 19 02:52:41.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:41.103: INFO: Found 0 / 1 Jan 19 02:52:42.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:42.104: INFO: Found 0 / 1 Jan 19 02:52:43.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:43.104: INFO: Found 0 / 1 Jan 19 02:52:44.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:44.103: INFO: Found 0 / 1 Jan 19 02:52:45.105: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:45.105: INFO: Found 0 / 1 Jan 19 02:52:46.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:46.104: INFO: Found 0 / 1 Jan 19 02:52:47.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:47.103: INFO: Found 0 / 1 Jan 19 02:52:48.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:48.104: INFO: Found 0 / 1 Jan 19 02:52:49.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:49.104: INFO: Found 0 / 1 Jan 19 02:52:50.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:50.104: INFO: Found 0 / 1 Jan 19 02:52:51.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:51.103: INFO: Found 0 / 1 Jan 19 02:52:52.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:52.103: INFO: Found 0 / 1 Jan 19 02:52:53.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:53.103: INFO: Found 0 / 1 Jan 19 02:52:54.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:54.103: INFO: Found 0 / 1 Jan 19 02:52:55.105: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:55.105: INFO: Found 0 / 1 Jan 19 02:52:56.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:56.104: INFO: Found 0 / 1 Jan 19 02:52:57.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:57.104: INFO: Found 0 / 1 Jan 19 02:52:58.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:58.104: INFO: Found 0 / 1 Jan 19 02:52:59.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:52:59.103: INFO: Found 0 / 1 Jan 19 02:53:00.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:00.104: INFO: Found 0 / 1 Jan 19 02:53:01.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:01.104: INFO: Found 0 / 1 Jan 19 02:53:02.105: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:02.105: INFO: Found 0 / 1 Jan 19 02:53:03.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:03.104: INFO: Found 0 / 1 Jan 19 02:53:04.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:04.103: INFO: Found 0 / 1 Jan 19 02:53:05.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:05.104: INFO: Found 0 / 1 Jan 19 02:53:06.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:06.104: INFO: Found 0 / 1 Jan 19 02:53:07.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:07.104: INFO: Found 0 / 1 Jan 19 02:53:08.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:08.103: INFO: Found 0 / 1 Jan 19 02:53:09.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:09.103: INFO: Found 0 / 1 Jan 19 02:53:10.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:10.104: INFO: Found 0 / 1 Jan 19 02:53:11.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:11.103: INFO: Found 0 / 1 Jan 19 02:53:12.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:12.104: INFO: Found 0 / 1 Jan 19 02:53:13.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:13.104: INFO: Found 0 / 1 Jan 19 02:53:14.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:14.103: INFO: Found 0 / 1 Jan 19 02:53:15.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:15.104: INFO: Found 0 / 1 Jan 19 02:53:16.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:16.104: INFO: Found 0 / 1 Jan 19 02:53:17.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:17.103: INFO: Found 0 / 1 Jan 19 02:53:18.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:18.103: INFO: Found 0 / 1 Jan 19 02:53:19.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:19.104: INFO: Found 0 / 1 Jan 19 02:53:20.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:20.103: INFO: Found 0 / 1 Jan 19 02:53:21.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:21.104: INFO: Found 0 / 1 Jan 19 02:53:22.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:22.104: INFO: Found 0 / 1 Jan 19 02:53:23.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:23.103: INFO: Found 0 / 1 Jan 19 02:53:24.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:24.104: INFO: Found 0 / 1 Jan 19 02:53:25.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:25.104: INFO: Found 0 / 1 Jan 19 02:53:26.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:26.104: INFO: Found 0 / 1 Jan 19 02:53:27.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:27.104: INFO: Found 0 / 1 Jan 19 02:53:28.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:28.104: INFO: Found 0 / 1 Jan 19 02:53:29.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:29.104: INFO: Found 0 / 1 Jan 19 02:53:30.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:30.104: INFO: Found 0 / 1 Jan 19 02:53:31.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:31.103: INFO: Found 0 / 1 Jan 19 02:53:32.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:32.104: INFO: Found 0 / 1 Jan 19 02:53:33.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:33.104: INFO: Found 0 / 1 Jan 19 02:53:34.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:34.103: INFO: Found 0 / 1 Jan 19 02:53:35.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:35.104: INFO: Found 0 / 1 Jan 19 02:53:36.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:36.103: INFO: Found 0 / 1 Jan 19 02:53:37.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:37.104: INFO: Found 0 / 1 Jan 19 02:53:38.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:38.104: INFO: Found 0 / 1 Jan 19 02:53:39.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:39.104: INFO: Found 0 / 1 Jan 19 02:53:40.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:40.104: INFO: Found 0 / 1 Jan 19 02:53:41.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:41.104: INFO: Found 0 / 1 Jan 19 02:53:42.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:42.104: INFO: Found 0 / 1 Jan 19 02:53:43.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:43.104: INFO: Found 0 / 1 Jan 19 02:53:44.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:44.104: INFO: Found 0 / 1 Jan 19 02:53:45.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:45.104: INFO: Found 0 / 1 Jan 19 02:53:46.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:46.104: INFO: Found 0 / 1 Jan 19 02:53:47.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:47.104: INFO: Found 0 / 1 Jan 19 02:53:48.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:48.104: INFO: Found 0 / 1 Jan 19 02:53:49.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:49.104: INFO: Found 0 / 1 Jan 19 02:53:50.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:50.104: INFO: Found 0 / 1 Jan 19 02:53:51.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:51.104: INFO: Found 0 / 1 Jan 19 02:53:52.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:52.103: INFO: Found 0 / 1 Jan 19 02:53:53.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:53.104: INFO: Found 0 / 1 Jan 19 02:53:54.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:54.103: INFO: Found 0 / 1 Jan 19 02:53:55.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:55.104: INFO: Found 0 / 1 Jan 19 02:53:56.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:56.103: INFO: Found 0 / 1 Jan 19 02:53:57.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:57.104: INFO: Found 0 / 1 Jan 19 02:53:58.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:58.103: INFO: Found 0 / 1 Jan 19 02:53:59.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:53:59.103: INFO: Found 0 / 1 Jan 19 02:54:00.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:00.104: INFO: Found 0 / 1 Jan 19 02:54:01.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:01.104: INFO: Found 0 / 1 Jan 19 02:54:02.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:02.104: INFO: Found 0 / 1 Jan 19 02:54:03.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:03.104: INFO: Found 0 / 1 Jan 19 02:54:04.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:04.103: INFO: Found 0 / 1 Jan 19 02:54:05.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:05.103: INFO: Found 0 / 1 Jan 19 02:54:06.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:06.104: INFO: Found 0 / 1 Jan 19 02:54:07.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:07.104: INFO: Found 0 / 1 Jan 19 02:54:08.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:08.104: INFO: Found 0 / 1 Jan 19 02:54:09.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:09.104: INFO: Found 0 / 1 Jan 19 02:54:10.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:10.103: INFO: Found 0 / 1 Jan 19 02:54:11.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:11.103: INFO: Found 0 / 1 Jan 19 02:54:12.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:12.103: INFO: Found 0 / 1 Jan 19 02:54:13.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:13.103: INFO: Found 0 / 1 Jan 19 02:54:14.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:14.104: INFO: Found 0 / 1 Jan 19 02:54:15.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:15.104: INFO: Found 0 / 1 Jan 19 02:54:16.105: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:16.105: INFO: Found 0 / 1 Jan 19 02:54:17.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:17.104: INFO: Found 0 / 1 Jan 19 02:54:18.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:18.104: INFO: Found 0 / 1 Jan 19 02:54:19.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:19.103: INFO: Found 0 / 1 Jan 19 02:54:20.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:20.104: INFO: Found 0 / 1 Jan 19 02:54:21.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:21.104: INFO: Found 0 / 1 Jan 19 02:54:22.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:22.104: INFO: Found 0 / 1 Jan 19 02:54:23.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:23.104: INFO: Found 0 / 1 Jan 19 02:54:24.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:24.104: INFO: Found 0 / 1 Jan 19 02:54:25.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:25.103: INFO: Found 0 / 1 Jan 19 02:54:26.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:26.104: INFO: Found 0 / 1 Jan 19 02:54:27.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:27.104: INFO: Found 0 / 1 Jan 19 02:54:28.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:28.103: INFO: Found 0 / 1 Jan 19 02:54:29.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:29.104: INFO: Found 0 / 1 Jan 19 02:54:30.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:30.104: INFO: Found 0 / 1 Jan 19 02:54:31.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:31.104: INFO: Found 0 / 1 Jan 19 02:54:32.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:32.103: INFO: Found 0 / 1 Jan 19 02:54:33.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:33.103: INFO: Found 0 / 1 Jan 19 02:54:34.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:34.104: INFO: Found 0 / 1 Jan 19 02:54:35.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:35.103: INFO: Found 0 / 1 Jan 19 02:54:36.105: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:36.105: INFO: Found 0 / 1 Jan 19 02:54:37.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:37.103: INFO: Found 0 / 1 Jan 19 02:54:38.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:38.104: INFO: Found 0 / 1 Jan 19 02:54:39.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:39.104: INFO: Found 0 / 1 Jan 19 02:54:40.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:40.104: INFO: Found 0 / 1 Jan 19 02:54:41.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:41.103: INFO: Found 0 / 1 Jan 19 02:54:42.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:42.104: INFO: Found 0 / 1 Jan 19 02:54:43.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:43.104: INFO: Found 0 / 1 Jan 19 02:54:44.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:44.104: INFO: Found 0 / 1 Jan 19 02:54:45.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:45.104: INFO: Found 0 / 1 Jan 19 02:54:46.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:46.104: INFO: Found 0 / 1 Jan 19 02:54:47.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:47.103: INFO: Found 0 / 1 Jan 19 02:54:48.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:48.104: INFO: Found 0 / 1 Jan 19 02:54:49.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:49.103: INFO: Found 0 / 1 Jan 19 02:54:50.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:50.104: INFO: Found 0 / 1 Jan 19 02:54:51.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:51.104: INFO: Found 0 / 1 Jan 19 02:54:52.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:52.104: INFO: Found 0 / 1 Jan 19 02:54:53.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:53.103: INFO: Found 0 / 1 Jan 19 02:54:54.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:54.104: INFO: Found 0 / 1 Jan 19 02:54:55.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:55.103: INFO: Found 0 / 1 Jan 19 02:54:56.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:56.104: INFO: Found 0 / 1 Jan 19 02:54:57.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:57.104: INFO: Found 0 / 1 Jan 19 02:54:58.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:58.103: INFO: Found 0 / 1 Jan 19 02:54:59.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:54:59.104: INFO: Found 0 / 1 Jan 19 02:55:00.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:00.103: INFO: Found 0 / 1 Jan 19 02:55:01.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:01.104: INFO: Found 0 / 1 Jan 19 02:55:02.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:02.104: INFO: Found 0 / 1 Jan 19 02:55:03.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:03.104: INFO: Found 0 / 1 Jan 19 02:55:04.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:04.103: INFO: Found 0 / 1 Jan 19 02:55:05.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:05.104: INFO: Found 0 / 1 Jan 19 02:55:06.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:06.104: INFO: Found 0 / 1 Jan 19 02:55:07.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:07.104: INFO: Found 0 / 1 Jan 19 02:55:08.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:08.104: INFO: Found 0 / 1 Jan 19 02:55:09.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:09.103: INFO: Found 0 / 1 Jan 19 02:55:10.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:10.104: INFO: Found 0 / 1 Jan 19 02:55:11.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:11.103: INFO: Found 0 / 1 Jan 19 02:55:12.106: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:12.106: INFO: Found 0 / 1 Jan 19 02:55:13.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:13.103: INFO: Found 0 / 1 Jan 19 02:55:14.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:14.103: INFO: Found 0 / 1 Jan 19 02:55:15.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:15.103: INFO: Found 0 / 1 Jan 19 02:55:16.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:16.103: INFO: Found 0 / 1 Jan 19 02:55:17.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:17.104: INFO: Found 0 / 1 Jan 19 02:55:18.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:18.103: INFO: Found 0 / 1 Jan 19 02:55:19.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:19.104: INFO: Found 0 / 1 Jan 19 02:55:20.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:20.104: INFO: Found 0 / 1 Jan 19 02:55:21.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:21.103: INFO: Found 0 / 1 Jan 19 02:55:22.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:22.103: INFO: Found 0 / 1 Jan 19 02:55:23.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:23.103: INFO: Found 0 / 1 Jan 19 02:55:24.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:24.104: INFO: Found 0 / 1 Jan 19 02:55:25.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:25.104: INFO: Found 0 / 1 Jan 19 02:55:26.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:26.104: INFO: Found 0 / 1 Jan 19 02:55:27.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:27.103: INFO: Found 0 / 1 Jan 19 02:55:28.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:28.104: INFO: Found 0 / 1 Jan 19 02:55:29.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:29.103: INFO: Found 0 / 1 Jan 19 02:55:30.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:30.104: INFO: Found 0 / 1 Jan 19 02:55:31.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:31.103: INFO: Found 0 / 1 Jan 19 02:55:32.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:32.103: INFO: Found 0 / 1 Jan 19 02:55:33.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:33.103: INFO: Found 0 / 1 Jan 19 02:55:34.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:34.104: INFO: Found 0 / 1 Jan 19 02:55:35.108: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:35.108: INFO: Found 0 / 1 Jan 19 02:55:36.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:36.103: INFO: Found 0 / 1 Jan 19 02:55:37.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:37.104: INFO: Found 0 / 1 Jan 19 02:55:38.105: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:38.105: INFO: Found 0 / 1 Jan 19 02:55:39.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:39.104: INFO: Found 0 / 1 Jan 19 02:55:40.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:40.104: INFO: Found 0 / 1 Jan 19 02:55:41.109: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:41.109: INFO: Found 0 / 1 Jan 19 02:55:42.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:42.104: INFO: Found 0 / 1 Jan 19 02:55:43.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:43.104: INFO: Found 0 / 1 Jan 19 02:55:44.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:44.104: INFO: Found 0 / 1 Jan 19 02:55:45.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:45.104: INFO: Found 0 / 1 Jan 19 02:55:46.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:46.103: INFO: Found 0 / 1 Jan 19 02:55:47.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:47.103: INFO: Found 0 / 1 Jan 19 02:55:48.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:48.103: INFO: Found 0 / 1 Jan 19 02:55:49.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:49.103: INFO: Found 0 / 1 Jan 19 02:55:50.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:50.104: INFO: Found 0 / 1 Jan 19 02:55:51.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:51.104: INFO: Found 0 / 1 Jan 19 02:55:52.115: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:52.115: INFO: Found 0 / 1 Jan 19 02:55:53.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:53.104: INFO: Found 0 / 1 Jan 19 02:55:54.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:54.104: INFO: Found 0 / 1 Jan 19 02:55:55.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:55.103: INFO: Found 0 / 1 Jan 19 02:55:56.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:56.104: INFO: Found 0 / 1 Jan 19 02:55:57.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:57.103: INFO: Found 0 / 1 Jan 19 02:55:58.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:58.104: INFO: Found 0 / 1 Jan 19 02:55:59.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:55:59.103: INFO: Found 0 / 1 Jan 19 02:56:00.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:00.104: INFO: Found 0 / 1 Jan 19 02:56:01.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:01.103: INFO: Found 0 / 1 Jan 19 02:56:02.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:02.104: INFO: Found 0 / 1 Jan 19 02:56:03.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:03.105: INFO: Found 0 / 1 Jan 19 02:56:04.105: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:04.105: INFO: Found 0 / 1 Jan 19 02:56:05.105: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:05.105: INFO: Found 0 / 1 Jan 19 02:56:06.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:06.103: INFO: Found 0 / 1 Jan 19 02:56:07.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:07.104: INFO: Found 0 / 1 Jan 19 02:56:08.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:08.104: INFO: Found 0 / 1 Jan 19 02:56:09.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:09.104: INFO: Found 0 / 1 Jan 19 02:56:10.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:10.104: INFO: Found 0 / 1 Jan 19 02:56:11.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:11.104: INFO: Found 0 / 1 Jan 19 02:56:12.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:12.104: INFO: Found 0 / 1 Jan 19 02:56:13.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:13.104: INFO: Found 0 / 1 Jan 19 02:56:14.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:14.103: INFO: Found 0 / 1 Jan 19 02:56:15.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:15.104: INFO: Found 0 / 1 Jan 19 02:56:16.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:16.104: INFO: Found 0 / 1 Jan 19 02:56:17.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:17.104: INFO: Found 0 / 1 Jan 19 02:56:18.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:18.103: INFO: Found 0 / 1 Jan 19 02:56:19.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:19.104: INFO: Found 0 / 1 Jan 19 02:56:20.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:20.104: INFO: Found 0 / 1 Jan 19 02:56:21.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:21.103: INFO: Found 0 / 1 Jan 19 02:56:22.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:22.104: INFO: Found 0 / 1 Jan 19 02:56:23.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:23.103: INFO: Found 0 / 1 Jan 19 02:56:24.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:24.104: INFO: Found 0 / 1 Jan 19 02:56:25.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:25.103: INFO: Found 0 / 1 Jan 19 02:56:26.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:26.104: INFO: Found 0 / 1 Jan 19 02:56:27.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:27.103: INFO: Found 0 / 1 Jan 19 02:56:28.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:28.104: INFO: Found 0 / 1 Jan 19 02:56:29.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:29.104: INFO: Found 0 / 1 Jan 19 02:56:30.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:30.103: INFO: Found 0 / 1 Jan 19 02:56:31.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:31.103: INFO: Found 0 / 1 Jan 19 02:56:32.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:32.104: INFO: Found 0 / 1 Jan 19 02:56:33.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:33.103: INFO: Found 0 / 1 Jan 19 02:56:34.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:34.104: INFO: Found 0 / 1 Jan 19 02:56:35.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:35.103: INFO: Found 0 / 1 Jan 19 02:56:36.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:36.104: INFO: Found 0 / 1 Jan 19 02:56:37.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:37.104: INFO: Found 0 / 1 Jan 19 02:56:38.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:38.103: INFO: Found 0 / 1 Jan 19 02:56:39.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:39.103: INFO: Found 0 / 1 Jan 19 02:56:40.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:40.104: INFO: Found 0 / 1 Jan 19 02:56:41.109: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:41.109: INFO: Found 0 / 1 Jan 19 02:56:42.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:42.103: INFO: Found 0 / 1 Jan 19 02:56:43.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:43.104: INFO: Found 0 / 1 Jan 19 02:56:44.102: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:44.102: INFO: Found 0 / 1 Jan 19 02:56:45.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:45.103: INFO: Found 0 / 1 Jan 19 02:56:46.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:46.103: INFO: Found 0 / 1 Jan 19 02:56:47.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:47.103: INFO: Found 0 / 1 Jan 19 02:56:48.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:48.104: INFO: Found 0 / 1 Jan 19 02:56:49.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:49.103: INFO: Found 0 / 1 Jan 19 02:56:50.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:50.103: INFO: Found 0 / 1 Jan 19 02:56:51.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:51.103: INFO: Found 0 / 1 Jan 19 02:56:52.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:52.104: INFO: Found 0 / 1 Jan 19 02:56:53.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:53.104: INFO: Found 0 / 1 Jan 19 02:56:54.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:54.104: INFO: Found 0 / 1 Jan 19 02:56:55.109: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:55.109: INFO: Found 0 / 1 Jan 19 02:56:56.105: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:56.105: INFO: Found 0 / 1 Jan 19 02:56:57.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:57.104: INFO: Found 0 / 1 Jan 19 02:56:58.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:58.104: INFO: Found 0 / 1 Jan 19 02:56:59.103: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:56:59.103: INFO: Found 0 / 1 Jan 19 02:57:00.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:57:00.104: INFO: Found 0 / 1 Jan 19 02:57:01.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:57:01.104: INFO: Found 0 / 1 Jan 19 02:57:02.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:57:02.104: INFO: Found 0 / 1 Jan 19 02:57:03.108: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:57:03.108: INFO: Found 0 / 1 Jan 19 02:57:04.104: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:57:04.104: INFO: Found 0 / 1 Jan 19 02:57:04.169: INFO: Selector matched 1 pods for map[app:agnhost] Jan 19 02:57:04.169: INFO: Found 0 / 1 Jan 19 02:57:04.169: INFO: WaitFor completed with timeout 5m0s. Pods found = 0 out of 1 �[1mSTEP:�[0m Collecting events from namespace "kubectl-9493". �[38;5;243m01/19/23 02:57:04.169�[0m �[1mSTEP:�[0m Found 12 events. �[38;5;243m01/19/23 02:57:04.234�[0m Jan 19 02:57:04.235: INFO: At 2023-01-19 02:52:03 +0000 UTC - event for agnhost-primary: {replication-controller } SuccessfulCreate: Created pod: agnhost-primary-t6mr6 Jan 19 02:57:04.235: INFO: At 2023-01-19 02:52:03 +0000 UTC - event for agnhost-primary-t6mr6: {default-scheduler } Scheduled: Successfully assigned kubectl-9493/agnhost-primary-t6mr6 to i-08066f65509d69679 Jan 19 02:57:04.235: INFO: At 2023-01-19 02:52:03 +0000 UTC - event for agnhost-primary-t6mr6: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "13071da6c3d316f615b0a76b347a064036ed25630b0818c96582ce322e1a4dbd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:04.235: INFO: At 2023-01-19 02:52:17 +0000 UTC - event for agnhost-primary-t6mr6: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "94367a68a170c9aac33790ee2e8491dbbd6f63a87394693fa4762985ae2c02df": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:04.235: INFO: At 2023-01-19 02:52:32 +0000 UTC - event for agnhost-primary-t6mr6: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ffd179c84128df8b2d2a33d07784db418f3cc7febf1430ded7c28061db7a1422": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:04.235: INFO: At 2023-01-19 02:52:45 +0000 UTC - event for agnhost-primary-t6mr6: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "08d1789735877b5aaed6547e8afa5c98370a9be160801252f9e12fbcbef96936": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:04.235: INFO: At 2023-01-19 02:52:56 +0000 UTC - event for agnhost-primary-t6mr6: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "776dac6fc984a29a8285875ecd423dfeb2ff70f221def913186740eca46c9806": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:04.235: INFO: At 2023-01-19 02:53:08 +0000 UTC - event for agnhost-primary-t6mr6: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "47952c37f21e677c43a606d466140626063d1a627b17fe0e6b1ae39471ebe655": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:04.235: INFO: At 2023-01-19 02:53:22 +0000 UTC - event for agnhost-primary-t6mr6: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6e12a5b1671f8dfa5b1b1e30b029322051f21b611f7125133f5126bbf680f8be": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:04.235: INFO: At 2023-01-19 02:53:37 +0000 UTC - event for agnhost-primary-t6mr6: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e8c4e1f9e879adb13fd1616ff6fd031ae0d3763df76ef76399138d537ec8a14d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:04.235: INFO: At 2023-01-19 02:53:50 +0000 UTC - event for agnhost-primary-t6mr6: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "84f976f764c0176730306e410c1886ba3de0268a9cae4d2d9e93ab1d456e4698": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:04.235: INFO: At 2023-01-19 02:54:02 +0000 UTC - event for agnhost-primary-t6mr6: {kubelet i-08066f65509d69679} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d5eddfe0b7d8bc2ac297873c76d1ace4a6e41e8856a9fbdd81cbf430cf787680": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 19 02:57:04.299: INFO: POD NODE PHASE GRACE CONDITIONS Jan 19 02:57:04.299: INFO: agnhost-primary-t6mr6 i-08066f65509d69679 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:52:03 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:52:03 +0000 UTC ContainersNotReady containers with unready status: [agnhost-primary]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:52:03 +0000 UTC ContainersNotReady containers with unready status: [agnhost-primary]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-19 02:52:03 +0000 UTC }] Jan 19 02:57:04.299: INFO: Jan 19 02:57:04.365: INFO: Unable to fetch kubectl-9493/agnhost-primary-t6mr6/agnhost-primary logs: the server rejected our request for an unknown reason (get pods agnhost-primary-t6mr6) Jan 19 02:57:04.431: INFO: Logging node info for node i-023e074b52731ec5a Jan 19 02:57:04.496: INFO: Node Info: &Node{ObjectMeta:{i-023e074b52731ec5a e961fee7-3382-47b0-8744-433e44345d0f 22429 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-023e074b52731ec5a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-023e074b52731ec5a topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.43 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-023e074b52731ec5a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-19 02:56:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-023e074b52731ec5a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:56:35 +0000 UTC,LastTransitionTime:2023-01-19 02:33:47 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.43,},NodeAddress{Type:ExternalIP,Address:35.163.72.25,},NodeAddress{Type:InternalDNS,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-023e074b52731ec5a.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-163-72-25.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2fdc458699464b606b9fca6747bb8e,SystemUUID:ec2fdc45-8699-464b-606b-9fca6747bb8e,BootID:c860ef30-1fd7-41be-b096-79723bc17c52,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 19 02:57:04.497: INFO: Logging kubelet events for node i-023e074b52731ec5a Jan 19 02:57:04.564: INFO: Logging pods the kubelet thinks is on node i-023e074b52731ec5a Jan 19 02:57:04.636: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-dzctr started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:04.636: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nztbv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:04.636: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-fqdth started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:04.636: INFO: rs-8nq4k started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:04.636: INFO: pod-d9db111b-e3ea-492e-8d92-f800d7e5eb72 started at 2023-01-19 02:54:00 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container write-pod ready: true, restart count 0 Jan 19 02:57:04.636: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-k7tm4 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:04.636: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-rbxbc started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:04.636: INFO: rs-s55zq started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:04.636: INFO: csi-mockplugin-0 started at 2023-01-19 02:55:03 +0000 UTC (0+4 container statuses recorded) Jan 19 02:57:04.636: INFO: Container busybox ready: false, restart count 0 Jan 19 02:57:04.636: INFO: Container csi-provisioner ready: false, restart count 0 Jan 19 02:57:04.636: INFO: Container driver-registrar ready: false, restart count 0 Jan 19 02:57:04.636: INFO: Container mock ready: false, restart count 0 Jan 19 02:57:04.636: INFO: ebs-csi-node-txkj8 started at 2023-01-19 02:33:36 +0000 UTC (0+3 container statuses recorded) Jan 19 02:57:04.636: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:57:04.636: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:57:04.636: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:57:04.636: INFO: hostexec-i-023e074b52731ec5a-54hsp started at 2023-01-19 02:53:57 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:57:04.636: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-px9wv started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: false, restart count 0 Jan 19 02:57:04.636: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-kmq27 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:04.636: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-nlzkq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:04.636: INFO: pod-274dfb82-42ec-4da2-a13a-f44e2e02e8e0 started at 2023-01-19 02:56:53 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container write-pod ready: false, restart count 0 Jan 19 02:57:04.636: INFO: coredns-559769c974-tc4gk started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container coredns ready: true, restart count 0 Jan 19 02:57:04.636: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gzrm9 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:04.636: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-z97mx started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:04.636: INFO: cilium-4xgjg started at 2023-01-19 02:33:36 +0000 UTC (1+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:57:04.636: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:57:04.636: INFO: coredns-autoscaler-7cb5c5b969-pkb4q started at 2023-01-19 02:33:48 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:04.636: INFO: Container autoscaler ready: true, restart count 0 Jan 19 02:57:04.903: INFO: Latency metrics for node i-023e074b52731ec5a Jan 19 02:57:04.903: INFO: Logging node info for node i-02d86c0c31a5b3e66 Jan 19 02:57:04.968: INFO: Node Info: &Node{ObjectMeta:{i-02d86c0c31a5b3e66 2b72ee85-8a44-46ad-89d8-94df5d455adf 21681 0 2023-01-19 02:33:41 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-02d86c0c31a5b3e66 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-02d86c0c31a5b3e66 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.52.66 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-3594":"i-02d86c0c31a5b3e66","ebs.csi.aws.com":"i-02d86c0c31a5b3e66"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:41 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:54:17 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:54:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-02d86c0c31a5b3e66,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078206976 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973349376 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:41 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:54:24 +0000 UTC,LastTransitionTime:2023-01-19 02:33:53 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.52.66,},NodeAddress{Type:ExternalIP,Address:54.218.213.176,},NodeAddress{Type:InternalDNS,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:Hostname,Address:i-02d86c0c31a5b3e66.us-west-2.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-218-213-176.us-west-2.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2854d64f7363e92b7b006397583f0a,SystemUUID:ec2854d6-4f73-63e9-2b7b-006397583f0a,BootID:a64d8535-a0a2-421b-b474-ed26b967c37a,KernelVersion:4.19.0-23-cloud-amd64,OSImage:Debian GNU/Linux 10 (buster),ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-3594^900045cd-97a4-11ed-af43-d6e7a8e15f2d kubernetes.io/csi/csi-hostpath-ephemeral-3594^90009a58-97a4-11ed-af43-d6e7a8e15f2d],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3594^90009a58-97a4-11ed-af43-d6e7a8e15f2d,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-3594^900045cd-97a4-11ed-af43-d6e7a8e15f2d,DevicePath:,},},Config:nil,},} Jan 19 02:57:04.968: INFO: Logging kubelet events for node i-02d86c0c31a5b3e66 Jan 19 02:57:05.044: INFO: Logging pods the kubelet thinks is on node i-02d86c0c31a5b3e66 Jan 19 02:57:05.136: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hgwmq started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:05.136: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-thtlz started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:05.136: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-gqbwh started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:05.136: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-njqx8 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:05.136: INFO: coredns-559769c974-jhsx5 started at 2023-01-19 02:34:10 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container coredns ready: true, restart count 0 Jan 19 02:57:05.136: INFO: hostexec-i-02d86c0c31a5b3e66-c6b9d started at 2023-01-19 02:56:47 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container agnhost-container ready: true, restart count 0 Jan 19 02:57:05.136: INFO: rs-gztrr started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:05.136: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-g4pps started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:05.136: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-r25l2 started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:05.136: INFO: cilium-dpz9q started at 2023-01-19 02:33:41 +0000 UTC (1+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 19 02:57:05.136: INFO: Container cilium-agent ready: true, restart count 0 Jan 19 02:57:05.136: INFO: inline-volume-tester-7nwl6 started at 2023-01-19 02:54:17 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 19 02:57:05.136: INFO: exec-volume-test-preprovisionedpv-9wvb started at 2023-01-19 02:56:57 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container exec-container-preprovisionedpv-9wvb ready: false, restart count 0 Jan 19 02:57:05.136: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-hkqgk started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:05.136: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-46kbx started at 2023-01-19 02:40:45 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:05.136: INFO: rs-ltlhr started at 2023-01-19 02:56:52 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container donothing ready: false, restart count 0 Jan 19 02:57:05.136: INFO: csi-hostpathplugin-0 started at 2023-01-19 02:53:05 +0000 UTC (0+7 container statuses recorded) Jan 19 02:57:05.136: INFO: Container csi-attacher ready: true, restart count 0 Jan 19 02:57:05.136: INFO: Container csi-provisioner ready: true, restart count 0 Jan 19 02:57:05.136: INFO: Container csi-resizer ready: true, restart count 0 Jan 19 02:57:05.136: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 19 02:57:05.136: INFO: Container hostpath ready: true, restart count 0 Jan 19 02:57:05.136: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:57:05.136: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:57:05.136: INFO: ebs-csi-node-vnlk5 started at 2023-01-19 02:33:41 +0000 UTC (0+3 container statuses recorded) Jan 19 02:57:05.136: INFO: Container ebs-plugin ready: true, restart count 0 Jan 19 02:57:05.136: INFO: Container liveness-probe ready: true, restart count 0 Jan 19 02:57:05.136: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 19 02:57:05.136: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-wm87d started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:05.136: INFO: cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9-jq8pp started at 2023-01-19 02:40:46 +0000 UTC (0+1 container statuses recorded) Jan 19 02:57:05.136: INFO: Container cleanup40-bc20dee4-6f87-41ec-abda-0038c37c6bd9 ready: true, restart count 0 Jan 19 02:57:05.420: INFO: Latency metrics for node i-02d86c0c31a5b3e66 Jan 19 02:57:05.420: INFO: Logging node info for node i-08066f65509d69679 Jan 19 02:57:05.486: INFO: Node Info: &Node{ObjectMeta:{i-08066f65509d69679 0be3effa-655e-4b68-9a19-46c9ab83ba9a 22779 0 2023-01-19 02:33:35 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:us-west-2 failure-domain.beta.kubernetes.io/zone:us-west-2a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08066f65509d69679 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:us-west-2a topology.hostpath.csi/node:i-08066f65509d69679 topology.kubernetes.io/region:us-west-2 topology.kubernetes.io/zone:us-west-2a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.217 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1190":"i-08066f65509d69679","ebs.csi.aws.com":"i-08066f65509d69679"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-19 02:33:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-19 02:33:36 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-19 02:40:45 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-19 02:57:01 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-19 02:57:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///us-west-2a/i-08066f65509d69679,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{50478186496 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4078190592 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{45430367772 0} {<nil>} 45430367772 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3973332992 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:35 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-19 02:57:03 +0000 UTC,LastTransitionTime:2023-01-19 02:33:48 +0000 UTC,Reason:KubeletReady,Message:kubele