e2e-kops-grid-cilium-eni-u2004-k26 #1618493961117110272
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 16 failed / 871 succeeded |
| Started | |
| Elapsed | 43m17s |
| Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDeployment\sdeployment\sshould\ssupport\srollover\s\[Conformance\]$'
test/e2e/apps/deployment.go:904 k8s.io/kubernetes/test/e2e/apps.testRolloverDeployment(0xc0004ad6d8?) test/e2e/apps/deployment.go:904 +0x4d1 k8s.io/kubernetes/test/e2e/apps.glob..func5.7() test/e2e/apps/deployment.go:133 +0x1dfrom junit_01.xml
[BeforeEach] [sig-apps] Deployment set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/26/23 06:37:47.725�[0m Jan 26 06:37:47.725: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename deployment �[38;5;243m01/26/23 06:37:47.726�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/26/23 06:37:48.047�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/26/23 06:37:48.256�[0m [BeforeEach] [sig-apps] Deployment test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-apps] Deployment test/e2e/apps/deployment.go:91 [It] deployment should support rollover [Conformance] test/e2e/apps/deployment.go:132 Jan 26 06:37:48.679: INFO: Pod name rollover-pod: Found 1 pods out of 1 �[1mSTEP:�[0m ensuring each pod is running �[38;5;243m01/26/23 06:37:48.679�[0m Jan 26 06:37:48.679: INFO: Waiting up to 5m0s for pod "test-rollover-controller-nb66n" in namespace "deployment-4668" to be "running" Jan 26 06:37:48.784: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 105.490978ms Jan 26 06:37:50.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2.211422167s Jan 26 06:37:52.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4.211993528s Jan 26 06:37:54.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 6.211891204s Jan 26 06:37:56.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 8.211559143s Jan 26 06:37:58.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 10.212022381s Jan 26 06:38:00.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 12.212279499s Jan 26 06:38:02.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 14.21228672s Jan 26 06:38:04.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 16.212111437s Jan 26 06:38:06.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 18.211775661s Jan 26 06:38:08.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 20.21156949s Jan 26 06:38:10.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 22.21145983s Jan 26 06:38:12.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 24.211651691s Jan 26 06:38:14.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 26.213204224s Jan 26 06:38:16.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 28.211446702s Jan 26 06:38:18.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 30.211642496s Jan 26 06:38:20.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 32.212233515s Jan 26 06:38:22.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 34.212608167s Jan 26 06:38:24.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 36.211480949s Jan 26 06:38:26.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 38.211602954s Jan 26 06:38:28.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 40.211639227s Jan 26 06:38:30.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 42.211734538s Jan 26 06:38:32.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 44.21255249s Jan 26 06:38:34.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 46.211785757s Jan 26 06:38:36.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 48.212571931s Jan 26 06:38:38.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 50.212474367s Jan 26 06:38:40.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 52.213152447s Jan 26 06:38:42.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 54.212237003s Jan 26 06:38:44.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 56.211701735s Jan 26 06:38:46.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 58.212849909s Jan 26 06:38:48.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.211575138s Jan 26 06:38:50.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.211775651s Jan 26 06:38:52.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.212395494s Jan 26 06:38:54.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.212522879s Jan 26 06:38:56.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.212133908s Jan 26 06:38:58.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.212285362s Jan 26 06:39:00.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.211855998s Jan 26 06:39:02.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.212967406s Jan 26 06:39:04.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.211650761s Jan 26 06:39:06.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.212536381s Jan 26 06:39:08.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.211929934s Jan 26 06:39:10.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.211641653s Jan 26 06:39:12.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.212166988s Jan 26 06:39:14.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.212295661s Jan 26 06:39:16.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.211576593s Jan 26 06:39:18.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.212370495s Jan 26 06:39:20.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.211773578s Jan 26 06:39:22.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.212457762s Jan 26 06:39:24.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.211613563s Jan 26 06:39:26.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.212327658s Jan 26 06:39:28.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.211647631s Jan 26 06:39:30.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.212627303s Jan 26 06:39:32.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.211555512s Jan 26 06:39:34.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.212349317s Jan 26 06:39:36.893: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.213725536s Jan 26 06:39:38.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.211542263s Jan 26 06:39:40.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.211581917s Jan 26 06:39:42.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.211618629s Jan 26 06:39:44.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.212271631s Jan 26 06:39:46.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.211744148s Jan 26 06:39:48.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.211562647s Jan 26 06:39:50.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.211438162s Jan 26 06:39:52.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.211367838s Jan 26 06:39:54.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.211672649s Jan 26 06:39:56.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.212168355s Jan 26 06:39:58.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.211743647s Jan 26 06:40:00.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.212147372s Jan 26 06:40:02.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.213189584s Jan 26 06:40:04.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.21250618s Jan 26 06:40:06.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.212401126s Jan 26 06:40:08.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.211664075s Jan 26 06:40:10.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.21229739s Jan 26 06:40:12.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.212408095s Jan 26 06:40:14.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.212236651s Jan 26 06:40:16.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.212577259s Jan 26 06:40:18.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.211717088s Jan 26 06:40:20.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.212306331s Jan 26 06:40:22.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.212336677s Jan 26 06:40:24.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.211604607s Jan 26 06:40:26.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.21197626s Jan 26 06:40:28.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.211216212s Jan 26 06:40:30.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.211539336s Jan 26 06:40:32.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.212207821s Jan 26 06:40:34.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.212363149s Jan 26 06:40:36.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.211689381s Jan 26 06:40:38.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.211661979s Jan 26 06:40:40.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.212321969s Jan 26 06:40:42.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.212688959s Jan 26 06:40:44.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.212263872s Jan 26 06:40:46.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.211540543s Jan 26 06:40:48.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.212063281s Jan 26 06:40:50.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.211507071s Jan 26 06:40:52.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.211532897s Jan 26 06:40:54.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.211659697s Jan 26 06:40:56.893: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.213887309s Jan 26 06:40:58.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.21138001s Jan 26 06:41:00.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.212435792s Jan 26 06:41:02.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.211384613s Jan 26 06:41:04.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.212347273s Jan 26 06:41:06.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.211805839s Jan 26 06:41:08.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.211642319s Jan 26 06:41:10.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.212233979s Jan 26 06:41:12.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.212545839s Jan 26 06:41:14.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.212473599s Jan 26 06:41:16.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.21152582s Jan 26 06:41:18.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.211760738s Jan 26 06:41:20.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.212313341s Jan 26 06:41:22.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.212616543s Jan 26 06:41:24.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.211515473s Jan 26 06:41:26.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.211480351s Jan 26 06:41:28.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.211649227s Jan 26 06:41:30.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.212352313s Jan 26 06:41:32.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.213304756s Jan 26 06:41:34.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.212542788s Jan 26 06:41:36.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.212529604s Jan 26 06:41:38.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.211761874s Jan 26 06:41:40.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.212461646s Jan 26 06:41:42.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.212610954s Jan 26 06:41:44.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.21142229s Jan 26 06:41:46.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.211572261s Jan 26 06:41:48.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.211531058s Jan 26 06:41:50.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.211657985s Jan 26 06:41:52.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.212250523s Jan 26 06:41:54.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.211758312s Jan 26 06:41:56.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.211422573s Jan 26 06:41:58.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.212093377s Jan 26 06:42:00.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.2115511s Jan 26 06:42:02.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.211511702s Jan 26 06:42:04.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.211467104s Jan 26 06:42:06.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.212406648s Jan 26 06:42:08.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.212135393s Jan 26 06:42:10.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.212417002s Jan 26 06:42:12.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.212422396s Jan 26 06:42:14.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.212575221s Jan 26 06:42:16.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.212432554s Jan 26 06:42:18.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.212142874s Jan 26 06:42:20.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.21143201s Jan 26 06:42:22.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.212271847s Jan 26 06:42:24.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.212306099s Jan 26 06:42:26.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.211809876s Jan 26 06:42:28.890: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.211434638s Jan 26 06:42:30.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.211721997s Jan 26 06:42:32.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.211976577s Jan 26 06:42:34.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.211916419s Jan 26 06:42:36.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.211611784s Jan 26 06:42:38.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.211827379s Jan 26 06:42:40.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.212515876s Jan 26 06:42:42.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.212336388s Jan 26 06:42:44.892: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.212716609s Jan 26 06:42:46.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.212543942s Jan 26 06:42:48.891: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.211599038s Jan 26 06:42:48.996: INFO: Pod "test-rollover-controller-nb66n": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.317242705s Jan 26 06:42:48.996: INFO: Unexpected error: error in waiting for pods to come up: failed to wait for pods running: [timed out while waiting for pod deployment-4668/test-rollover-controller-nb66n to be running]: <*errors.errorString | 0xc0017bafc0>: { s: "failed to wait for pods running: [timed out while waiting for pod deployment-4668/test-rollover-controller-nb66n to be running]", } Jan 26 06:42:48.996: FAIL: error in waiting for pods to come up: failed to wait for pods running: [timed out while waiting for pod deployment-4668/test-rollover-controller-nb66n to be running]: failed to wait for pods running: [timed out while waiting for pod deployment-4668/test-rollover-controller-nb66n to be running] Full Stack Trace k8s.io/kubernetes/test/e2e/apps.testRolloverDeployment(0xc0004ad6d8?) test/e2e/apps/deployment.go:904 +0x4d1 k8s.io/kubernetes/test/e2e/apps.glob..func5.7() test/e2e/apps/deployment.go:133 +0x1d [AfterEach] [sig-apps] Deployment test/e2e/apps/deployment.go:84 Jan 26 06:42:49.102: INFO: Log out all the ReplicaSets if there is no deployment created Jan 26 06:42:49.208: INFO: ReplicaSet "test-rollover-controller": &ReplicaSet{ObjectMeta:{test-rollover-controller deployment-4668 885b1717-445f-4bf4-bfb3-5f36408d260a 14491 1 2023-01-26 06:37:48 +0000 UTC <nil> <nil> map[name:rollover-pod pod:httpd] map[] [] [] [{e2e.test Update apps/v1 2023-01-26 06:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:name":{},"f:pod":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-26 06:37:48 +0000 UTC FieldsV1 {"f:status":{"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*1,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: rollover-pod,pod: httpd,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[name:rollover-pod pod:httpd] map[] [] [] []} {[] [] [{httpd registry.k8s.io/e2e-test-images/httpd:2.4.38-4 [] [] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent nil false false false}] [] Always 0xc00359f368 <nil> ClusterFirst map[] <nil> false false false <nil> PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:1,FullyLabeledReplicas:1,ObservedGeneration:1,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Jan 26 06:42:49.314: INFO: pod: "test-rollover-controller-nb66n": &Pod{ObjectMeta:{test-rollover-controller-nb66n test-rollover-controller- deployment-4668 4a77a4c1-5a06-4c12-b215-f14527cdfdbc 14492 0 2023-01-26 06:37:48 +0000 UTC <nil> <nil> map[name:rollover-pod pod:httpd] map[] [{apps/v1 ReplicaSet test-rollover-controller 885b1717-445f-4bf4-bfb3-5f36408d260a 0xc00411aee7 0xc00411aee8}] [] [{kube-controller-manager Update v1 2023-01-26 06:37:48 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:name":{},"f:pod":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"885b1717-445f-4bf4-bfb3-5f36408d260a\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"httpd\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-26 06:37:48 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-4w8nm,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:httpd,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-4w8nm,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-078e786f96d20a635,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:37:48 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:37:48 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:37:48 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [httpd],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:37:48 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.39.26,PodIP:,StartTime:2023-01-26 06:37:48 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:httpd,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment test/e2e/framework/node/init/init.go:32 Jan 26 06:42:49.314: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] Deployment test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-apps] Deployment dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/26/23 06:42:49.421�[0m �[1mSTEP:�[0m Collecting events from namespace "deployment-4668". �[38;5;243m01/26/23 06:42:49.421�[0m �[1mSTEP:�[0m Found 12 events. �[38;5;243m01/26/23 06:42:49.527�[0m Jan 26 06:42:49.527: INFO: At 2023-01-26 06:37:48 +0000 UTC - event for test-rollover-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-controller-nb66n Jan 26 06:42:49.527: INFO: At 2023-01-26 06:37:48 +0000 UTC - event for test-rollover-controller-nb66n: {default-scheduler } Scheduled: Successfully assigned deployment-4668/test-rollover-controller-nb66n to i-078e786f96d20a635 Jan 26 06:42:49.527: INFO: At 2023-01-26 06:37:49 +0000 UTC - event for test-rollover-controller-nb66n: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "93ff55dd1f4359efbffdaad7119e614bc24ad1c75cdff54dc7100fd0191e1582": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:42:49.527: INFO: At 2023-01-26 06:38:00 +0000 UTC - event for test-rollover-controller-nb66n: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a3c8f1bb18771ead023af1b5f443032c643e3d68f8c754e08edd187f2e0ab047": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:42:49.527: INFO: At 2023-01-26 06:38:15 +0000 UTC - event for test-rollover-controller-nb66n: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "19325994b8659aef3888eb3e420c73f572a93367fe7223ab65543f9ed3868855": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:42:49.527: INFO: At 2023-01-26 06:38:30 +0000 UTC - event for test-rollover-controller-nb66n: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3bfbf079b256907985e4e6e1a6a653bcda2ce354f5421e3b591bdc2fa9b64a00": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:42:49.527: INFO: At 2023-01-26 06:38:43 +0000 UTC - event for test-rollover-controller-nb66n: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f7a9ea5c7386a336b74676748211236a03bbb87218f651005b83511d8d09391a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:42:49.527: INFO: At 2023-01-26 06:38:55 +0000 UTC - event for test-rollover-controller-nb66n: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7a0f4e1a68eaf1dfddf5f3c691510d0a6749d26ece2acc3305ffa6a2da87f745": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:42:49.527: INFO: At 2023-01-26 06:39:11 +0000 UTC - event for test-rollover-controller-nb66n: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8e9acadc9dde3bc22472e79e99218a509312d0b38143efb23ba6af061bc88a46": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:42:49.527: INFO: At 2023-01-26 06:39:23 +0000 UTC - event for test-rollover-controller-nb66n: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "be22a1a92f77c70bfc37c7f696f51b97d96684b30abad14849436968a444fe54": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:42:49.527: INFO: At 2023-01-26 06:39:37 +0000 UTC - event for test-rollover-controller-nb66n: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "df6a645234ee3bc6bd5ba55ed42a2622c45f3faa90d8b0bf920f926c8b769282": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:42:49.527: INFO: At 2023-01-26 06:39:51 +0000 UTC - event for test-rollover-controller-nb66n: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bd7159e60ab1545fc4293cedf08592dd820174f9143d5e69fe99436080cf5386": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:42:49.633: INFO: POD NODE PHASE GRACE CONDITIONS Jan 26 06:42:49.633: INFO: test-rollover-controller-nb66n i-078e786f96d20a635 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:48 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:48 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:48 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:48 +0000 UTC }] Jan 26 06:42:49.633: INFO: Jan 26 06:42:49.739: INFO: Unable to fetch deployment-4668/test-rollover-controller-nb66n/httpd logs: the server rejected our request for an unknown reason (get pods test-rollover-controller-nb66n) Jan 26 06:42:49.846: INFO: Logging node info for node i-027758317ed18f24c Jan 26 06:42:49.952: INFO: Node Info: &Node{ObjectMeta:{i-027758317ed18f24c 5be4e0bd-951c-4336-b624-4b1e91c486e9 15442 0 2023-01-26 06:28:01 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-027758317ed18f24c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-027758317ed18f24c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.30 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-027758317ed18f24c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:39:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-027758317ed18f24c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.30,},NodeAddress{Type:ExternalIP,Address:54.78.113.195,},NodeAddress{Type:InternalDNS,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-78-113-195.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec217487a4b2df8f6bfdfc14eba9a7c2,SystemUUID:ec217487-a4b2-df8f-6bfd-fc14eba9a7c2,BootID:54603b90-dc3a-4156-9179-27712e5d6040,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 26 06:42:49.952: INFO: Logging kubelet events for node i-027758317ed18f24c Jan 26 06:42:50.062: INFO: Logging pods the kubelet thinks is on node i-027758317ed18f24c Jan 26 06:42:50.176: INFO: ebs-csi-node-ltj76 started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded) Jan 26 06:42:50.176: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:42:50.176: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:42:50.176: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:42:50.176: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-2ln5x started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.176: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4kttc started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.176: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-rs2m5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.176: INFO: pod-disruption-failure-ignore-0-j8pfd started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container c ready: false, restart count 0 Jan 26 06:42:50.176: INFO: netserver-0 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container webserver ready: false, restart count 0 Jan 26 06:42:50.176: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4frxr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.176: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5nlws started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.176: INFO: csi-mockplugin-0 started at 2023-01-26 06:38:10 +0000 UTC (0+3 container statuses recorded) Jan 26 06:42:50.176: INFO: Container csi-provisioner ready: false, restart count 0 Jan 26 06:42:50.176: INFO: Container driver-registrar ready: false, restart count 0 Jan 26 06:42:50.176: INFO: Container mock ready: false, restart count 0 Jan 26 06:42:50.176: INFO: coredns-559769c974-wcbx4 started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container coredns ready: true, restart count 0 Jan 26 06:42:50.176: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8h5jw started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.176: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-pq6nw started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.176: INFO: coredns-autoscaler-7cb5c5b969-n6dbb started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container autoscaler ready: true, restart count 0 Jan 26 06:42:50.176: INFO: test-rolling-update-with-lb-56d9b65d4c-n5n56 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container agnhost ready: false, restart count 0 Jan 26 06:42:50.176: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-p5fw4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.176: INFO: cilium-rf9ss started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:42:50.176: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:42:50.176: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-mdbgh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.176: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-qlxcz started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.176: INFO: pod-disruption-failure-ignore-1-j4jwr started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.176: INFO: Container c ready: false, restart count 0 Jan 26 06:42:50.599: INFO: Latency metrics for node i-027758317ed18f24c Jan 26 06:42:50.599: INFO: Logging node info for node i-03743e1aeef854f6a Jan 26 06:42:50.705: INFO: Node Info: &Node{ObjectMeta:{i-03743e1aeef854f6a 24dc0f81-a5a8-4cc2-b4c4-d349428290df 14959 0 2023-01-26 06:28:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03743e1aeef854f6a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-03743e1aeef854f6a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.218 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03743e1aeef854f6a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-03743e1aeef854f6a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.218,},NodeAddress{Type:ExternalIP,Address:34.242.210.172,},NodeAddress{Type:InternalDNS,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-242-210-172.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20e9e6999a79b936afeaa0b5c2f8d1,SystemUUID:ec20e9e6-999a-79b9-36af-eaa0b5c2f8d1,BootID:78a5ef12-71ee-45de-9a4e-511ab894624a,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1,DevicePath:,},},Config:nil,},} Jan 26 06:42:50.706: INFO: Logging kubelet events for node i-03743e1aeef854f6a Jan 26 06:42:50.814: INFO: Logging pods the kubelet thinks is on node i-03743e1aeef854f6a Jan 26 06:42:50.940: INFO: affinity-nodeport-transition-hk5f5 started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Jan 26 06:42:50.940: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c966n started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.940: INFO: netserver-1 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container webserver ready: false, restart count 0 Jan 26 06:42:50.940: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-64l9m started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.940: INFO: downwardapi-volume-a4ec348e-9be9-4f89-accc-454ea9b384f2 started at 2023-01-26 06:38:14 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container client-container ready: false, restart count 0 Jan 26 06:42:50.940: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-gg2n2 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.940: INFO: alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab ready: false, restart count 0 Jan 26 06:42:50.940: INFO: busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 started at 2023-01-26 06:38:51 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container busybox ready: false, restart count 0 Jan 26 06:42:50.940: INFO: pod-1 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container donothing ready: false, restart count 0 Jan 26 06:42:50.940: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-fwv5h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.940: INFO: pod-subpath-test-preprovisionedpv-bfzt started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container test-container-subpath-preprovisionedpv-bfzt ready: false, restart count 0 Jan 26 06:42:50.940: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bjg5g started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.940: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4x2rf started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.940: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-k7vkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.940: INFO: ebs-csi-node-9p4ds started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded) Jan 26 06:42:50.940: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:42:50.940: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:42:50.940: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:42:50.940: INFO: cilium-h8sgv started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:42:50.940: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:42:50.940: INFO: ss-1 started at 2023-01-26 06:37:47 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container webserver ready: false, restart count 0 Jan 26 06:42:50.940: INFO: explicit-nonroot-uid started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container explicit-nonroot-uid ready: false, restart count 0 Jan 26 06:42:50.940: INFO: hostexec-i-03743e1aeef854f6a-vjpnj started at 2023-01-26 06:38:19 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container agnhost-container ready: true, restart count 0 Jan 26 06:42:50.940: INFO: test-rolling-update-with-lb-56d9b65d4c-sl4lf started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container agnhost ready: true, restart count 0 Jan 26 06:42:50.940: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-w7dtm started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.940: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9ncf5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:50.940: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9rzll started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:50.940: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:51.362: INFO: Latency metrics for node i-03743e1aeef854f6a Jan 26 06:42:51.362: INFO: Logging node info for node i-078e786f96d20a635 Jan 26 06:42:51.467: INFO: Node Info: &Node{ObjectMeta:{i-078e786f96d20a635 f723e0db-adce-4e86-a6eb-74cd60253348 15626 0 2023-01-26 06:28:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-078e786f96d20a635 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-078e786f96d20a635 topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.26 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2478":"i-078e786f96d20a635","ebs.csi.aws.com":"i-078e786f96d20a635"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-26 06:28:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-078e786f96d20a635,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.26,},NodeAddress{Type:ExternalIP,Address:54.77.178.217,},NodeAddress{Type:InternalDNS,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-77-178-217.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24661a036d7f8fb4e32b792d7b9eff,SystemUUID:ec24661a-036d-7f8f-b4e3-2b792d7b9eff,BootID:ea35d483-6a83-4e50-8ffa-20c56aa45bf3,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8 kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8,DevicePath:,},},Config:nil,},} Jan 26 06:42:51.468: INFO: Logging kubelet events for node i-078e786f96d20a635 Jan 26 06:42:51.576: INFO: Logging pods the kubelet thinks is on node i-078e786f96d20a635 Jan 26 06:42:51.692: INFO: pfpod started at 2023-01-26 06:37:48 +0000 UTC (0+2 container statuses recorded) Jan 26 06:42:51.692: INFO: Container portforwardtester ready: false, restart count 0 Jan 26 06:42:51.692: INFO: Container readiness ready: false, restart count 0 Jan 26 06:42:51.692: INFO: var-expansion-8f3d4023-ad0f-4de9-9fca-b5144eba549f started at 2023-01-26 06:38:20 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container dapi-container ready: false, restart count 0 Jan 26 06:42:51.692: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tl4r4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: false, restart count 0 Jan 26 06:42:51.692: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cckkd started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:51.692: INFO: ss-0 started at 2023-01-26 06:36:05 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container webserver ready: true, restart count 0 Jan 26 06:42:51.692: INFO: ebs-csi-node-bm9ks started at 2023-01-26 06:28:04 +0000 UTC (0+3 container statuses recorded) Jan 26 06:42:51.692: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:42:51.692: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:42:51.692: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:42:51.692: INFO: cilium-tvcl7 started at 2023-01-26 06:28:04 +0000 UTC (1+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:42:51.692: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:42:51.692: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bvftr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:51.692: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c5w9z started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:51.692: INFO: test-rollover-controller-nb66n started at 2023-01-26 06:37:48 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container httpd ready: false, restart count 0 Jan 26 06:42:51.692: INFO: dns-test-cee2145e-bfbc-4913-ab2f-46bbcbb0c067 started at 2023-01-26 06:38:58 +0000 UTC (0+3 container statuses recorded) Jan 26 06:42:51.692: INFO: Container jessie-querier ready: false, restart count 0 Jan 26 06:42:51.692: INFO: Container querier ready: false, restart count 0 Jan 26 06:42:51.692: INFO: Container webserver ready: false, restart count 0 Jan 26 06:42:51.692: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-llwt7 started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:51.692: INFO: test-rolling-update-with-lb-56d9b65d4c-k8ss5 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container agnhost ready: false, restart count 0 Jan 26 06:42:51.692: INFO: pause started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container pause ready: false, restart count 0 Jan 26 06:42:51.692: INFO: hostexec-i-078e786f96d20a635-kwjjx started at 2023-01-26 06:41:53 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container agnhost-container ready: true, restart count 0 Jan 26 06:42:51.692: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-lxcv7 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:51.692: INFO: rc-test-f4hc8 started at 2023-01-26 06:37:54 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container rc-test ready: false, restart count 0 Jan 26 06:42:51.692: INFO: inline-volume-tester-sbl7m started at 2023-01-26 06:34:40 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 26 06:42:51.692: INFO: netserver-2 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container webserver ready: false, restart count 0 Jan 26 06:42:51.692: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-zdwkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:51.692: INFO: affinity-nodeport-transition-gxp6x started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container affinity-nodeport-transition ready: false, restart count 0 Jan 26 06:42:51.692: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b2pzh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:51.692: INFO: pod-0 started at 2023-01-26 06:36:14 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container donothing ready: true, restart count 0 Jan 26 06:42:51.692: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cl2g5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:51.692: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-j5qj6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:51.692: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:36:46 +0000 UTC (0+7 container statuses recorded) Jan 26 06:42:51.692: INFO: Container csi-attacher ready: true, restart count 0 Jan 26 06:42:51.692: INFO: Container csi-provisioner ready: true, restart count 0 Jan 26 06:42:51.692: INFO: Container csi-resizer ready: true, restart count 0 Jan 26 06:42:51.692: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 26 06:42:51.692: INFO: Container hostpath ready: true, restart count 0 Jan 26 06:42:51.692: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:42:51.692: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:42:51.692: INFO: pod-e8f677e8-f25b-4b11-9e72-60c497d771a7 started at 2023-01-26 06:41:58 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container write-pod ready: false, restart count 0 Jan 26 06:42:51.692: INFO: inline-volume-tester-mmz4t started at 2023-01-26 06:39:35 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 26 06:42:51.692: INFO: pod-2 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:51.692: INFO: Container donothing ready: false, restart count 0 Jan 26 06:42:52.391: INFO: Latency metrics for node i-078e786f96d20a635 Jan 26 06:42:52.391: INFO: Logging node info for node i-07dd0af9495bd7a2d Jan 26 06:42:52.497: INFO: Node Info: &Node{ObjectMeta:{i-07dd0af9495bd7a2d db95ce0d-a7e3-4367-b695-1206b36a4ed7 16185 0 2023-01-26 06:28:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07dd0af9495bd7a2d kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-07dd0af9495bd7a2d topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.14 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07dd0af9495bd7a2d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:28:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:41:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-07dd0af9495bd7a2d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.14,},NodeAddress{Type:ExternalIP,Address:34.254.60.108,},NodeAddress{Type:InternalDNS,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-254-60-108.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23d9d9da6c43e1b12d6c6adb2bca5c,SystemUUID:ec23d9d9-da6c-43e1-b12d-6c6adb2bca5c,BootID:8844f0d4-74db-4ceb-94f5-285e3dcef78b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 26 06:42:52.497: INFO: Logging kubelet events for node i-07dd0af9495bd7a2d Jan 26 06:42:52.606: INFO: Logging pods the kubelet thinks is on node i-07dd0af9495bd7a2d Jan 26 06:42:52.723: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-kmrs9 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:52.723: INFO: coredns-559769c974-hxkxl started at 2023-01-26 06:28:36 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container coredns ready: true, restart count 0 Jan 26 06:42:52.723: INFO: affinity-nodeport-transition-b7tng started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Jan 26 06:42:52.723: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:42:01 +0000 UTC (0+7 container statuses recorded) Jan 26 06:42:52.723: INFO: Container csi-attacher ready: false, restart count 0 Jan 26 06:42:52.723: INFO: Container csi-provisioner ready: false, restart count 0 Jan 26 06:42:52.723: INFO: Container csi-resizer ready: false, restart count 0 Jan 26 06:42:52.723: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 26 06:42:52.723: INFO: Container hostpath ready: false, restart count 0 Jan 26 06:42:52.723: INFO: Container liveness-probe ready: false, restart count 0 Jan 26 06:42:52.723: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 26 06:42:52.723: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5dbcr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:52.723: INFO: ebs-csi-node-vsjqn started at 2023-01-26 06:28:03 +0000 UTC (0+3 container statuses recorded) Jan 26 06:42:52.723: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:42:52.723: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:42:52.723: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:42:52.723: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tt42n started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:52.723: INFO: httpd started at 2023-01-26 06:39:40 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container httpd ready: false, restart count 0 Jan 26 06:42:52.723: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-47vr6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:52.723: INFO: hostpath-symlink-prep-provisioning-3425 started at 2023-01-26 06:38:58 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container init-volume-provisioning-3425 ready: false, restart count 0 Jan 26 06:42:52.723: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b4l5j started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:52.723: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-v96fn started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:52.723: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-56mcl started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:52.723: INFO: netserver-3 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container webserver ready: false, restart count 0 Jan 26 06:42:52.723: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-6prmp started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:52.723: INFO: cilium-w5n9v started at 2023-01-26 06:28:03 +0000 UTC (1+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:42:52.723: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:42:52.723: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bzv56 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:52.723: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8jm8h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:52.723: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:42:53.203: INFO: Latency metrics for node i-07dd0af9495bd7a2d Jan 26 06:42:53.203: INFO: Logging node info for node i-089a9e95df3068b0a Jan 26 06:42:53.309: INFO: Node Info: &Node{ObjectMeta:{i-089a9e95df3068b0a 35816ce0-3668-4f6e-a8fd-15fd2906316c 15227 0 2023-01-26 06:25:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089a9e95df3068b0a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089a9e95df3068b0a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:25:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-26 06:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:27:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-26 06:38:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-089a9e95df3068b0a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:27:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.54,},NodeAddress{Type:ExternalIP,Address:18.203.178.61,},NodeAddress{Type:InternalDNS,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-203-178-61.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec270b473b916bebdc318bfa0f9b1a87,SystemUUID:ec270b47-3b91-6beb-dc31-8bfa0f9b1a87,BootID:b319d8a4-ba87-403c-8d6a-5778dcb9a28c,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:63920476,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:44339051,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841311,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965809,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 26 06:42:53.310: INFO: Logging kubelet events for node i-089a9e95df3068b0a Jan 26 06:42:53.418: INFO: Logging pods the kubelet thinks is on node i-089a9e95df3068b0a Jan 26 06:42:53.530: INFO: etcd-manager-events-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded) Jan 26 06:42:53.530: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Container etcd-manager ready: true, restart count 0 Jan 26 06:42:53.530: INFO: kube-apiserver-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+2 container statuses recorded) Jan 26 06:42:53.530: INFO: Container healthcheck ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Container kube-apiserver ready: true, restart count 2 Jan 26 06:42:53.530: INFO: kube-scheduler-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:53.530: INFO: Container kube-scheduler ready: true, restart count 0 Jan 26 06:42:53.530: INFO: cilium-8rnxh started at 2023-01-26 06:26:49 +0000 UTC (1+1 container statuses recorded) Jan 26 06:42:53.530: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:42:53.530: INFO: ebs-csi-node-62mcc started at 2023-01-26 06:26:49 +0000 UTC (0+3 container statuses recorded) Jan 26 06:42:53.530: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:42:53.530: INFO: dns-controller-69987775c6-9h2dj started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:53.530: INFO: Container dns-controller ready: true, restart count 0 Jan 26 06:42:53.530: INFO: etcd-manager-main-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded) Jan 26 06:42:53.530: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Container etcd-manager ready: true, restart count 0 Jan 26 06:42:53.530: INFO: kube-controller-manager-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:53.530: INFO: Container kube-controller-manager ready: true, restart count 4 Jan 26 06:42:53.530: INFO: kops-controller-nkbt7 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:53.530: INFO: Container kops-controller ready: true, restart count 0 Jan 26 06:42:53.530: INFO: aws-cloud-controller-manager-xz4hv started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:53.530: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 26 06:42:53.530: INFO: cilium-operator-5dd44dc49f-2h9f5 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:42:53.530: INFO: Container cilium-operator ready: true, restart count 0 Jan 26 06:42:53.530: INFO: ebs-csi-controller-5bd98b456f-zpvmp started at 2023-01-26 06:26:49 +0000 UTC (0+5 container statuses recorded) Jan 26 06:42:53.530: INFO: Container csi-attacher ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Container csi-provisioner ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Container csi-resizer ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:42:53.530: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:42:53.910: INFO: Latency metrics for node i-089a9e95df3068b0a [DeferCleanup (Each)] [sig-apps] Deployment tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "deployment-4668" for this suite. �[38;5;243m01/26/23 06:42:53.91�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDeployment\sshould\snot\sdisrupt\sa\scloud\sload\-balancer\'s\sconnectivity\sduring\srollout$'
test/e2e/apps/deployment.go:1378 k8s.io/kubernetes/test/e2e/apps.testRollingUpdateDeploymentWithLocalTrafficLoadBalancer(0x8022ee8?) test/e2e/apps/deployment.go:1378 +0x6f7 k8s.io/kubernetes/test/e2e/apps.glob..func5.12() test/e2e/apps/deployment.go:169 +0x118from junit_01.xml
[BeforeEach] [sig-apps] Deployment set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/26/23 06:38:01.607�[0m Jan 26 06:38:01.607: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename deployment �[38;5;243m01/26/23 06:38:01.608�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/26/23 06:38:01.932�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/26/23 06:38:02.144�[0m [BeforeEach] [sig-apps] Deployment test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-apps] Deployment test/e2e/apps/deployment.go:91 [It] should not disrupt a cloud load-balancer's connectivity during rollout test/e2e/apps/deployment.go:163 Jan 26 06:38:02.464: INFO: Creating Deployment "test-rolling-update-with-lb" Jan 26 06:38:02.679: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:04.791: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:06.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:08.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:10.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:12.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:14.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:16.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:18.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:20.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:22.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:24.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:26.788: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:28.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:30.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:32.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:34.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:36.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:38.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:40.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:42.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:44.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:46.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:48.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:50.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:52.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:54.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:56.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:38:58.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:00.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:02.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:04.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:06.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:08.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:10.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:12.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:14.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:16.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:18.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:20.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:22.791: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:24.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:26.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:28.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:30.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:32.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:34.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:36.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:38.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:40.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:42.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:44.790: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:46.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:48.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:50.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:52.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:54.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:56.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:39:58.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:00.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:02.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:04.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:06.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:08.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:10.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:12.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:14.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:16.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:18.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:20.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:22.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:24.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:26.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:28.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:30.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:32.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:34.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:36.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:38.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:40.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:42.789: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:44.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:46.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:48.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:50.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:52.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:54.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:56.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:40:58.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:00.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:02.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:04.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:06.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:08.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:10.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:12.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:14.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:16.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:18.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:20.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:22.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:24.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:26.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:28.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:30.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:32.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:34.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:36.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:38.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:40.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:42.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:44.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:46.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:48.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:50.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:52.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:54.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:56.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:41:58.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:00.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:02.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:04.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:06.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:08.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:10.792: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:12.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:14.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:16.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:18.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:20.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:22.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:24.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:26.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:28.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:30.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:32.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:34.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:36.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:38.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:40.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:42.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:44.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:46.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:48.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:50.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:52.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:54.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:56.786: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:42:58.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:43:00.791: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:43:02.787: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:43:02.894: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 26 06:43:02.894: INFO: Unexpected error: <*errors.errorString | 0xc000194a90>: { s: "error waiting for deployment \"test-rolling-update-with-lb\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"test-rolling-update-with-lb-56d9b65d4c\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", } Jan 26 06:43:02.894: FAIL: error waiting for deployment "test-rolling-update-with-lb" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 26, 6, 39, 55, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 26, 6, 38, 2, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)} Full Stack Trace k8s.io/kubernetes/test/e2e/apps.testRollingUpdateDeploymentWithLocalTrafficLoadBalancer(0x8022ee8?) test/e2e/apps/deployment.go:1378 +0x6f7 k8s.io/kubernetes/test/e2e/apps.glob..func5.12() test/e2e/apps/deployment.go:169 +0x118 [AfterEach] [sig-apps] Deployment test/e2e/apps/deployment.go:84 Jan 26 06:43:03.001: INFO: Deployment "test-rolling-update-with-lb": &Deployment{ObjectMeta:{test-rolling-update-with-lb deployment-7711 44b11bce-e024-480f-8255-892336de0568 15769 1 2023-01-26 06:38:02 +0000 UTC <nil> <nil> map[name:test-rolling-update-with-lb] map[deployment.kubernetes.io/revision:1] [] [] [{e2e.test Update apps/v1 2023-01-26 06:38:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:iteration":{},"f:name":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-26 06:39:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}}},"f:status":{"f:availableReplicas":{},"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Progressing\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{},"f:unavailableReplicas":{},"f:updatedReplicas":{}}} status}]},Spec:DeploymentSpec{Replicas:*3,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: test-rolling-update-with-lb,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb] map[] [] [] []} {[] [] [{agnhost registry.k8s.io/e2e-test-images/agnhost:2.43 [] [netexec --http-port=80 --udp-port=80] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc0018f2738 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] &Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},} default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},Strategy:DeploymentStrategy{Type:RollingUpdate,RollingUpdate:&RollingUpdateDeployment{MaxUnavailable:0,MaxSurge:1,},},MinReadySeconds:0,RevisionHistoryLimit:*10,Paused:false,ProgressDeadlineSeconds:*600,},Status:DeploymentStatus{ObservedGeneration:1,Replicas:3,UpdatedReplicas:3,AvailableReplicas:1,UnavailableReplicas:2,Conditions:[]DeploymentCondition{DeploymentCondition{Type:Available,Status:False,Reason:MinimumReplicasUnavailable,Message:Deployment does not have minimum availability.,LastUpdateTime:2023-01-26 06:38:02 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,},DeploymentCondition{Type:Progressing,Status:True,Reason:ReplicaSetUpdated,Message:ReplicaSet "test-rolling-update-with-lb-56d9b65d4c" is progressing.,LastUpdateTime:2023-01-26 06:39:55 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,},},ReadyReplicas:1,CollisionCount:nil,},} Jan 26 06:43:03.110: INFO: New ReplicaSet "test-rolling-update-with-lb-56d9b65d4c" of Deployment "test-rolling-update-with-lb": &ReplicaSet{ObjectMeta:{test-rolling-update-with-lb-56d9b65d4c deployment-7711 9b64d913-4489-4731-96d5-43800857d2c7 15768 1 2023-01-26 06:38:02 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:56d9b65d4c] map[deployment.kubernetes.io/desired-replicas:3 deployment.kubernetes.io/max-replicas:4 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment test-rolling-update-with-lb 44b11bce-e024-480f-8255-892336de0568 0xc0018f2b67 0xc0018f2b68}] [] [{kube-controller-manager Update apps/v1 2023-01-26 06:38:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"44b11bce-e024-480f-8255-892336de0568\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-26 06:39:55 +0000 UTC FieldsV1 {"f:status":{"f:availableReplicas":{},"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*3,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: test-rolling-update-with-lb,pod-template-hash: 56d9b65d4c,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:56d9b65d4c] map[] [] [] []} {[] [] [{agnhost registry.k8s.io/e2e-test-images/agnhost:2.43 [] [netexec --http-port=80 --udp-port=80] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc0018f2c28 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] &Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},} default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:3,FullyLabeledReplicas:3,ObservedGeneration:1,ReadyReplicas:1,AvailableReplicas:1,Conditions:[]ReplicaSetCondition{},},} Jan 26 06:43:03.218: INFO: Pod "test-rolling-update-with-lb-56d9b65d4c-k8ss5" is not available: &Pod{ObjectMeta:{test-rolling-update-with-lb-56d9b65d4c-k8ss5 test-rolling-update-with-lb-56d9b65d4c- deployment-7711 102c606b-96e1-44b4-ad30-91eca65621d5 14720 0 2023-01-26 06:38:02 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:56d9b65d4c] map[] [{apps/v1 ReplicaSet test-rolling-update-with-lb-56d9b65d4c 9b64d913-4489-4731-96d5-43800857d2c7 0xc0018f3017 0xc0018f3018}] [] [{kube-controller-manager Update v1 2023-01-26 06:38:02 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"9b64d913-4489-4731-96d5-43800857d2c7\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-26 06:38:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-7jpgx,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,Command:[],Args:[netexec --http-port=80 --udp-port=80],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-7jpgx,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-078e786f96d20a635,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:&Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},},SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [agnhost],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [agnhost],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.39.26,PodIP:,StartTime:2023-01-26 06:38:02 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 26 06:43:03.218: INFO: Pod "test-rolling-update-with-lb-56d9b65d4c-n5n56" is not available: &Pod{ObjectMeta:{test-rolling-update-with-lb-56d9b65d4c-n5n56 test-rolling-update-with-lb-56d9b65d4c- deployment-7711 48ab44f2-8041-46e7-a6a5-59e841501cee 14719 0 2023-01-26 06:38:02 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:56d9b65d4c] map[] [{apps/v1 ReplicaSet test-rolling-update-with-lb-56d9b65d4c 9b64d913-4489-4731-96d5-43800857d2c7 0xc0018f3217 0xc0018f3218}] [] [{kube-controller-manager Update v1 2023-01-26 06:38:02 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"9b64d913-4489-4731-96d5-43800857d2c7\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-26 06:38:02 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-hvtjr,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,Command:[],Args:[netexec --http-port=80 --udp-port=80],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-hvtjr,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-027758317ed18f24c,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:&Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},},SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [agnhost],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [agnhost],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.53.30,PodIP:,StartTime:2023-01-26 06:38:02 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 26 06:43:03.218: INFO: Pod "test-rolling-update-with-lb-56d9b65d4c-sl4lf" is available: &Pod{ObjectMeta:{test-rolling-update-with-lb-56d9b65d4c-sl4lf test-rolling-update-with-lb-56d9b65d4c- deployment-7711 406470db-0eb3-430c-bec4-b89591531233 15767 0 2023-01-26 06:38:02 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:56d9b65d4c] map[] [{apps/v1 ReplicaSet test-rolling-update-with-lb-56d9b65d4c 9b64d913-4489-4731-96d5-43800857d2c7 0xc0018f3417 0xc0018f3418}] [] [{kube-controller-manager Update v1 2023-01-26 06:38:02 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"9b64d913-4489-4731-96d5-43800857d2c7\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-26 06:39:55 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.43.161\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-t7gf2,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,Command:[],Args:[netexec --http-port=80 --udp-port=80],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-t7gf2,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-03743e1aeef854f6a,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:&Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},},SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:39:55 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:39:55 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-26 06:38:02 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.60.218,PodIP:172.20.43.161,StartTime:2023-01-26 06:38:02 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-26 06:39:54 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,ImageID:registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e,ContainerID:containerd://2d6788556bb87e8ad1000b3fe6355c2ef1472cdbfd6174516d162adb3693935a,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.43.161,},},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment test/e2e/framework/node/init/init.go:32 Jan 26 06:43:03.218: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] Deployment test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-apps] Deployment dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/26/23 06:43:03.326�[0m �[1mSTEP:�[0m Collecting events from namespace "deployment-7711". �[38;5;243m01/26/23 06:43:03.326�[0m �[1mSTEP:�[0m Found 38 events. �[38;5;243m01/26/23 06:43:03.434�[0m Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:02 +0000 UTC - event for test-rolling-update-with-lb: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rolling-update-with-lb-56d9b65d4c to 3 Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:02 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-56d9b65d4c-sl4lf Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:02 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-56d9b65d4c-n5n56 Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:02 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-56d9b65d4c-k8ss5 Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:02 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-k8ss5: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "46162098a4cac7718b4d35685fc30c751bcff215f748f2df17ddbbf0fa14b66c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:02 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-k8ss5: {default-scheduler } Scheduled: Successfully assigned deployment-7711/test-rolling-update-with-lb-56d9b65d4c-k8ss5 to i-078e786f96d20a635 Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:02 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-n5n56: {kubelet i-027758317ed18f24c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "32d46c5828585c79ac921b6d9f4d2928a5409b13502e0a2483cb181336b91f93": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:02 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-n5n56: {default-scheduler } Scheduled: Successfully assigned deployment-7711/test-rolling-update-with-lb-56d9b65d4c-n5n56 to i-027758317ed18f24c Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:02 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {default-scheduler } Scheduled: Successfully assigned deployment-7711/test-rolling-update-with-lb-56d9b65d4c-sl4lf to i-03743e1aeef854f6a Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:03 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4e722a3ddfe017c8f9cd810256d16ec8da0a61e45208d00ec1346a16838b59be": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:14 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-k8ss5: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e0f1835190ccee03037d25f47ad3019343f422efc25c1058cd850d45037f053e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:15 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-n5n56: {kubelet i-027758317ed18f24c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e05204a7e189853752c64e2d517815c07b235cfbb2d11b332700b64a19194618": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:18 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "73c59e62e71513718039ba1417e393d387a2bf33983127f6305fa16676c38c8e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:26 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-n5n56: {kubelet i-027758317ed18f24c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f27fe90c58a88202aa28e0b8d0fa203cbf26b2acc7344efaf18b813028c5834f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:29 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-k8ss5: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c2ca44be62a83baac170d12da2889614358f7682c320b01d18f3fcd331d7fb86": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:32 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "47178b2a20841898a401da177aef578deaf0bfc892ae3180c2e20f5539d353ac": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:39 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-n5n56: {kubelet i-027758317ed18f24c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "989b9a559d45f1f674ad46baa4cc93bcec95229d3ae08cf61d47819328a3fc0d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:44 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-k8ss5: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "957fa44408bae749714d7710c1779e9127dcc313c760c4c2c2563a52a129c8bf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:47 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9550cb0ddabfa58354d617d36ee3ba24f78d426e988fae60078221b0c2878f6f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:53 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-n5n56: {kubelet i-027758317ed18f24c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7aefec777805c97a98014be479e32d0fcc432309013f15eb2607ebb88fa6dd0e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:56 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-k8ss5: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "069e3903c6973f18eae4dce4f683fe76a97548bdbedc695581330ca06a4d05b3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:38:58 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "edbe2cdb0ed0b1fb3778f1dcd9556f738ff312cc35567f30e290560cfb8da68a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:08 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-n5n56: {kubelet i-027758317ed18f24c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a554947ab9cdcc57c539abcd7da4c510ff292bd4e9ef43afe6502b23fe7bf201": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:09 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-k8ss5: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f86aa72a72c0ba46b8d1ea42b50d79ae58dfa5fd41adc5a535c58da2447c8065": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:12 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "74dca6e9ca655826404c014ee399ec2dea1ba180b12bd7ca12b1f9597ed23213": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:20 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-k8ss5: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "106ddd57bebc3428d909c388fa6eb46323d393f7858ae1d3331cdf4ec9e09b3d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:20 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-n5n56: {kubelet i-027758317ed18f24c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a4344034d64927b082686440ae99926613579b1346c06610db651b527ebc0469": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:25 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1f75b4ecbb208b678a805abde7b7351bae774e948614f41973bfec1e5855691a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:34 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-n5n56: {kubelet i-027758317ed18f24c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "381eee5bf6085b7506494f88f45767421778c58e9293a69b426a2abef9c1acb3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:35 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-k8ss5: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e996ed3babff055965bd96c012a58b9c7b0844daa9ed7e56092be19e08615052": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:38 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7ec51c0a89a0027cef3e48106f335ebf10e17009420459cac237c9ac2a5b287e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:48 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-k8ss5: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "74be3426c7fc4740a952fbae61fa0acb4ef3cb5c8a120e216ff0f9394eb51812": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:49 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-n5n56: {kubelet i-027758317ed18f24c} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b367cabb90cae0b49ee899afc7b8511bf43e88a21b9e789cd6d159192d4d49c4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:54 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {kubelet i-03743e1aeef854f6a} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:54 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {kubelet i-03743e1aeef854f6a} Created: Created container agnhost Jan 26 06:43:03.434: INFO: At 2023-01-26 06:39:54 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-sl4lf: {kubelet i-03743e1aeef854f6a} Started: Started container agnhost Jan 26 06:43:03.434: INFO: At 2023-01-26 06:40:02 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-n5n56: {kubelet i-027758317ed18f24c} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e4d4167f5b82b8f6aa8353ecc3863e5822f7cb4336023a58442fd5a6157aae01": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.434: INFO: At 2023-01-26 06:40:03 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-k8ss5: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "42cb9c33cb46674a9d9493ebe5640fc84dd293f1b37a83141dc6e4c22dfbb2f3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:03.541: INFO: POD NODE PHASE GRACE CONDITIONS Jan 26 06:43:03.541: INFO: test-rolling-update-with-lb-56d9b65d4c-k8ss5 i-078e786f96d20a635 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:38:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:38:02 +0000 UTC ContainersNotReady containers with unready status: [agnhost]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:38:02 +0000 UTC ContainersNotReady containers with unready status: [agnhost]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:38:02 +0000 UTC }] Jan 26 06:43:03.541: INFO: test-rolling-update-with-lb-56d9b65d4c-n5n56 i-027758317ed18f24c Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:38:02 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:38:02 +0000 UTC ContainersNotReady containers with unready status: [agnhost]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:38:02 +0000 UTC ContainersNotReady containers with unready status: [agnhost]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:38:02 +0000 UTC }] Jan 26 06:43:03.541: INFO: test-rolling-update-with-lb-56d9b65d4c-sl4lf i-03743e1aeef854f6a Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:38:02 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:39:55 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:39:55 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:38:02 +0000 UTC }] Jan 26 06:43:03.541: INFO: Jan 26 06:43:03.649: INFO: Unable to fetch deployment-7711/test-rolling-update-with-lb-56d9b65d4c-k8ss5/agnhost logs: the server rejected our request for an unknown reason (get pods test-rolling-update-with-lb-56d9b65d4c-k8ss5) Jan 26 06:43:03.769: INFO: Unable to fetch deployment-7711/test-rolling-update-with-lb-56d9b65d4c-n5n56/agnhost logs: the server rejected our request for an unknown reason (get pods test-rolling-update-with-lb-56d9b65d4c-n5n56) Jan 26 06:43:03.987: INFO: Logging node info for node i-027758317ed18f24c Jan 26 06:43:04.093: INFO: Node Info: &Node{ObjectMeta:{i-027758317ed18f24c 5be4e0bd-951c-4336-b624-4b1e91c486e9 15442 0 2023-01-26 06:28:01 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-027758317ed18f24c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-027758317ed18f24c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.30 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-027758317ed18f24c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:39:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-027758317ed18f24c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.30,},NodeAddress{Type:ExternalIP,Address:54.78.113.195,},NodeAddress{Type:InternalDNS,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-78-113-195.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec217487a4b2df8f6bfdfc14eba9a7c2,SystemUUID:ec217487-a4b2-df8f-6bfd-fc14eba9a7c2,BootID:54603b90-dc3a-4156-9179-27712e5d6040,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 26 06:43:04.094: INFO: Logging kubelet events for node i-027758317ed18f24c Jan 26 06:43:04.203: INFO: Logging pods the kubelet thinks is on node i-027758317ed18f24c Jan 26 06:43:04.424: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4frxr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:04.424: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5nlws started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:04.424: INFO: csi-mockplugin-0 started at 2023-01-26 06:38:10 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:04.424: INFO: Container csi-provisioner ready: false, restart count 0 Jan 26 06:43:04.424: INFO: Container driver-registrar ready: false, restart count 0 Jan 26 06:43:04.424: INFO: Container mock ready: false, restart count 0 Jan 26 06:43:04.424: INFO: coredns-559769c974-wcbx4 started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container coredns ready: true, restart count 0 Jan 26 06:43:04.424: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8h5jw started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:04.424: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-pq6nw started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:04.424: INFO: coredns-autoscaler-7cb5c5b969-n6dbb started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container autoscaler ready: true, restart count 0 Jan 26 06:43:04.424: INFO: test-rolling-update-with-lb-56d9b65d4c-n5n56 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container agnhost ready: false, restart count 0 Jan 26 06:43:04.424: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-p5fw4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:04.424: INFO: cilium-rf9ss started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:43:04.424: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:43:04.424: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-mdbgh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:04.424: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-qlxcz started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:04.424: INFO: pod-disruption-failure-ignore-1-j4jwr started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container c ready: false, restart count 0 Jan 26 06:43:04.424: INFO: hostexec-i-027758317ed18f24c-9cp6h started at 2023-01-26 06:42:56 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container agnhost-container ready: true, restart count 0 Jan 26 06:43:04.424: INFO: local-injector started at <nil> (0+0 container statuses recorded) Jan 26 06:43:04.424: INFO: ebs-csi-node-ltj76 started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:04.424: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:04.424: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:04.424: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:04.424: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-2ln5x started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:04.424: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4kttc started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:04.424: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-rs2m5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:04.424: INFO: pod-disruption-failure-ignore-0-j8pfd started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container c ready: false, restart count 0 Jan 26 06:43:04.424: INFO: netserver-0 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:04.424: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:04.815: INFO: Latency metrics for node i-027758317ed18f24c Jan 26 06:43:04.815: INFO: Logging node info for node i-03743e1aeef854f6a Jan 26 06:43:04.922: INFO: Node Info: &Node{ObjectMeta:{i-03743e1aeef854f6a 24dc0f81-a5a8-4cc2-b4c4-d349428290df 14959 0 2023-01-26 06:28:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03743e1aeef854f6a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-03743e1aeef854f6a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.218 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03743e1aeef854f6a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-03743e1aeef854f6a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.218,},NodeAddress{Type:ExternalIP,Address:34.242.210.172,},NodeAddress{Type:InternalDNS,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-242-210-172.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20e9e6999a79b936afeaa0b5c2f8d1,SystemUUID:ec20e9e6-999a-79b9-36af-eaa0b5c2f8d1,BootID:78a5ef12-71ee-45de-9a4e-511ab894624a,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1,DevicePath:,},},Config:nil,},} Jan 26 06:43:04.922: INFO: Logging kubelet events for node i-03743e1aeef854f6a Jan 26 06:43:05.032: INFO: Logging pods the kubelet thinks is on node i-03743e1aeef854f6a Jan 26 06:43:05.279: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-w7dtm started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:05.279: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9ncf5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:05.279: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9rzll started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:05.279: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c966n started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:05.279: INFO: netserver-1 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:05.279: INFO: affinity-nodeport-transition-hk5f5 started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Jan 26 06:43:05.279: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-64l9m started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:05.279: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-gg2n2 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:05.279: INFO: alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab ready: false, restart count 0 Jan 26 06:43:05.279: INFO: hostpath-symlink-prep-provisioning-3964 started at 2023-01-26 06:42:54 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container init-volume-provisioning-3964 ready: false, restart count 0 Jan 26 06:43:05.279: INFO: downwardapi-volume-a4ec348e-9be9-4f89-accc-454ea9b384f2 started at 2023-01-26 06:38:14 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container client-container ready: false, restart count 0 Jan 26 06:43:05.279: INFO: pod-1 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container donothing ready: false, restart count 0 Jan 26 06:43:05.279: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-fwv5h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:05.279: INFO: busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 started at 2023-01-26 06:38:51 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container busybox ready: false, restart count 0 Jan 26 06:43:05.279: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4x2rf started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:05.279: INFO: pod-test started at 2023-01-26 06:42:59 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container pod-test ready: false, restart count 0 Jan 26 06:43:05.279: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-k7vkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:05.279: INFO: pod-subpath-test-preprovisionedpv-bfzt started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container test-container-subpath-preprovisionedpv-bfzt ready: false, restart count 0 Jan 26 06:43:05.279: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bjg5g started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:05.279: INFO: cilium-h8sgv started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:43:05.279: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:43:05.279: INFO: ss-1 started at 2023-01-26 06:37:47 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:05.279: INFO: explicit-nonroot-uid started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container explicit-nonroot-uid ready: false, restart count 0 Jan 26 06:43:05.279: INFO: ebs-csi-node-9p4ds started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:05.279: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:05.279: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:05.279: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:05.279: INFO: test-rolling-update-with-lb-56d9b65d4c-sl4lf started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container agnhost ready: true, restart count 0 Jan 26 06:43:05.279: INFO: hostexec-i-03743e1aeef854f6a-vjpnj started at 2023-01-26 06:38:19 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:05.279: INFO: Container agnhost-container ready: true, restart count 0 Jan 26 06:43:05.747: INFO: Latency metrics for node i-03743e1aeef854f6a Jan 26 06:43:05.747: INFO: Logging node info for node i-078e786f96d20a635 Jan 26 06:43:05.853: INFO: Node Info: &Node{ObjectMeta:{i-078e786f96d20a635 f723e0db-adce-4e86-a6eb-74cd60253348 15626 0 2023-01-26 06:28:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-078e786f96d20a635 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-078e786f96d20a635 topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.26 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2478":"i-078e786f96d20a635","ebs.csi.aws.com":"i-078e786f96d20a635"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-26 06:28:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-078e786f96d20a635,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.26,},NodeAddress{Type:ExternalIP,Address:54.77.178.217,},NodeAddress{Type:InternalDNS,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-77-178-217.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24661a036d7f8fb4e32b792d7b9eff,SystemUUID:ec24661a-036d-7f8f-b4e3-2b792d7b9eff,BootID:ea35d483-6a83-4e50-8ffa-20c56aa45bf3,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8 kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8,DevicePath:,},},Config:nil,},} Jan 26 06:43:05.854: INFO: Logging kubelet events for node i-078e786f96d20a635 Jan 26 06:43:05.965: INFO: Logging pods the kubelet thinks is on node i-078e786f96d20a635 Jan 26 06:43:06.081: INFO: netserver-2 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:06.081: INFO: pod-0 started at 2023-01-26 06:36:14 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container donothing ready: true, restart count 0 Jan 26 06:43:06.081: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cl2g5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.081: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-j5qj6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.081: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-zdwkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.081: INFO: affinity-nodeport-transition-gxp6x started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container affinity-nodeport-transition ready: false, restart count 0 Jan 26 06:43:06.081: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b2pzh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.081: INFO: pod-e8f677e8-f25b-4b11-9e72-60c497d771a7 started at 2023-01-26 06:41:58 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container write-pod ready: false, restart count 0 Jan 26 06:43:06.081: INFO: inline-volume-tester-mmz4t started at 2023-01-26 06:39:35 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 26 06:43:06.081: INFO: pod-2 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container donothing ready: false, restart count 0 Jan 26 06:43:06.081: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:36:46 +0000 UTC (0+7 container statuses recorded) Jan 26 06:43:06.081: INFO: Container csi-attacher ready: true, restart count 0 Jan 26 06:43:06.081: INFO: Container csi-provisioner ready: true, restart count 0 Jan 26 06:43:06.081: INFO: Container csi-resizer ready: true, restart count 0 Jan 26 06:43:06.081: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 26 06:43:06.081: INFO: Container hostpath ready: true, restart count 0 Jan 26 06:43:06.081: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:06.081: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:06.081: INFO: var-expansion-8f3d4023-ad0f-4de9-9fca-b5144eba549f started at 2023-01-26 06:38:20 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container dapi-container ready: false, restart count 0 Jan 26 06:43:06.081: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tl4r4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: false, restart count 0 Jan 26 06:43:06.081: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cckkd started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.081: INFO: ebs-csi-node-bm9ks started at 2023-01-26 06:28:04 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:06.081: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:06.081: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:06.081: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:06.081: INFO: cilium-tvcl7 started at 2023-01-26 06:28:04 +0000 UTC (1+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:43:06.081: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:43:06.081: INFO: ss-0 started at 2023-01-26 06:36:05 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container webserver ready: true, restart count 0 Jan 26 06:43:06.081: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c5w9z started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.081: INFO: dns-test-cee2145e-bfbc-4913-ab2f-46bbcbb0c067 started at 2023-01-26 06:38:58 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:06.081: INFO: Container jessie-querier ready: false, restart count 0 Jan 26 06:43:06.081: INFO: Container querier ready: false, restart count 0 Jan 26 06:43:06.081: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:06.081: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bvftr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.081: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-llwt7 started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.081: INFO: test-rolling-update-with-lb-56d9b65d4c-k8ss5 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container agnhost ready: false, restart count 0 Jan 26 06:43:06.081: INFO: pause started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container pause ready: false, restart count 0 Jan 26 06:43:06.081: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-lxcv7 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.081: INFO: inline-volume-tester-sbl7m started at 2023-01-26 06:34:40 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 26 06:43:06.081: INFO: hostexec-i-078e786f96d20a635-kwjjx started at 2023-01-26 06:41:53 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.081: INFO: Container agnhost-container ready: true, restart count 0 Jan 26 06:43:06.595: INFO: Latency metrics for node i-078e786f96d20a635 Jan 26 06:43:06.595: INFO: Logging node info for node i-07dd0af9495bd7a2d Jan 26 06:43:06.702: INFO: Node Info: &Node{ObjectMeta:{i-07dd0af9495bd7a2d db95ce0d-a7e3-4367-b695-1206b36a4ed7 16185 0 2023-01-26 06:28:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07dd0af9495bd7a2d kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-07dd0af9495bd7a2d topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.14 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07dd0af9495bd7a2d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:28:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:41:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-07dd0af9495bd7a2d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.14,},NodeAddress{Type:ExternalIP,Address:34.254.60.108,},NodeAddress{Type:InternalDNS,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-254-60-108.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23d9d9da6c43e1b12d6c6adb2bca5c,SystemUUID:ec23d9d9-da6c-43e1-b12d-6c6adb2bca5c,BootID:8844f0d4-74db-4ceb-94f5-285e3dcef78b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 26 06:43:06.702: INFO: Logging kubelet events for node i-07dd0af9495bd7a2d Jan 26 06:43:06.812: INFO: Logging pods the kubelet thinks is on node i-07dd0af9495bd7a2d Jan 26 06:43:06.925: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8jm8h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.925: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-kmrs9 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.925: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5dbcr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.925: INFO: coredns-559769c974-hxkxl started at 2023-01-26 06:28:36 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container coredns ready: true, restart count 0 Jan 26 06:43:06.925: INFO: affinity-nodeport-transition-b7tng started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Jan 26 06:43:06.925: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:42:01 +0000 UTC (0+7 container statuses recorded) Jan 26 06:43:06.925: INFO: Container csi-attacher ready: false, restart count 0 Jan 26 06:43:06.925: INFO: Container csi-provisioner ready: false, restart count 0 Jan 26 06:43:06.925: INFO: Container csi-resizer ready: false, restart count 0 Jan 26 06:43:06.925: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 26 06:43:06.925: INFO: Container hostpath ready: false, restart count 0 Jan 26 06:43:06.925: INFO: Container liveness-probe ready: false, restart count 0 Jan 26 06:43:06.925: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 26 06:43:06.925: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-47vr6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.925: INFO: ebs-csi-node-vsjqn started at 2023-01-26 06:28:03 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:06.925: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:06.925: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:06.925: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:06.925: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tt42n started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.925: INFO: httpd started at 2023-01-26 06:39:40 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container httpd ready: false, restart count 0 Jan 26 06:43:06.925: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-56mcl started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.925: INFO: hostpath-symlink-prep-provisioning-3425 started at 2023-01-26 06:38:58 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container init-volume-provisioning-3425 ready: false, restart count 0 Jan 26 06:43:06.925: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b4l5j started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.925: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-v96fn started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.925: INFO: netserver-3 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:06.925: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-6prmp started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:06.925: INFO: cilium-w5n9v started at 2023-01-26 06:28:03 +0000 UTC (1+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:43:06.925: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:43:06.925: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bzv56 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:06.925: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:07.321: INFO: Latency metrics for node i-07dd0af9495bd7a2d Jan 26 06:43:07.321: INFO: Logging node info for node i-089a9e95df3068b0a Jan 26 06:43:07.427: INFO: Node Info: &Node{ObjectMeta:{i-089a9e95df3068b0a 35816ce0-3668-4f6e-a8fd-15fd2906316c 15227 0 2023-01-26 06:25:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089a9e95df3068b0a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089a9e95df3068b0a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:25:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-26 06:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:27:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-26 06:38:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-089a9e95df3068b0a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:27:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.54,},NodeAddress{Type:ExternalIP,Address:18.203.178.61,},NodeAddress{Type:InternalDNS,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-203-178-61.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec270b473b916bebdc318bfa0f9b1a87,SystemUUID:ec270b47-3b91-6beb-dc31-8bfa0f9b1a87,BootID:b319d8a4-ba87-403c-8d6a-5778dcb9a28c,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:63920476,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:44339051,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841311,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965809,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 26 06:43:07.427: INFO: Logging kubelet events for node i-089a9e95df3068b0a Jan 26 06:43:07.542: INFO: Logging pods the kubelet thinks is on node i-089a9e95df3068b0a Jan 26 06:43:07.655: INFO: cilium-8rnxh started at 2023-01-26 06:26:49 +0000 UTC (1+1 container statuses recorded) Jan 26 06:43:07.655: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:43:07.655: INFO: ebs-csi-node-62mcc started at 2023-01-26 06:26:49 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:07.655: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:07.655: INFO: dns-controller-69987775c6-9h2dj started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:07.655: INFO: Container dns-controller ready: true, restart count 0 Jan 26 06:43:07.655: INFO: etcd-manager-events-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded) Jan 26 06:43:07.655: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Container etcd-manager ready: true, restart count 0 Jan 26 06:43:07.655: INFO: kube-apiserver-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+2 container statuses recorded) Jan 26 06:43:07.655: INFO: Container healthcheck ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Container kube-apiserver ready: true, restart count 2 Jan 26 06:43:07.655: INFO: kube-scheduler-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:07.655: INFO: Container kube-scheduler ready: true, restart count 0 Jan 26 06:43:07.655: INFO: aws-cloud-controller-manager-xz4hv started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:07.655: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 26 06:43:07.655: INFO: cilium-operator-5dd44dc49f-2h9f5 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:07.655: INFO: Container cilium-operator ready: true, restart count 0 Jan 26 06:43:07.655: INFO: ebs-csi-controller-5bd98b456f-zpvmp started at 2023-01-26 06:26:49 +0000 UTC (0+5 container statuses recorded) Jan 26 06:43:07.655: INFO: Container csi-attacher ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Container csi-provisioner ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Container csi-resizer ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:07.655: INFO: etcd-manager-main-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded) Jan 26 06:43:07.655: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Jan 26 06:43:07.655: INFO: Container etcd-manager ready: true, restart count 0 Jan 26 06:43:07.655: INFO: kube-controller-manager-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:07.655: INFO: Container kube-controller-manager ready: true, restart count 4 Jan 26 06:43:07.655: INFO: kops-controller-nkbt7 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:07.655: INFO: Container kops-controller ready: true, restart count 0 Jan 26 06:43:08.040: INFO: Latency metrics for node i-089a9e95df3068b0a [DeferCleanup (Each)] [sig-apps] Deployment tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "deployment-7711" for this suite. �[38;5;243m01/26/23 06:43:08.04�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sReplicationController\sshould\stest\sthe\slifecycle\sof\sa\sReplicationController\s\[Conformance\]$'
test/e2e/apps/rc.go:189
k8s.io/kubernetes/test/e2e/apps.glob..func8.7.1(0xc0005eb520?)
test/e2e/apps/rc.go:189 +0x49d
k8s.io/kubernetes/test/e2e/framework.WatchEventSequenceVerifier({0x7fe5ba8?, 0xc00012a008}, {0x7fb1880?, _}, {{0x0, 0x0}, {0x75b9f5c, 0x2}, {0x7614288, 0x16}}, ...)
test/e2e/framework/util.go:721 +0x575
k8s.io/kubernetes/test/e2e/apps.glob..func8.7()
test/e2e/apps/rc.go:148 +0x753
[BeforeEach] [sig-apps] ReplicationController
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/26/23 06:37:53.462�[0m
Jan 26 06:37:53.462: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename replication-controller �[38;5;243m01/26/23 06:37:53.463�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/26/23 06:37:53.785�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/26/23 06:37:53.996�[0m
[BeforeEach] [sig-apps] ReplicationController
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] ReplicationController
test/e2e/apps/rc.go:57
[It] should test the lifecycle of a ReplicationController [Conformance]
test/e2e/apps/rc.go:110
�[1mSTEP:�[0m creating a ReplicationController �[38;5;243m01/26/23 06:37:54.314�[0m
�[1mSTEP:�[0m waiting for RC to be added �[38;5;243m01/26/23 06:37:54.428�[0m
�[1mSTEP:�[0m waiting for available Replicas �[38;5;243m01/26/23 06:37:54.429�[0m
Jan 26 06:42:54.430: INFO: Unexpected error: Wait for condition with watch events should not return an error:
<*errors.errorString | 0xc0001c39a0>: {
s: "timed out waiting for the condition",
}
Jan 26 06:42:54.430: FAIL: Wait for condition with watch events should not return an error: timed out waiting for the condition
Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.glob..func8.7.1(0xc0005eb520?)
test/e2e/apps/rc.go:189 +0x49d
k8s.io/kubernetes/test/e2e/framework.WatchEventSequenceVerifier({0x7fe5ba8?, 0xc00012a008}, {0x7fb1880?, _}, {{0x0, 0x0}, {0x75b9f5c, 0x2}, {0x7614288, 0x16}}, ...)
test/e2e/framework/util.go:721 +0x575
k8s.io/kubernetes/test/e2e/apps.glob..func8.7()
test/e2e/apps/rc.go:148 +0x753
[AfterEach] [sig-apps] ReplicationController
test/e2e/framework/node/init/init.go:32
Jan 26 06:42:54.430: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] ReplicationController
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] ReplicationController
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/26/23 06:42:54.539�[0m
�[1mSTEP:�[0m Collecting events from namespace "replication-controller-1712". �[38;5;243m01/26/23 06:42:54.539�[0m
�[1mSTEP:�[0m Found 12 events. �[38;5;243m01/26/23 06:42:54.645�[0m
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:37:54 +0000 UTC - event for rc-test: {replication-controller } SuccessfulCreate: Created pod: rc-test-f4hc8
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:37:54 +0000 UTC - event for rc-test-f4hc8: {default-scheduler } Scheduled: Successfully assigned replication-controller-1712/rc-test-f4hc8 to i-078e786f96d20a635
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:37:54 +0000 UTC - event for rc-test-f4hc8: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6ce784112cb1d463be71777282d6692cff91325fa19c60bed483cd5d23ca02a0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:38:10 +0000 UTC - event for rc-test-f4hc8: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e369be943bce9f0f3b13bdcb84785a255194860e786391eb1092ac361c7aa7bb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:38:23 +0000 UTC - event for rc-test-f4hc8: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7532cffd00ed28a8211a3fa475a84e10c41f11d0d3ebaefb40f53ec319b49ebb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:38:37 +0000 UTC - event for rc-test-f4hc8: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "551731b2e4e6bb702d7fc98b72dd9430d2af323952fef7b12170f0fb6a30664f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:38:50 +0000 UTC - event for rc-test-f4hc8: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e9bed4e731df99ac4867929ac1e17548c3358572558f1b98eeef73af672577ce": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:39:04 +0000 UTC - event for rc-test-f4hc8: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5b169a92949185c331305117db66b272f6998a19859cf35255158549830d18e3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:39:17 +0000 UTC - event for rc-test-f4hc8: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "62c41f53f2d20e52c2d7cca13867e07f6da71852b9dcf1a8b9bd151f5baef469": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:39:31 +0000 UTC - event for rc-test-f4hc8: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d4e4550d6146fffe21c1952c2e7d1d519af25d259be3de230929aba245e43c3c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:39:46 +0000 UTC - event for rc-test-f4hc8: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "507156929cab0b8740b899826f83f6225c11a4ca44610ecece1eb72f8d6f6b3f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:54.645: INFO: At 2023-01-26 06:39:57 +0000 UTC - event for rc-test-f4hc8: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a8cd330d4429e3f67bcbe9f58e471e28da1d001aac0b4b48d460b5b61c154af7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:54.751: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 26 06:42:54.751: INFO: rc-test-f4hc8 i-078e786f96d20a635 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:54 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:54 +0000 UTC ContainersNotReady containers with unready status: [rc-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:54 +0000 UTC ContainersNotReady containers with unready status: [rc-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:54 +0000 UTC }]
Jan 26 06:42:54.751: INFO:
Jan 26 06:42:54.859: INFO: Unable to fetch replication-controller-1712/rc-test-f4hc8/rc-test logs: the server rejected our request for an unknown reason (get pods rc-test-f4hc8)
Jan 26 06:42:54.966: INFO:
Logging node info for node i-027758317ed18f24c
Jan 26 06:42:55.072: INFO: Node Info: &Node{ObjectMeta:{i-027758317ed18f24c 5be4e0bd-951c-4336-b624-4b1e91c486e9 15442 0 2023-01-26 06:28:01 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-027758317ed18f24c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-027758317ed18f24c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.30 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-027758317ed18f24c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:39:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-027758317ed18f24c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.30,},NodeAddress{Type:ExternalIP,Address:54.78.113.195,},NodeAddress{Type:InternalDNS,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-78-113-195.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec217487a4b2df8f6bfdfc14eba9a7c2,SystemUUID:ec217487-a4b2-df8f-6bfd-fc14eba9a7c2,BootID:54603b90-dc3a-4156-9179-27712e5d6040,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 26 06:42:55.072: INFO:
Logging kubelet events for node i-027758317ed18f24c
Jan 26 06:42:55.181: INFO:
Logging pods the kubelet thinks is on node i-027758317ed18f24c
Jan 26 06:42:55.294: INFO: coredns-autoscaler-7cb5c5b969-n6dbb started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.294: INFO: Container autoscaler ready: true, restart count 0
Jan 26 06:42:55.294: INFO: test-rolling-update-with-lb-56d9b65d4c-n5n56 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.294: INFO: Container agnhost ready: false, restart count 0
Jan 26 06:42:55.294: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-p5fw4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.294: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:55.294: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-mdbgh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.294: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:55.294: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-qlxcz started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.294: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:55.294: INFO: pod-disruption-failure-ignore-1-j4jwr started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.294: INFO: Container c ready: false, restart count 0
Jan 26 06:42:55.294: INFO: cilium-rf9ss started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:42:55.294: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:42:55.294: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:42:55.294: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-2ln5x started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.294: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:55.294: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4kttc started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.294: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:55.294: INFO: ebs-csi-node-ltj76 started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:55.295: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:55.295: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:55.295: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:55.295: INFO: pod-disruption-failure-ignore-0-j8pfd started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.295: INFO: Container c ready: false, restart count 0
Jan 26 06:42:55.295: INFO: netserver-0 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.295: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:55.295: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-rs2m5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.295: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:55.295: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5nlws started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.295: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:55.295: INFO: csi-mockplugin-0 started at 2023-01-26 06:38:10 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:55.295: INFO: Container csi-provisioner ready: false, restart count 0
Jan 26 06:42:55.295: INFO: Container driver-registrar ready: false, restart count 0
Jan 26 06:42:55.295: INFO: Container mock ready: false, restart count 0
Jan 26 06:42:55.295: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4frxr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.295: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:55.295: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8h5jw started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.295: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:55.295: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-pq6nw started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.295: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:55.295: INFO: coredns-559769c974-wcbx4 started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:55.295: INFO: Container coredns ready: true, restart count 0
Jan 26 06:42:55.712: INFO:
Latency metrics for node i-027758317ed18f24c
Jan 26 06:42:55.712: INFO:
Logging node info for node i-03743e1aeef854f6a
Jan 26 06:42:55.818: INFO: Node Info: &Node{ObjectMeta:{i-03743e1aeef854f6a 24dc0f81-a5a8-4cc2-b4c4-d349428290df 14959 0 2023-01-26 06:28:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03743e1aeef854f6a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-03743e1aeef854f6a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.218 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03743e1aeef854f6a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-03743e1aeef854f6a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.218,},NodeAddress{Type:ExternalIP,Address:34.242.210.172,},NodeAddress{Type:InternalDNS,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-242-210-172.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20e9e6999a79b936afeaa0b5c2f8d1,SystemUUID:ec20e9e6-999a-79b9-36af-eaa0b5c2f8d1,BootID:78a5ef12-71ee-45de-9a4e-511ab894624a,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1,DevicePath:,},},Config:nil,},}
Jan 26 06:42:55.819: INFO:
Logging kubelet events for node i-03743e1aeef854f6a
Jan 26 06:42:55.928: INFO:
Logging pods the kubelet thinks is on node i-03743e1aeef854f6a
Jan 26 06:42:56.041: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bjg5g started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.041: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4x2rf started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.041: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-k7vkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.041: INFO: pod-subpath-test-preprovisionedpv-bfzt started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container test-container-subpath-preprovisionedpv-bfzt ready: false, restart count 0
Jan 26 06:42:56.041: INFO: ebs-csi-node-9p4ds started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:56.041: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:56.041: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:56.041: INFO: cilium-h8sgv started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:42:56.041: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:42:56.041: INFO: ss-1 started at 2023-01-26 06:37:47 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:56.041: INFO: explicit-nonroot-uid started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container explicit-nonroot-uid ready: false, restart count 0
Jan 26 06:42:56.041: INFO: hostexec-i-03743e1aeef854f6a-vjpnj started at 2023-01-26 06:38:19 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container agnhost-container ready: true, restart count 0
Jan 26 06:42:56.041: INFO: test-rolling-update-with-lb-56d9b65d4c-sl4lf started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container agnhost ready: true, restart count 0
Jan 26 06:42:56.041: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-w7dtm started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.041: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9ncf5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.041: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9rzll started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.041: INFO: affinity-nodeport-transition-hk5f5 started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container affinity-nodeport-transition ready: true, restart count 0
Jan 26 06:42:56.041: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c966n started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.041: INFO: netserver-1 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:56.041: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-64l9m started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.041: INFO: downwardapi-volume-a4ec348e-9be9-4f89-accc-454ea9b384f2 started at 2023-01-26 06:38:14 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container client-container ready: false, restart count 0
Jan 26 06:42:56.041: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-gg2n2 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.041: INFO: alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab ready: false, restart count 0
Jan 26 06:42:56.041: INFO: hostpath-symlink-prep-provisioning-3964 started at 2023-01-26 06:42:54 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container init-volume-provisioning-3964 ready: false, restart count 0
Jan 26 06:42:56.041: INFO: busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 started at 2023-01-26 06:38:51 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container busybox ready: false, restart count 0
Jan 26 06:42:56.041: INFO: pod-1 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container donothing ready: false, restart count 0
Jan 26 06:42:56.041: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-fwv5h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.041: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.492: INFO:
Latency metrics for node i-03743e1aeef854f6a
Jan 26 06:42:56.492: INFO:
Logging node info for node i-078e786f96d20a635
Jan 26 06:42:56.598: INFO: Node Info: &Node{ObjectMeta:{i-078e786f96d20a635 f723e0db-adce-4e86-a6eb-74cd60253348 15626 0 2023-01-26 06:28:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-078e786f96d20a635 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-078e786f96d20a635 topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.26 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2478":"i-078e786f96d20a635","ebs.csi.aws.com":"i-078e786f96d20a635"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-26 06:28:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-078e786f96d20a635,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.26,},NodeAddress{Type:ExternalIP,Address:54.77.178.217,},NodeAddress{Type:InternalDNS,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-77-178-217.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24661a036d7f8fb4e32b792d7b9eff,SystemUUID:ec24661a-036d-7f8f-b4e3-2b792d7b9eff,BootID:ea35d483-6a83-4e50-8ffa-20c56aa45bf3,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8 kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8,DevicePath:,},},Config:nil,},}
Jan 26 06:42:56.599: INFO:
Logging kubelet events for node i-078e786f96d20a635
Jan 26 06:42:56.708: INFO:
Logging pods the kubelet thinks is on node i-078e786f96d20a635
Jan 26 06:42:56.823: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-j5qj6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.823: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-zdwkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.823: INFO: affinity-nodeport-transition-gxp6x started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container affinity-nodeport-transition ready: false, restart count 0
Jan 26 06:42:56.823: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b2pzh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.823: INFO: pod-0 started at 2023-01-26 06:36:14 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container donothing ready: true, restart count 0
Jan 26 06:42:56.823: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cl2g5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.823: INFO: pod-2 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container donothing ready: false, restart count 0
Jan 26 06:42:56.823: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:36:46 +0000 UTC (0+7 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container csi-attacher ready: true, restart count 0
Jan 26 06:42:56.823: INFO: Container csi-provisioner ready: true, restart count 0
Jan 26 06:42:56.823: INFO: Container csi-resizer ready: true, restart count 0
Jan 26 06:42:56.823: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 26 06:42:56.823: INFO: Container hostpath ready: true, restart count 0
Jan 26 06:42:56.823: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:56.823: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:56.823: INFO: pod-e8f677e8-f25b-4b11-9e72-60c497d771a7 started at 2023-01-26 06:41:58 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container write-pod ready: false, restart count 0
Jan 26 06:42:56.823: INFO: inline-volume-tester-mmz4t started at 2023-01-26 06:39:35 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 26 06:42:56.823: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cckkd started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.823: INFO: pfpod started at 2023-01-26 06:37:48 +0000 UTC (0+2 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container portforwardtester ready: false, restart count 0
Jan 26 06:42:56.823: INFO: Container readiness ready: false, restart count 0
Jan 26 06:42:56.823: INFO: var-expansion-8f3d4023-ad0f-4de9-9fca-b5144eba549f started at 2023-01-26 06:38:20 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container dapi-container ready: false, restart count 0
Jan 26 06:42:56.823: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tl4r4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: false, restart count 0
Jan 26 06:42:56.823: INFO: ss-0 started at 2023-01-26 06:36:05 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container webserver ready: true, restart count 0
Jan 26 06:42:56.823: INFO: ebs-csi-node-bm9ks started at 2023-01-26 06:28:04 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:56.823: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:56.823: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:56.823: INFO: cilium-tvcl7 started at 2023-01-26 06:28:04 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:42:56.823: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:42:56.823: INFO: dns-test-cee2145e-bfbc-4913-ab2f-46bbcbb0c067 started at 2023-01-26 06:38:58 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container jessie-querier ready: false, restart count 0
Jan 26 06:42:56.823: INFO: Container querier ready: false, restart count 0
Jan 26 06:42:56.823: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:56.823: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bvftr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.823: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c5w9z started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.823: INFO: test-rollover-controller-nb66n started at 2023-01-26 06:37:48 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container httpd ready: false, restart count 0
Jan 26 06:42:56.823: INFO: pause started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container pause ready: false, restart count 0
Jan 26 06:42:56.823: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-llwt7 started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.823: INFO: test-rolling-update-with-lb-56d9b65d4c-k8ss5 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container agnhost ready: false, restart count 0
Jan 26 06:42:56.823: INFO: inline-volume-tester-sbl7m started at 2023-01-26 06:34:40 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 26 06:42:56.823: INFO: hostexec-i-078e786f96d20a635-kwjjx started at 2023-01-26 06:41:53 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container agnhost-container ready: true, restart count 0
Jan 26 06:42:56.823: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-lxcv7 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:56.823: INFO: rc-test-f4hc8 started at 2023-01-26 06:37:54 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container rc-test ready: false, restart count 0
Jan 26 06:42:56.823: INFO: netserver-2 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:56.823: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:57.397: INFO:
Latency metrics for node i-078e786f96d20a635
Jan 26 06:42:57.397: INFO:
Logging node info for node i-07dd0af9495bd7a2d
Jan 26 06:42:57.504: INFO: Node Info: &Node{ObjectMeta:{i-07dd0af9495bd7a2d db95ce0d-a7e3-4367-b695-1206b36a4ed7 16185 0 2023-01-26 06:28:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07dd0af9495bd7a2d kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-07dd0af9495bd7a2d topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.14 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07dd0af9495bd7a2d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:28:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:41:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-07dd0af9495bd7a2d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.14,},NodeAddress{Type:ExternalIP,Address:34.254.60.108,},NodeAddress{Type:InternalDNS,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-254-60-108.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23d9d9da6c43e1b12d6c6adb2bca5c,SystemUUID:ec23d9d9-da6c-43e1-b12d-6c6adb2bca5c,BootID:8844f0d4-74db-4ceb-94f5-285e3dcef78b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 26 06:42:57.504: INFO:
Logging kubelet events for node i-07dd0af9495bd7a2d
Jan 26 06:42:57.614: INFO:
Logging pods the kubelet thinks is on node i-07dd0af9495bd7a2d
Jan 26 06:42:57.730: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-kmrs9 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:57.730: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:42:01 +0000 UTC (0+7 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container csi-attacher ready: false, restart count 0
Jan 26 06:42:57.730: INFO: Container csi-provisioner ready: false, restart count 0
Jan 26 06:42:57.730: INFO: Container csi-resizer ready: false, restart count 0
Jan 26 06:42:57.730: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 26 06:42:57.730: INFO: Container hostpath ready: false, restart count 0
Jan 26 06:42:57.730: INFO: Container liveness-probe ready: false, restart count 0
Jan 26 06:42:57.730: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 26 06:42:57.730: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5dbcr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:57.730: INFO: coredns-559769c974-hxkxl started at 2023-01-26 06:28:36 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container coredns ready: true, restart count 0
Jan 26 06:42:57.730: INFO: affinity-nodeport-transition-b7tng started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container affinity-nodeport-transition ready: true, restart count 0
Jan 26 06:42:57.730: INFO: httpd started at 2023-01-26 06:39:40 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container httpd ready: false, restart count 0
Jan 26 06:42:57.730: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-47vr6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:57.730: INFO: ebs-csi-node-vsjqn started at 2023-01-26 06:28:03 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:57.730: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:57.730: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:57.730: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tt42n started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:57.730: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-v96fn started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:57.730: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-56mcl started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:57.730: INFO: hostpath-symlink-prep-provisioning-3425 started at 2023-01-26 06:38:58 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container init-volume-provisioning-3425 ready: false, restart count 0
Jan 26 06:42:57.730: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b4l5j started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:57.730: INFO: netserver-3 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:57.730: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-6prmp started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:57.730: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bzv56 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:57.730: INFO: cilium-w5n9v started at 2023-01-26 06:28:03 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:42:57.730: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:42:57.730: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8jm8h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:57.730: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:58.136: INFO:
Latency metrics for node i-07dd0af9495bd7a2d
Jan 26 06:42:58.136: INFO:
Logging node info for node i-089a9e95df3068b0a
Jan 26 06:42:58.243: INFO: Node Info: &Node{ObjectMeta:{i-089a9e95df3068b0a 35816ce0-3668-4f6e-a8fd-15fd2906316c 15227 0 2023-01-26 06:25:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089a9e95df3068b0a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089a9e95df3068b0a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:25:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-26 06:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:27:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-26 06:38:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-089a9e95df3068b0a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:27:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.54,},NodeAddress{Type:ExternalIP,Address:18.203.178.61,},NodeAddress{Type:InternalDNS,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-203-178-61.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec270b473b916bebdc318bfa0f9b1a87,SystemUUID:ec270b47-3b91-6beb-dc31-8bfa0f9b1a87,BootID:b319d8a4-ba87-403c-8d6a-5778dcb9a28c,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:63920476,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:44339051,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841311,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965809,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 26 06:42:58.243: INFO:
Logging kubelet events for node i-089a9e95df3068b0a
Jan 26 06:42:58.356: INFO:
Logging pods the kubelet thinks is on node i-089a9e95df3068b0a
Jan 26 06:42:58.469: INFO: ebs-csi-controller-5bd98b456f-zpvmp started at 2023-01-26 06:26:49 +0000 UTC (0+5 container statuses recorded)
Jan 26 06:42:58.469: INFO: Container csi-attacher ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Container csi-provisioner ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Container csi-resizer ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:58.469: INFO: etcd-manager-main-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded)
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Container etcd-manager ready: true, restart count 0
Jan 26 06:42:58.469: INFO: kube-controller-manager-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:58.469: INFO: Container kube-controller-manager ready: true, restart count 4
Jan 26 06:42:58.469: INFO: kops-controller-nkbt7 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:58.469: INFO: Container kops-controller ready: true, restart count 0
Jan 26 06:42:58.469: INFO: aws-cloud-controller-manager-xz4hv started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:58.469: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 26 06:42:58.469: INFO: cilium-operator-5dd44dc49f-2h9f5 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:58.469: INFO: Container cilium-operator ready: true, restart count 0
Jan 26 06:42:58.469: INFO: dns-controller-69987775c6-9h2dj started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:58.469: INFO: Container dns-controller ready: true, restart count 0
Jan 26 06:42:58.469: INFO: etcd-manager-events-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded)
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Container etcd-manager ready: true, restart count 0
Jan 26 06:42:58.469: INFO: kube-apiserver-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+2 container statuses recorded)
Jan 26 06:42:58.469: INFO: Container healthcheck ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Container kube-apiserver ready: true, restart count 2
Jan 26 06:42:58.469: INFO: kube-scheduler-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:58.469: INFO: Container kube-scheduler ready: true, restart count 0
Jan 26 06:42:58.469: INFO: cilium-8rnxh started at 2023-01-26 06:26:49 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:42:58.469: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:42:58.469: INFO: ebs-csi-node-62mcc started at 2023-01-26 06:26:49 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:58.469: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:58.469: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:58.852: INFO:
Latency metrics for node i-089a9e95df3068b0a
[DeferCleanup (Each)] [sig-apps] ReplicationController
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "replication-controller-1712" for this suite. �[38;5;243m01/26/23 06:42:58.852�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sPort\sforwarding\sWith\sa\sserver\slistening\son\slocalhost\sshould\ssupport\sforwarding\sover\swebsockets$'
test/e2e/kubectl/portforward.go:372
k8s.io/kubernetes/test/e2e/kubectl.doTestOverWebSockets({0x75cb648, 0x9}, 0xc000d584b0)
test/e2e/kubectl/portforward.go:372 +0x2af
k8s.io/kubernetes/test/e2e/kubectl.glob..func2.2.3()
test/e2e/kubectl/portforward.go:493 +0x29
[BeforeEach] [sig-cli] Kubectl Port forwarding
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/26/23 06:37:48.109�[0m
Jan 26 06:37:48.109: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename port-forwarding �[38;5;243m01/26/23 06:37:48.11�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/26/23 06:37:48.435�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/26/23 06:37:48.649�[0m
[BeforeEach] [sig-cli] Kubectl Port forwarding
test/e2e/framework/metrics/init/init.go:31
[It] should support forwarding over websockets
test/e2e/kubectl/portforward.go:492
Jan 26 06:37:48.863: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Creating the pod �[38;5;243m01/26/23 06:37:48.864�[0m
Jan 26 06:37:48.975: INFO: Waiting up to 5m0s for pod "pfpod" in namespace "port-forwarding-3052" to be "running and ready"
Jan 26 06:37:49.083: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 107.697079ms
Jan 26 06:37:49.083: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:37:51.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2.216067847s
Jan 26 06:37:51.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:37:53.193: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4.217689644s
Jan 26 06:37:53.193: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:37:55.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 6.216459349s
Jan 26 06:37:55.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:37:57.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 8.216297031s
Jan 26 06:37:57.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:37:59.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 10.216145965s
Jan 26 06:37:59.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:01.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 12.216096011s
Jan 26 06:38:01.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:03.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 14.216425704s
Jan 26 06:38:03.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:05.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 16.215954068s
Jan 26 06:38:05.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:07.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 18.216246938s
Jan 26 06:38:07.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:09.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 20.216200771s
Jan 26 06:38:09.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:11.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 22.216311669s
Jan 26 06:38:11.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:13.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 24.217022524s
Jan 26 06:38:13.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:15.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 26.215663405s
Jan 26 06:38:15.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:17.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 28.215678006s
Jan 26 06:38:17.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:19.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 30.216276489s
Jan 26 06:38:19.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:21.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 32.216427359s
Jan 26 06:38:21.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:23.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 34.216137018s
Jan 26 06:38:23.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:25.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 36.216887785s
Jan 26 06:38:25.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:27.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 38.215936349s
Jan 26 06:38:27.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:29.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 40.21636748s
Jan 26 06:38:29.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:31.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 42.216418599s
Jan 26 06:38:31.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:33.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 44.217167205s
Jan 26 06:38:33.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:35.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 46.216308116s
Jan 26 06:38:35.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:37.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 48.21582541s
Jan 26 06:38:37.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:39.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 50.216134967s
Jan 26 06:38:39.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:41.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 52.216514009s
Jan 26 06:38:41.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:43.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 54.216582652s
Jan 26 06:38:43.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:45.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 56.216066554s
Jan 26 06:38:45.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:47.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 58.216126358s
Jan 26 06:38:47.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:49.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.216586463s
Jan 26 06:38:49.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:51.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.216086423s
Jan 26 06:38:51.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:53.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.217007162s
Jan 26 06:38:53.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:55.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.216706448s
Jan 26 06:38:55.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:57.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.215764328s
Jan 26 06:38:57.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:38:59.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.216358935s
Jan 26 06:38:59.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:01.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.216066459s
Jan 26 06:39:01.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:03.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.216497202s
Jan 26 06:39:03.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:05.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.216384091s
Jan 26 06:39:05.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:07.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.216512166s
Jan 26 06:39:07.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:09.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.216296215s
Jan 26 06:39:09.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:11.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.216443154s
Jan 26 06:39:11.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:13.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.216585812s
Jan 26 06:39:13.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:15.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.216439547s
Jan 26 06:39:15.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:17.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.216457197s
Jan 26 06:39:17.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:19.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.215778373s
Jan 26 06:39:19.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:21.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.216322303s
Jan 26 06:39:21.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:23.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.2157555s
Jan 26 06:39:23.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:25.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.216404092s
Jan 26 06:39:25.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:27.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.21621894s
Jan 26 06:39:27.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:29.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.216419683s
Jan 26 06:39:29.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:31.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.215955704s
Jan 26 06:39:31.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:33.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.21609702s
Jan 26 06:39:33.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:35.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.216576378s
Jan 26 06:39:35.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:37.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.216212184s
Jan 26 06:39:37.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:39.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.216285332s
Jan 26 06:39:39.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:41.193: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.217444838s
Jan 26 06:39:41.193: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:43.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.216463625s
Jan 26 06:39:43.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:45.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.216600217s
Jan 26 06:39:45.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:47.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.216202965s
Jan 26 06:39:47.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:49.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.217181543s
Jan 26 06:39:49.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:51.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.216842619s
Jan 26 06:39:51.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:53.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.216630831s
Jan 26 06:39:53.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:55.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.216494435s
Jan 26 06:39:55.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:57.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.216691977s
Jan 26 06:39:57.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:39:59.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.215983525s
Jan 26 06:39:59.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:01.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.216555827s
Jan 26 06:40:01.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:03.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.215462771s
Jan 26 06:40:03.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:05.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.216398575s
Jan 26 06:40:05.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:07.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.215910859s
Jan 26 06:40:07.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:09.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.216756258s
Jan 26 06:40:09.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:11.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.216174425s
Jan 26 06:40:11.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:13.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.21641379s
Jan 26 06:40:13.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:15.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.216576733s
Jan 26 06:40:15.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:17.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.216449942s
Jan 26 06:40:17.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:19.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.216460441s
Jan 26 06:40:19.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:21.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.216268765s
Jan 26 06:40:21.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:23.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.2160743s
Jan 26 06:40:23.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:25.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.216244427s
Jan 26 06:40:25.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:27.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.216329491s
Jan 26 06:40:27.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:29.193: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.21767183s
Jan 26 06:40:29.193: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:31.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.216989391s
Jan 26 06:40:31.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:33.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.216140096s
Jan 26 06:40:33.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:35.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.21652343s
Jan 26 06:40:35.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:37.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.216393536s
Jan 26 06:40:37.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:39.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.216421888s
Jan 26 06:40:39.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:41.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.216468177s
Jan 26 06:40:41.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:43.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.215784555s
Jan 26 06:40:43.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:45.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.216451923s
Jan 26 06:40:45.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:47.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.216091961s
Jan 26 06:40:47.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:49.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.216503433s
Jan 26 06:40:49.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:51.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.216378151s
Jan 26 06:40:51.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:53.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.215704816s
Jan 26 06:40:53.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:55.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.216525797s
Jan 26 06:40:55.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:57.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.216239183s
Jan 26 06:40:57.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:40:59.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.216495696s
Jan 26 06:40:59.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:01.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.216381375s
Jan 26 06:41:01.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:03.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.216474811s
Jan 26 06:41:03.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:05.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.216226958s
Jan 26 06:41:05.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:07.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.216118669s
Jan 26 06:41:07.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:09.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.216190549s
Jan 26 06:41:09.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:11.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.216161777s
Jan 26 06:41:11.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:13.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.216447495s
Jan 26 06:41:13.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:15.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.216566811s
Jan 26 06:41:15.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:17.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.216206094s
Jan 26 06:41:17.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:19.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.216366746s
Jan 26 06:41:19.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:21.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.216847048s
Jan 26 06:41:21.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:23.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.216489696s
Jan 26 06:41:23.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:25.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.216680238s
Jan 26 06:41:25.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:27.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.215917331s
Jan 26 06:41:27.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:29.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.215776705s
Jan 26 06:41:29.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:31.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.216227975s
Jan 26 06:41:31.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:33.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.215728693s
Jan 26 06:41:33.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:35.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.215989917s
Jan 26 06:41:35.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:37.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.215966126s
Jan 26 06:41:37.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:39.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.216085919s
Jan 26 06:41:39.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:41.193: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.217491934s
Jan 26 06:41:41.193: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:43.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.215961831s
Jan 26 06:41:43.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:45.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.21676206s
Jan 26 06:41:45.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:47.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.215892409s
Jan 26 06:41:47.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:49.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.216490611s
Jan 26 06:41:49.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:51.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.216447818s
Jan 26 06:41:51.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:53.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.215761867s
Jan 26 06:41:53.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:55.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.216233377s
Jan 26 06:41:55.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:57.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.216219046s
Jan 26 06:41:57.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:41:59.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.216323796s
Jan 26 06:41:59.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:01.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.216368707s
Jan 26 06:42:01.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:03.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.215843997s
Jan 26 06:42:03.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:05.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.216135217s
Jan 26 06:42:05.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:07.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.216223257s
Jan 26 06:42:07.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:09.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.216273488s
Jan 26 06:42:09.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:11.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.21639616s
Jan 26 06:42:11.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:13.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.21570565s
Jan 26 06:42:13.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:15.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.216160518s
Jan 26 06:42:15.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:17.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.216460768s
Jan 26 06:42:17.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:19.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.215856678s
Jan 26 06:42:19.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:21.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.216479316s
Jan 26 06:42:21.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:23.190: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.215422434s
Jan 26 06:42:23.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:25.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.216040091s
Jan 26 06:42:25.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:27.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.216412441s
Jan 26 06:42:27.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:29.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.215859669s
Jan 26 06:42:29.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:31.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.216343155s
Jan 26 06:42:31.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:33.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.21605039s
Jan 26 06:42:33.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:35.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.215675368s
Jan 26 06:42:35.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:37.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.215907451s
Jan 26 06:42:37.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:39.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.216589638s
Jan 26 06:42:39.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:41.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.216497636s
Jan 26 06:42:41.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:43.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.216281084s
Jan 26 06:42:43.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:45.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.2163102s
Jan 26 06:42:45.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:47.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.216533102s
Jan 26 06:42:47.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:49.191: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.21636938s
Jan 26 06:42:49.191: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:49.299: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.323993146s
Jan 26 06:42:49.299: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 26 06:42:49.299: FAIL: Pod did not start running: timed out while waiting for pod port-forwarding-3052/pfpod to be running and ready
Full Stack Trace
k8s.io/kubernetes/test/e2e/kubectl.doTestOverWebSockets({0x75cb648, 0x9}, 0xc000d584b0)
test/e2e/kubectl/portforward.go:372 +0x2af
k8s.io/kubernetes/test/e2e/kubectl.glob..func2.2.3()
test/e2e/kubectl/portforward.go:493 +0x29
[AfterEach] [sig-cli] Kubectl Port forwarding
test/e2e/framework/node/init/init.go:32
Jan 26 06:42:49.299: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/26/23 06:42:49.409�[0m
�[1mSTEP:�[0m Collecting events from namespace "port-forwarding-3052". �[38;5;243m01/26/23 06:42:49.409�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/26/23 06:42:49.517�[0m
Jan 26 06:42:49.517: INFO: At 2023-01-26 06:37:48 +0000 UTC - event for pfpod: {default-scheduler } Scheduled: Successfully assigned port-forwarding-3052/pfpod to i-078e786f96d20a635
Jan 26 06:42:49.517: INFO: At 2023-01-26 06:37:49 +0000 UTC - event for pfpod: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1c97350060687f88364e7b8a4fb49203bcb44796bafd2888b4ce8531abf4099e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:49.517: INFO: At 2023-01-26 06:38:02 +0000 UTC - event for pfpod: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "021974c717c31533b849e61ae7e43ec01f38d9d3802d0b4221e38da1b8108087": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:49.517: INFO: At 2023-01-26 06:38:14 +0000 UTC - event for pfpod: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fc167b89f59614dd8c78858570945342138a4d1e636260dcb5e2229c83a5a49f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:49.517: INFO: At 2023-01-26 06:38:28 +0000 UTC - event for pfpod: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8ef4d9b20a9374cce26fc01b7a727ca6faff0e7a979f6786e44371d5dbabfd12": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:49.517: INFO: At 2023-01-26 06:38:39 +0000 UTC - event for pfpod: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7124e493a9fc791686ebf9d1b9f313d69dbdf3449e0e8d49e365c27c8702ad01": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:49.517: INFO: At 2023-01-26 06:38:50 +0000 UTC - event for pfpod: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f35810ffed6049f77dbbda0544d6cd2fbe9d10d6599a385ab6899dbf3aa5b2d1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:49.517: INFO: At 2023-01-26 06:39:04 +0000 UTC - event for pfpod: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e3cfab6fa48462d60b562e1e7f5791788e26ceec46db5b28e90bc35ff33e9d2f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:49.517: INFO: At 2023-01-26 06:39:16 +0000 UTC - event for pfpod: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5ecef7707fb223e24ab118f93bf19a5c0340e8674fbef2dc99f9f3c16c449723": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:49.517: INFO: At 2023-01-26 06:39:31 +0000 UTC - event for pfpod: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d29170a9d0729a29c156bf89bec3dfbda3d6508c71834088c2f0e5ad2d855443": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:49.517: INFO: At 2023-01-26 06:39:44 +0000 UTC - event for pfpod: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "66fc49632036152c859938c19d115e9517ad73d20f630ae2dcb7532a7c087811": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:42:49.628: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 26 06:42:49.628: INFO: pfpod i-078e786f96d20a635 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:48 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:48 +0000 UTC ContainersNotReady containers with unready status: [readiness portforwardtester]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:48 +0000 UTC ContainersNotReady containers with unready status: [readiness portforwardtester]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:37:48 +0000 UTC }]
Jan 26 06:42:49.628: INFO:
Jan 26 06:42:49.737: INFO: Unable to fetch port-forwarding-3052/pfpod/readiness logs: the server rejected our request for an unknown reason (get pods pfpod)
Jan 26 06:42:49.847: INFO: Unable to fetch port-forwarding-3052/pfpod/portforwardtester logs: the server rejected our request for an unknown reason (get pods pfpod)
Jan 26 06:42:49.955: INFO:
Logging node info for node i-027758317ed18f24c
Jan 26 06:42:50.063: INFO: Node Info: &Node{ObjectMeta:{i-027758317ed18f24c 5be4e0bd-951c-4336-b624-4b1e91c486e9 15442 0 2023-01-26 06:28:01 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-027758317ed18f24c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-027758317ed18f24c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.30 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-027758317ed18f24c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:39:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-027758317ed18f24c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.30,},NodeAddress{Type:ExternalIP,Address:54.78.113.195,},NodeAddress{Type:InternalDNS,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-78-113-195.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec217487a4b2df8f6bfdfc14eba9a7c2,SystemUUID:ec217487-a4b2-df8f-6bfd-fc14eba9a7c2,BootID:54603b90-dc3a-4156-9179-27712e5d6040,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 26 06:42:50.063: INFO:
Logging kubelet events for node i-027758317ed18f24c
Jan 26 06:42:50.174: INFO:
Logging pods the kubelet thinks is on node i-027758317ed18f24c
Jan 26 06:42:50.293: INFO: coredns-autoscaler-7cb5c5b969-n6dbb started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container autoscaler ready: true, restart count 0
Jan 26 06:42:50.293: INFO: test-rolling-update-with-lb-56d9b65d4c-n5n56 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container agnhost ready: false, restart count 0
Jan 26 06:42:50.293: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-p5fw4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:50.293: INFO: cilium-rf9ss started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:42:50.293: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:42:50.293: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-mdbgh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:50.293: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-qlxcz started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:50.293: INFO: pod-disruption-failure-ignore-1-j4jwr started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container c ready: false, restart count 0
Jan 26 06:42:50.293: INFO: ebs-csi-node-ltj76 started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:50.293: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:50.293: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:50.293: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-2ln5x started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:50.293: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4kttc started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:50.293: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-rs2m5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:50.293: INFO: pod-disruption-failure-ignore-0-j8pfd started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container c ready: false, restart count 0
Jan 26 06:42:50.293: INFO: netserver-0 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:50.293: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4frxr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:50.293: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5nlws started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:50.293: INFO: csi-mockplugin-0 started at 2023-01-26 06:38:10 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container csi-provisioner ready: false, restart count 0
Jan 26 06:42:50.293: INFO: Container driver-registrar ready: false, restart count 0
Jan 26 06:42:50.293: INFO: Container mock ready: false, restart count 0
Jan 26 06:42:50.293: INFO: coredns-559769c974-wcbx4 started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container coredns ready: true, restart count 0
Jan 26 06:42:50.293: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8h5jw started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:50.293: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-pq6nw started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:50.293: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:50.728: INFO:
Latency metrics for node i-027758317ed18f24c
Jan 26 06:42:50.728: INFO:
Logging node info for node i-03743e1aeef854f6a
Jan 26 06:42:50.835: INFO: Node Info: &Node{ObjectMeta:{i-03743e1aeef854f6a 24dc0f81-a5a8-4cc2-b4c4-d349428290df 14959 0 2023-01-26 06:28:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03743e1aeef854f6a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-03743e1aeef854f6a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.218 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03743e1aeef854f6a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-03743e1aeef854f6a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.218,},NodeAddress{Type:ExternalIP,Address:34.242.210.172,},NodeAddress{Type:InternalDNS,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-242-210-172.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20e9e6999a79b936afeaa0b5c2f8d1,SystemUUID:ec20e9e6-999a-79b9-36af-eaa0b5c2f8d1,BootID:78a5ef12-71ee-45de-9a4e-511ab894624a,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1,DevicePath:,},},Config:nil,},}
Jan 26 06:42:50.836: INFO:
Logging kubelet events for node i-03743e1aeef854f6a
Jan 26 06:42:50.946: INFO:
Logging pods the kubelet thinks is on node i-03743e1aeef854f6a
Jan 26 06:42:51.071: INFO: test-rolling-update-with-lb-56d9b65d4c-sl4lf started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container agnhost ready: true, restart count 0
Jan 26 06:42:51.071: INFO: hostexec-i-03743e1aeef854f6a-vjpnj started at 2023-01-26 06:38:19 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container agnhost-container ready: true, restart count 0
Jan 26 06:42:51.071: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-w7dtm started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.071: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9ncf5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.071: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9rzll started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.071: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c966n started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.071: INFO: netserver-1 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:51.071: INFO: affinity-nodeport-transition-hk5f5 started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container affinity-nodeport-transition ready: true, restart count 0
Jan 26 06:42:51.071: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-64l9m started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.071: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-gg2n2 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.071: INFO: alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab ready: false, restart count 0
Jan 26 06:42:51.071: INFO: downwardapi-volume-a4ec348e-9be9-4f89-accc-454ea9b384f2 started at 2023-01-26 06:38:14 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container client-container ready: false, restart count 0
Jan 26 06:42:51.071: INFO: pod-1 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container donothing ready: false, restart count 0
Jan 26 06:42:51.071: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-fwv5h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.071: INFO: busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 started at 2023-01-26 06:38:51 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container busybox ready: false, restart count 0
Jan 26 06:42:51.071: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4x2rf started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.071: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-k7vkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.071: INFO: pod-subpath-test-preprovisionedpv-bfzt started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container test-container-subpath-preprovisionedpv-bfzt ready: false, restart count 0
Jan 26 06:42:51.071: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bjg5g started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.071: INFO: cilium-h8sgv started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:42:51.071: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:42:51.071: INFO: ss-1 started at 2023-01-26 06:37:47 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:51.071: INFO: explicit-nonroot-uid started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container explicit-nonroot-uid ready: false, restart count 0
Jan 26 06:42:51.071: INFO: ebs-csi-node-9p4ds started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:51.071: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:51.071: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:51.071: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:51.476: INFO:
Latency metrics for node i-03743e1aeef854f6a
Jan 26 06:42:51.476: INFO:
Logging node info for node i-078e786f96d20a635
Jan 26 06:42:51.584: INFO: Node Info: &Node{ObjectMeta:{i-078e786f96d20a635 f723e0db-adce-4e86-a6eb-74cd60253348 15626 0 2023-01-26 06:28:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-078e786f96d20a635 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-078e786f96d20a635 topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.26 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2478":"i-078e786f96d20a635","ebs.csi.aws.com":"i-078e786f96d20a635"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-26 06:28:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-078e786f96d20a635,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.26,},NodeAddress{Type:ExternalIP,Address:54.77.178.217,},NodeAddress{Type:InternalDNS,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-77-178-217.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24661a036d7f8fb4e32b792d7b9eff,SystemUUID:ec24661a-036d-7f8f-b4e3-2b792d7b9eff,BootID:ea35d483-6a83-4e50-8ffa-20c56aa45bf3,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8 kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8,DevicePath:,},},Config:nil,},}
Jan 26 06:42:51.584: INFO:
Logging kubelet events for node i-078e786f96d20a635
Jan 26 06:42:51.695: INFO:
Logging pods the kubelet thinks is on node i-078e786f96d20a635
Jan 26 06:42:51.813: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-llwt7 started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.813: INFO: test-rolling-update-with-lb-56d9b65d4c-k8ss5 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container agnhost ready: false, restart count 0
Jan 26 06:42:51.813: INFO: pause started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container pause ready: false, restart count 0
Jan 26 06:42:51.813: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-lxcv7 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.813: INFO: rc-test-f4hc8 started at 2023-01-26 06:37:54 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container rc-test ready: false, restart count 0
Jan 26 06:42:51.813: INFO: inline-volume-tester-sbl7m started at 2023-01-26 06:34:40 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 26 06:42:51.813: INFO: hostexec-i-078e786f96d20a635-kwjjx started at 2023-01-26 06:41:53 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container agnhost-container ready: true, restart count 0
Jan 26 06:42:51.813: INFO: netserver-2 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:51.813: INFO: affinity-nodeport-transition-gxp6x started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container affinity-nodeport-transition ready: false, restart count 0
Jan 26 06:42:51.813: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b2pzh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.813: INFO: pod-0 started at 2023-01-26 06:36:14 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container donothing ready: true, restart count 0
Jan 26 06:42:51.813: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cl2g5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.813: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-j5qj6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.813: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-zdwkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.813: INFO: pod-e8f677e8-f25b-4b11-9e72-60c497d771a7 started at 2023-01-26 06:41:58 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container write-pod ready: false, restart count 0
Jan 26 06:42:51.813: INFO: inline-volume-tester-mmz4t started at 2023-01-26 06:39:35 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 26 06:42:51.813: INFO: pod-2 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container donothing ready: false, restart count 0
Jan 26 06:42:51.813: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:36:46 +0000 UTC (0+7 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container csi-attacher ready: true, restart count 0
Jan 26 06:42:51.813: INFO: Container csi-provisioner ready: true, restart count 0
Jan 26 06:42:51.813: INFO: Container csi-resizer ready: true, restart count 0
Jan 26 06:42:51.813: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 26 06:42:51.813: INFO: Container hostpath ready: true, restart count 0
Jan 26 06:42:51.813: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:51.813: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:51.813: INFO: pfpod started at 2023-01-26 06:37:48 +0000 UTC (0+2 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container portforwardtester ready: false, restart count 0
Jan 26 06:42:51.813: INFO: Container readiness ready: false, restart count 0
Jan 26 06:42:51.813: INFO: var-expansion-8f3d4023-ad0f-4de9-9fca-b5144eba549f started at 2023-01-26 06:38:20 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container dapi-container ready: false, restart count 0
Jan 26 06:42:51.813: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tl4r4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: false, restart count 0
Jan 26 06:42:51.813: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cckkd started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.813: INFO: ebs-csi-node-bm9ks started at 2023-01-26 06:28:04 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:51.813: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:51.813: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:51.813: INFO: cilium-tvcl7 started at 2023-01-26 06:28:04 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:42:51.813: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:42:51.813: INFO: ss-0 started at 2023-01-26 06:36:05 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container webserver ready: true, restart count 0
Jan 26 06:42:51.813: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c5w9z started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:51.813: INFO: test-rollover-controller-nb66n started at 2023-01-26 06:37:48 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container httpd ready: false, restart count 0
Jan 26 06:42:51.813: INFO: dns-test-cee2145e-bfbc-4913-ab2f-46bbcbb0c067 started at 2023-01-26 06:38:58 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container jessie-querier ready: false, restart count 0
Jan 26 06:42:51.813: INFO: Container querier ready: false, restart count 0
Jan 26 06:42:51.813: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:51.813: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bvftr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:51.813: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:52.444: INFO:
Latency metrics for node i-078e786f96d20a635
Jan 26 06:42:52.444: INFO:
Logging node info for node i-07dd0af9495bd7a2d
Jan 26 06:42:52.552: INFO: Node Info: &Node{ObjectMeta:{i-07dd0af9495bd7a2d db95ce0d-a7e3-4367-b695-1206b36a4ed7 16185 0 2023-01-26 06:28:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07dd0af9495bd7a2d kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-07dd0af9495bd7a2d topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.14 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07dd0af9495bd7a2d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:28:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:41:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-07dd0af9495bd7a2d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.14,},NodeAddress{Type:ExternalIP,Address:34.254.60.108,},NodeAddress{Type:InternalDNS,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-254-60-108.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23d9d9da6c43e1b12d6c6adb2bca5c,SystemUUID:ec23d9d9-da6c-43e1-b12d-6c6adb2bca5c,BootID:8844f0d4-74db-4ceb-94f5-285e3dcef78b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 26 06:42:52.552: INFO:
Logging kubelet events for node i-07dd0af9495bd7a2d
Jan 26 06:42:52.663: INFO:
Logging pods the kubelet thinks is on node i-07dd0af9495bd7a2d
Jan 26 06:42:52.779: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-kmrs9 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:52.779: INFO: coredns-559769c974-hxkxl started at 2023-01-26 06:28:36 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container coredns ready: true, restart count 0
Jan 26 06:42:52.779: INFO: affinity-nodeport-transition-b7tng started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container affinity-nodeport-transition ready: true, restart count 0
Jan 26 06:42:52.779: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:42:01 +0000 UTC (0+7 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container csi-attacher ready: false, restart count 0
Jan 26 06:42:52.779: INFO: Container csi-provisioner ready: false, restart count 0
Jan 26 06:42:52.779: INFO: Container csi-resizer ready: false, restart count 0
Jan 26 06:42:52.779: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 26 06:42:52.779: INFO: Container hostpath ready: false, restart count 0
Jan 26 06:42:52.779: INFO: Container liveness-probe ready: false, restart count 0
Jan 26 06:42:52.779: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 26 06:42:52.779: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5dbcr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:52.779: INFO: ebs-csi-node-vsjqn started at 2023-01-26 06:28:03 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:52.779: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:52.779: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:52.779: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tt42n started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:52.779: INFO: httpd started at 2023-01-26 06:39:40 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container httpd ready: false, restart count 0
Jan 26 06:42:52.779: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-47vr6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:52.779: INFO: hostpath-symlink-prep-provisioning-3425 started at 2023-01-26 06:38:58 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container init-volume-provisioning-3425 ready: false, restart count 0
Jan 26 06:42:52.779: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b4l5j started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:52.779: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-v96fn started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:52.779: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-56mcl started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:52.779: INFO: netserver-3 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container webserver ready: false, restart count 0
Jan 26 06:42:52.779: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-6prmp started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:52.779: INFO: cilium-w5n9v started at 2023-01-26 06:28:03 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:42:52.779: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:42:52.779: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bzv56 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:52.779: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8jm8h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:52.779: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:42:53.233: INFO:
Latency metrics for node i-07dd0af9495bd7a2d
Jan 26 06:42:53.233: INFO:
Logging node info for node i-089a9e95df3068b0a
Jan 26 06:42:53.341: INFO: Node Info: &Node{ObjectMeta:{i-089a9e95df3068b0a 35816ce0-3668-4f6e-a8fd-15fd2906316c 15227 0 2023-01-26 06:25:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089a9e95df3068b0a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089a9e95df3068b0a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:25:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-26 06:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:27:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-26 06:38:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-089a9e95df3068b0a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:27:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.54,},NodeAddress{Type:ExternalIP,Address:18.203.178.61,},NodeAddress{Type:InternalDNS,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-203-178-61.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec270b473b916bebdc318bfa0f9b1a87,SystemUUID:ec270b47-3b91-6beb-dc31-8bfa0f9b1a87,BootID:b319d8a4-ba87-403c-8d6a-5778dcb9a28c,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:63920476,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:44339051,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841311,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965809,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 26 06:42:53.341: INFO:
Logging kubelet events for node i-089a9e95df3068b0a
Jan 26 06:42:53.451: INFO:
Logging pods the kubelet thinks is on node i-089a9e95df3068b0a
Jan 26 06:42:53.565: INFO: kube-scheduler-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:53.565: INFO: Container kube-scheduler ready: true, restart count 0
Jan 26 06:42:53.565: INFO: cilium-8rnxh started at 2023-01-26 06:26:49 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:42:53.565: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:42:53.565: INFO: ebs-csi-node-62mcc started at 2023-01-26 06:26:49 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:42:53.565: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:42:53.565: INFO: dns-controller-69987775c6-9h2dj started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:53.565: INFO: Container dns-controller ready: true, restart count 0
Jan 26 06:42:53.565: INFO: etcd-manager-events-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded)
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Container etcd-manager ready: true, restart count 0
Jan 26 06:42:53.565: INFO: kube-apiserver-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+2 container statuses recorded)
Jan 26 06:42:53.565: INFO: Container healthcheck ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Container kube-apiserver ready: true, restart count 2
Jan 26 06:42:53.565: INFO: kops-controller-nkbt7 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:53.565: INFO: Container kops-controller ready: true, restart count 0
Jan 26 06:42:53.565: INFO: aws-cloud-controller-manager-xz4hv started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:53.565: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 26 06:42:53.565: INFO: cilium-operator-5dd44dc49f-2h9f5 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:53.565: INFO: Container cilium-operator ready: true, restart count 0
Jan 26 06:42:53.565: INFO: ebs-csi-controller-5bd98b456f-zpvmp started at 2023-01-26 06:26:49 +0000 UTC (0+5 container statuses recorded)
Jan 26 06:42:53.565: INFO: Container csi-attacher ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Container csi-provisioner ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Container csi-resizer ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:42:53.565: INFO: etcd-manager-main-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded)
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 26 06:42:53.565: INFO: Container etcd-manager ready: true, restart count 0
Jan 26 06:42:53.565: INFO: kube-controller-manager-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:42:53.565: INFO: Container kube-controller-manager ready: true, restart count 4
Jan 26 06:42:53.959: INFO:
Latency metrics for node i-089a9e95df3068b0a
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "port-forwarding-3052" for this suite. �[38;5;243m01/26/23 06:42:53.96�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sConfigMap\sshould\sbe\sconsumable\svia\sthe\senvironment\s\[NodeConformance\]\s\[Conformance\]$'
test/e2e/framework/pod/output/output.go:237
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0x75c5206?, {0x75f7da1?, 0xc003633ed8?}, 0xc001b92d80, 0x0, {0xc003633f08, 0x6, 0x6}, 0x0?)
test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/common/node.glob..func1.2()
test/e2e/common/node/configmap.go:127 +0x92b
[BeforeEach] [sig-node] ConfigMap
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/26/23 06:34:54.354�[0m
Jan 26 06:34:54.354: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename configmap �[38;5;243m01/26/23 06:34:54.355�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/26/23 06:34:54.674�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/26/23 06:34:54.884�[0m
[BeforeEach] [sig-node] ConfigMap
test/e2e/framework/metrics/init/init.go:31
[It] should be consumable via the environment [NodeConformance] [Conformance]
test/e2e/common/node/configmap.go:93
�[1mSTEP:�[0m Creating configMap configmap-689/configmap-test-74fe195e-9872-470e-a898-12d0c8df5542 �[38;5;243m01/26/23 06:34:55.095�[0m
�[1mSTEP:�[0m Creating a pod to test consume configMaps �[38;5;243m01/26/23 06:34:55.204�[0m
Jan 26 06:34:55.315: INFO: Waiting up to 5m0s for pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc" in namespace "configmap-689" to be "Succeeded or Failed"
Jan 26 06:34:55.421: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 105.656478ms
Jan 26 06:34:57.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2.212601146s
Jan 26 06:34:59.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4.212176313s
Jan 26 06:35:01.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 6.212895136s
Jan 26 06:35:03.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 8.212570885s
Jan 26 06:35:05.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 10.21248485s
Jan 26 06:35:07.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 12.211960906s
Jan 26 06:35:09.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 14.212519458s
Jan 26 06:35:11.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 16.211923618s
Jan 26 06:35:13.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 18.212525779s
Jan 26 06:35:15.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 20.211517131s
Jan 26 06:35:17.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 22.212806753s
Jan 26 06:35:19.529: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 24.21423628s
Jan 26 06:35:21.529: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 26.213286391s
Jan 26 06:35:23.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 28.211845079s
Jan 26 06:35:25.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 30.212695019s
Jan 26 06:35:27.530: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 32.214454554s
Jan 26 06:35:29.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 34.212535976s
Jan 26 06:35:31.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 36.212670793s
Jan 26 06:35:33.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 38.212577694s
Jan 26 06:35:35.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 40.212691771s
Jan 26 06:35:37.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 42.212039089s
Jan 26 06:35:39.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 44.21269507s
Jan 26 06:35:41.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 46.212919778s
Jan 26 06:35:43.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 48.212444536s
Jan 26 06:35:45.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 50.212751492s
Jan 26 06:35:47.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 52.212743253s
Jan 26 06:35:49.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 54.212669387s
Jan 26 06:35:51.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 56.21275445s
Jan 26 06:35:53.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 58.212616811s
Jan 26 06:35:55.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.212847264s
Jan 26 06:35:57.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.212670233s
Jan 26 06:35:59.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.212539879s
Jan 26 06:36:01.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.212846706s
Jan 26 06:36:03.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.211904069s
Jan 26 06:36:05.530: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.215221345s
Jan 26 06:36:07.536: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.220693363s
Jan 26 06:36:09.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.213168983s
Jan 26 06:36:11.529: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.213921725s
Jan 26 06:36:13.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.212644503s
Jan 26 06:36:15.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.212533963s
Jan 26 06:36:17.529: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.213974294s
Jan 26 06:36:19.530: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.215025206s
Jan 26 06:36:21.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.212611641s
Jan 26 06:36:23.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.212254104s
Jan 26 06:36:25.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.21268522s
Jan 26 06:36:27.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.212576253s
Jan 26 06:36:29.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.212630382s
Jan 26 06:36:31.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.212757907s
Jan 26 06:36:33.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.212559173s
Jan 26 06:36:35.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.212453956s
Jan 26 06:36:37.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.211819075s
Jan 26 06:36:39.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.212541527s
Jan 26 06:36:41.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.212458913s
Jan 26 06:36:43.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.212623724s
Jan 26 06:36:45.533: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.217326461s
Jan 26 06:36:47.530: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.214909762s
Jan 26 06:36:49.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.212268983s
Jan 26 06:36:51.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.212961621s
Jan 26 06:36:53.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.212514208s
Jan 26 06:36:55.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.212847516s
Jan 26 06:36:57.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.212727604s
Jan 26 06:36:59.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.212773473s
Jan 26 06:37:01.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.212905332s
Jan 26 06:37:03.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.212554373s
Jan 26 06:37:05.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.212605166s
Jan 26 06:37:07.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.21286002s
Jan 26 06:37:09.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.212624021s
Jan 26 06:37:11.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.212774881s
Jan 26 06:37:13.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.212680389s
Jan 26 06:37:15.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.212340762s
Jan 26 06:37:17.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.212624398s
Jan 26 06:37:19.530: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.214932866s
Jan 26 06:37:21.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.212486856s
Jan 26 06:37:23.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.212490368s
Jan 26 06:37:25.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.212657478s
Jan 26 06:37:27.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.212502888s
Jan 26 06:37:29.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.212697134s
Jan 26 06:37:31.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.212977207s
Jan 26 06:37:33.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.212888954s
Jan 26 06:37:35.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.212432441s
Jan 26 06:37:37.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.212673807s
Jan 26 06:37:39.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.212551064s
Jan 26 06:37:41.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.212053647s
Jan 26 06:37:43.529: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.214040862s
Jan 26 06:37:45.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.212758909s
Jan 26 06:37:47.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.212362609s
Jan 26 06:37:49.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.212566695s
Jan 26 06:37:51.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.212902483s
Jan 26 06:37:53.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.212870214s
Jan 26 06:37:55.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.212597017s
Jan 26 06:37:57.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.212525963s
Jan 26 06:37:59.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.212984822s
Jan 26 06:38:01.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.212734958s
Jan 26 06:38:03.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.211899341s
Jan 26 06:38:05.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.212624485s
Jan 26 06:38:07.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.212364114s
Jan 26 06:38:09.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.212586084s
Jan 26 06:38:11.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.212690926s
Jan 26 06:38:13.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.21214617s
Jan 26 06:38:15.529: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.213589422s
Jan 26 06:38:17.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.211830535s
Jan 26 06:38:19.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.212821244s
Jan 26 06:38:21.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.212844927s
Jan 26 06:38:23.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.212507924s
Jan 26 06:38:25.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.212409569s
Jan 26 06:38:27.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.21277406s
Jan 26 06:38:29.531: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.215339493s
Jan 26 06:38:31.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.212673666s
Jan 26 06:38:33.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.212622179s
Jan 26 06:38:35.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.211907215s
Jan 26 06:38:37.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.212950847s
Jan 26 06:38:39.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.212705878s
Jan 26 06:38:41.529: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.214159887s
Jan 26 06:38:43.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.212707083s
Jan 26 06:38:45.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.212784221s
Jan 26 06:38:47.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.212104112s
Jan 26 06:38:49.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.212994559s
Jan 26 06:38:51.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.212395715s
Jan 26 06:38:53.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.212228691s
Jan 26 06:38:55.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.212924465s
Jan 26 06:38:57.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.212638997s
Jan 26 06:38:59.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.212477465s
Jan 26 06:39:01.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.212834103s
Jan 26 06:39:03.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.21279581s
Jan 26 06:39:05.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.212913268s
Jan 26 06:39:07.536: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.22095354s
Jan 26 06:39:09.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.213011413s
Jan 26 06:39:11.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.212673548s
Jan 26 06:39:13.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.212535102s
Jan 26 06:39:15.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.212713812s
Jan 26 06:39:17.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.212603057s
Jan 26 06:39:19.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.212528271s
Jan 26 06:39:21.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.212946934s
Jan 26 06:39:23.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.212744849s
Jan 26 06:39:25.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.212756133s
Jan 26 06:39:27.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.212977466s
Jan 26 06:39:29.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.212549162s
Jan 26 06:39:31.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.212985036s
Jan 26 06:39:33.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.213089359s
Jan 26 06:39:35.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.212608852s
Jan 26 06:39:37.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.212585199s
Jan 26 06:39:39.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.212542649s
Jan 26 06:39:41.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.212600126s
Jan 26 06:39:43.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.212613926s
Jan 26 06:39:45.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.212643466s
Jan 26 06:39:47.537: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.221857011s
Jan 26 06:39:49.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.212517943s
Jan 26 06:39:51.528: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.212904205s
Jan 26 06:39:53.527: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.212052573s
Jan 26 06:39:55.529: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.213298451s
Jan 26 06:39:55.635: INFO: Pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.319418995s
Jan 26 06:39:55.848: INFO: Failed to get logs from node "i-078e786f96d20a635" pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc" container "env-test": the server rejected our request for an unknown reason (get pods pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc)
�[1mSTEP:�[0m delete the pod �[38;5;243m01/26/23 06:39:55.848�[0m
Jan 26 06:39:55.958: INFO: Waiting for pod pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc to disappear
Jan 26 06:39:56.064: INFO: Pod pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc still exists
Jan 26 06:39:58.065: INFO: Waiting for pod pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc to disappear
Jan 26 06:39:58.171: INFO: Pod pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc no longer exists
Jan 26 06:39:58.171: INFO: Unexpected error:
<*errors.errorString | 0xc001845220>: {
s: "expected pod \"pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc\" success: timed out while waiting for pod configmap-689/pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc to be Succeeded or Failed",
}
Jan 26 06:39:58.171: FAIL: expected pod "pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc" success: timed out while waiting for pod configmap-689/pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc to be Succeeded or Failed
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0x75c5206?, {0x75f7da1?, 0xc003633ed8?}, 0xc001b92d80, 0x0, {0xc003633f08, 0x6, 0x6}, 0x0?)
test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/common/node.glob..func1.2()
test/e2e/common/node/configmap.go:127 +0x92b
[AfterEach] [sig-node] ConfigMap
test/e2e/framework/node/init/init.go:32
Jan 26 06:39:58.171: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-node] ConfigMap
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-node] ConfigMap
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/26/23 06:39:58.279�[0m
�[1mSTEP:�[0m Collecting events from namespace "configmap-689". �[38;5;243m01/26/23 06:39:58.279�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/26/23 06:39:58.385�[0m
Jan 26 06:39:58.385: INFO: At 2023-01-26 06:34:55 +0000 UTC - event for pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc: {default-scheduler } Scheduled: Successfully assigned configmap-689/pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc to i-078e786f96d20a635
Jan 26 06:39:58.385: INFO: At 2023-01-26 06:34:56 +0000 UTC - event for pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4b9f95f0683f8841270b20fced29b7f89ef57763b78213e97d0369922a4e55e4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:39:58.385: INFO: At 2023-01-26 06:35:10 +0000 UTC - event for pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dc52e0812fd82fb99ce1830a2db5626a0d83249e234c18897220ba9c4cd3f731": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:39:58.385: INFO: At 2023-01-26 06:35:21 +0000 UTC - event for pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "72618f3a5e2bc13846caaf93f5dc5f2ba6b8ac9ef0d8b37f268cc42c456b6012": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:39:58.385: INFO: At 2023-01-26 06:35:33 +0000 UTC - event for pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "056c4434549dff6a1f0ee9478550cca075221b1d9244420829e86a678572f092": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:39:58.385: INFO: At 2023-01-26 06:35:45 +0000 UTC - event for pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c45f25d82b240f02d0d05fc78521e40c6e1c30ccb239454663aa88a6fdc0f7ab": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:39:58.385: INFO: At 2023-01-26 06:35:56 +0000 UTC - event for pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9178af8039d3359eb0b3891400ae9b731cfe5496d369f00dfb366bdc368149dd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:39:58.385: INFO: At 2023-01-26 06:36:09 +0000 UTC - event for pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "98a6dc37013b09822dd4f52e76bb66691eaa102592c2286fcb6a2849afc96d4a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:39:58.385: INFO: At 2023-01-26 06:36:21 +0000 UTC - event for pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d81db9c77f124e0ed76c3c2ed26b22b24f3af727bfec650956b403e1378b4cb5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:39:58.385: INFO: At 2023-01-26 06:36:35 +0000 UTC - event for pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d882e4dae105ea2b30552dc8ebfdf04c03b5fb53e10ae58013560f079e26f940": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:39:58.385: INFO: At 2023-01-26 06:36:50 +0000 UTC - event for pod-configmaps-3cfb4d9f-4196-4521-9fd6-c710a1cbc6dc: {kubelet i-078e786f96d20a635} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ea072a54b92b36003cdb740eea080994cc97df642afe121d78003021973cc3ca": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 26 06:39:58.491: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 26 06:39:58.491: INFO:
Jan 26 06:39:58.600: INFO:
Logging node info for node i-027758317ed18f24c
Jan 26 06:39:58.708: INFO: Node Info: &Node{ObjectMeta:{i-027758317ed18f24c 5be4e0bd-951c-4336-b624-4b1e91c486e9 15442 0 2023-01-26 06:28:01 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-027758317ed18f24c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-027758317ed18f24c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.30 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-027758317ed18f24c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:39:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-027758317ed18f24c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.30,},NodeAddress{Type:ExternalIP,Address:54.78.113.195,},NodeAddress{Type:InternalDNS,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-78-113-195.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec217487a4b2df8f6bfdfc14eba9a7c2,SystemUUID:ec217487-a4b2-df8f-6bfd-fc14eba9a7c2,BootID:54603b90-dc3a-4156-9179-27712e5d6040,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 26 06:39:58.709: INFO:
Logging kubelet events for node i-027758317ed18f24c
Jan 26 06:39:58.818: INFO:
Logging pods the kubelet thinks is on node i-027758317ed18f24c
Jan 26 06:39:58.932: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-p5fw4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:58.932: INFO: cilium-rf9ss started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:39:58.932: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:39:58.932: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-mdbgh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:58.932: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-qlxcz started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:58.932: INFO: pod-disruption-failure-ignore-1-j4jwr started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container c ready: false, restart count 0
Jan 26 06:39:58.932: INFO: ebs-csi-node-ltj76 started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:39:58.932: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:39:58.932: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:39:58.932: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-2ln5x started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:58.932: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4kttc started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:58.932: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-rs2m5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:58.932: INFO: pod-disruption-failure-ignore-0-j8pfd started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container c ready: false, restart count 0
Jan 26 06:39:58.932: INFO: hostexec-i-027758317ed18f24c-65cf2 started at 2023-01-26 06:35:11 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container agnhost-container ready: true, restart count 0
Jan 26 06:39:58.932: INFO: netserver-0 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container webserver ready: false, restart count 0
Jan 26 06:39:58.932: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4frxr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:58.932: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5nlws started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:58.932: INFO: pod-subpath-test-preprovisionedpv-lk99 started at 2023-01-26 06:35:21 +0000 UTC (0+2 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container test-container-subpath-preprovisionedpv-lk99 ready: false, restart count 0
Jan 26 06:39:58.932: INFO: Container test-container-volume-preprovisionedpv-lk99 ready: false, restart count 0
Jan 26 06:39:58.932: INFO: csi-mockplugin-0 started at 2023-01-26 06:38:10 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container csi-provisioner ready: false, restart count 0
Jan 26 06:39:58.932: INFO: Container driver-registrar ready: false, restart count 0
Jan 26 06:39:58.932: INFO: Container mock ready: false, restart count 0
Jan 26 06:39:58.932: INFO: coredns-559769c974-wcbx4 started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container coredns ready: true, restart count 0
Jan 26 06:39:58.932: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8h5jw started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:58.932: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-pq6nw started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:58.932: INFO: coredns-autoscaler-7cb5c5b969-n6dbb started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container autoscaler ready: true, restart count 0
Jan 26 06:39:58.932: INFO: test-rolling-update-with-lb-56d9b65d4c-n5n56 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:58.932: INFO: Container agnhost ready: false, restart count 0
Jan 26 06:39:59.331: INFO:
Latency metrics for node i-027758317ed18f24c
Jan 26 06:39:59.331: INFO:
Logging node info for node i-03743e1aeef854f6a
Jan 26 06:39:59.437: INFO: Node Info: &Node{ObjectMeta:{i-03743e1aeef854f6a 24dc0f81-a5a8-4cc2-b4c4-d349428290df 14959 0 2023-01-26 06:28:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03743e1aeef854f6a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-03743e1aeef854f6a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.218 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03743e1aeef854f6a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-03743e1aeef854f6a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.218,},NodeAddress{Type:ExternalIP,Address:34.242.210.172,},NodeAddress{Type:InternalDNS,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-242-210-172.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20e9e6999a79b936afeaa0b5c2f8d1,SystemUUID:ec20e9e6-999a-79b9-36af-eaa0b5c2f8d1,BootID:78a5ef12-71ee-45de-9a4e-511ab894624a,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1,DevicePath:,},},Config:nil,},}
Jan 26 06:39:59.438: INFO:
Logging kubelet events for node i-03743e1aeef854f6a
Jan 26 06:39:59.547: INFO:
Logging pods the kubelet thinks is on node i-03743e1aeef854f6a
Jan 26 06:39:59.659: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-64l9m started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.659: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:59.659: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-gg2n2 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.659: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:59.659: INFO: downwardapi-volume-a4ec348e-9be9-4f89-accc-454ea9b384f2 started at 2023-01-26 06:38:14 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.659: INFO: Container client-container ready: false, restart count 0
Jan 26 06:39:59.659: INFO: pod-1 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.659: INFO: Container donothing ready: false, restart count 0
Jan 26 06:39:59.659: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-fwv5h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.659: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:59.659: INFO: busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 started at 2023-01-26 06:38:51 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.659: INFO: Container busybox ready: false, restart count 0
Jan 26 06:39:59.660: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4x2rf started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:59.660: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-k7vkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:59.660: INFO: pod-subpath-test-preprovisionedpv-bfzt started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container test-container-subpath-preprovisionedpv-bfzt ready: false, restart count 0
Jan 26 06:39:59.660: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bjg5g started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:59.660: INFO: cilium-h8sgv started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:39:59.660: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:39:59.660: INFO: ss-1 started at 2023-01-26 06:37:47 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container webserver ready: false, restart count 0
Jan 26 06:39:59.660: INFO: busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a started at 2023-01-26 06:36:51 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a ready: false, restart count 0
Jan 26 06:39:59.660: INFO: explicit-nonroot-uid started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container explicit-nonroot-uid ready: false, restart count 0
Jan 26 06:39:59.660: INFO: ebs-csi-node-9p4ds started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:39:59.660: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:39:59.660: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:39:59.660: INFO: test-rolling-update-with-lb-56d9b65d4c-sl4lf started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container agnhost ready: true, restart count 0
Jan 26 06:39:59.660: INFO: hostexec-i-03743e1aeef854f6a-vjpnj started at 2023-01-26 06:38:19 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container agnhost-container ready: true, restart count 0
Jan 26 06:39:59.660: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-w7dtm started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:59.660: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9ncf5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:59.660: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9rzll started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:59.660: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c966n started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:39:59.660: INFO: netserver-1 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container webserver ready: false, restart count 0
Jan 26 06:39:59.660: INFO: affinity-nodeport-transition-hk5f5 started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:39:59.660: INFO: Container affinity-nodeport-transition ready: true, restart count 0
Jan 26 06:40:00.331: INFO:
Latency metrics for node i-03743e1aeef854f6a
Jan 26 06:40:00.331: INFO:
Logging node info for node i-078e786f96d20a635
Jan 26 06:40:00.438: INFO: Node Info: &Node{ObjectMeta:{i-078e786f96d20a635 f723e0db-adce-4e86-a6eb-74cd60253348 15626 0 2023-01-26 06:28:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-078e786f96d20a635 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-078e786f96d20a635 topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.26 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2478":"i-078e786f96d20a635","ebs.csi.aws.com":"i-078e786f96d20a635"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-26 06:28:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-078e786f96d20a635,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.26,},NodeAddress{Type:ExternalIP,Address:54.77.178.217,},NodeAddress{Type:InternalDNS,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-77-178-217.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24661a036d7f8fb4e32b792d7b9eff,SystemUUID:ec24661a-036d-7f8f-b4e3-2b792d7b9eff,BootID:ea35d483-6a83-4e50-8ffa-20c56aa45bf3,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8 kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8,DevicePath:,},},Config:nil,},}
Jan 26 06:40:00.438: INFO:
Logging kubelet events for node i-078e786f96d20a635
Jan 26 06:40:00.547: INFO:
Logging pods the kubelet thinks is on node i-078e786f96d20a635
Jan 26 06:40:00.662: INFO: var-expansion-8f3d4023-ad0f-4de9-9fca-b5144eba549f started at 2023-01-26 06:38:20 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container dapi-container ready: false, restart count 0
Jan 26 06:40:00.662: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tl4r4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: false, restart count 0
Jan 26 06:40:00.662: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cckkd started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:00.662: INFO: pfpod started at 2023-01-26 06:37:48 +0000 UTC (0+2 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container portforwardtester ready: false, restart count 0
Jan 26 06:40:00.662: INFO: Container readiness ready: false, restart count 0
Jan 26 06:40:00.662: INFO: ebs-csi-node-bm9ks started at 2023-01-26 06:28:04 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:40:00.662: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:40:00.662: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:40:00.662: INFO: cilium-tvcl7 started at 2023-01-26 06:28:04 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:40:00.662: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:40:00.662: INFO: ss-0 started at 2023-01-26 06:36:05 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container webserver ready: true, restart count 0
Jan 26 06:40:00.662: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c5w9z started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:00.662: INFO: test-rollover-controller-nb66n started at 2023-01-26 06:37:48 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container httpd ready: false, restart count 0
Jan 26 06:40:00.662: INFO: dns-test-cee2145e-bfbc-4913-ab2f-46bbcbb0c067 started at 2023-01-26 06:38:58 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container jessie-querier ready: false, restart count 0
Jan 26 06:40:00.662: INFO: Container querier ready: false, restart count 0
Jan 26 06:40:00.662: INFO: Container webserver ready: false, restart count 0
Jan 26 06:40:00.662: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bvftr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:00.662: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-llwt7 started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:00.662: INFO: test-rolling-update-with-lb-56d9b65d4c-k8ss5 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container agnhost ready: false, restart count 0
Jan 26 06:40:00.662: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-lxcv7 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:00.662: INFO: rc-test-f4hc8 started at 2023-01-26 06:37:54 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container rc-test ready: false, restart count 0
Jan 26 06:40:00.662: INFO: inline-volume-tester-sbl7m started at 2023-01-26 06:34:40 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 26 06:40:00.662: INFO: netserver-2 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container webserver ready: false, restart count 0
Jan 26 06:40:00.662: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b2pzh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:00.662: INFO: pod-0 started at 2023-01-26 06:36:14 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container donothing ready: true, restart count 0
Jan 26 06:40:00.662: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cl2g5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:00.662: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-j5qj6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:00.662: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-zdwkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:00.662: INFO: affinity-nodeport-transition-gxp6x started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container affinity-nodeport-transition ready: false, restart count 0
Jan 26 06:40:00.662: INFO: inline-volume-tester-mmz4t started at 2023-01-26 06:39:35 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 26 06:40:00.662: INFO: pod-2 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container donothing ready: false, restart count 0
Jan 26 06:40:00.662: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:36:46 +0000 UTC (0+7 container statuses recorded)
Jan 26 06:40:00.662: INFO: Container csi-attacher ready: true, restart count 0
Jan 26 06:40:00.662: INFO: Container csi-provisioner ready: true, restart count 0
Jan 26 06:40:00.662: INFO: Container csi-resizer ready: true, restart count 0
Jan 26 06:40:00.662: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 26 06:40:00.662: INFO: Container hostpath ready: true, restart count 0
Jan 26 06:40:00.662: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:40:00.662: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:40:01.138: INFO:
Latency metrics for node i-078e786f96d20a635
Jan 26 06:40:01.138: INFO:
Logging node info for node i-07dd0af9495bd7a2d
Jan 26 06:40:01.244: INFO: Node Info: &Node{ObjectMeta:{i-07dd0af9495bd7a2d db95ce0d-a7e3-4367-b695-1206b36a4ed7 13601 0 2023-01-26 06:28:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07dd0af9495bd7a2d kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-07dd0af9495bd7a2d topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.14 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07dd0af9495bd7a2d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:28:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:36:23 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-07dd0af9495bd7a2d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:36:23 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:36:23 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:36:23 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:36:23 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.14,},NodeAddress{Type:ExternalIP,Address:34.254.60.108,},NodeAddress{Type:InternalDNS,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-254-60-108.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23d9d9da6c43e1b12d6c6adb2bca5c,SystemUUID:ec23d9d9-da6c-43e1-b12d-6c6adb2bca5c,BootID:8844f0d4-74db-4ceb-94f5-285e3dcef78b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 26 06:40:01.244: INFO:
Logging kubelet events for node i-07dd0af9495bd7a2d
Jan 26 06:40:01.353: INFO:
Logging pods the kubelet thinks is on node i-07dd0af9495bd7a2d
Jan 26 06:40:01.472: INFO: coredns-559769c974-hxkxl started at 2023-01-26 06:28:36 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container coredns ready: true, restart count 0
Jan 26 06:40:01.472: INFO: affinity-nodeport-transition-b7tng started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container affinity-nodeport-transition ready: true, restart count 0
Jan 26 06:40:01.472: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5dbcr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:01.472: INFO: ebs-csi-node-vsjqn started at 2023-01-26 06:28:03 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:40:01.472: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:40:01.472: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:40:01.472: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tt42n started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:01.472: INFO: httpd started at 2023-01-26 06:39:40 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container httpd ready: false, restart count 0
Jan 26 06:40:01.472: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-47vr6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:01.472: INFO: hostpath-symlink-prep-provisioning-3425 started at 2023-01-26 06:38:58 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container init-volume-provisioning-3425 ready: false, restart count 0
Jan 26 06:40:01.472: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b4l5j started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:01.472: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-v96fn started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:01.472: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-56mcl started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:01.472: INFO: netserver-3 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container webserver ready: false, restart count 0
Jan 26 06:40:01.472: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-6prmp started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:01.472: INFO: cilium-w5n9v started at 2023-01-26 06:28:03 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:40:01.472: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:40:01.472: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bzv56 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:01.472: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8jm8h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:01.472: INFO: concurrent-27911919-nkrmc started at 2023-01-26 06:39:00 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container c ready: false, restart count 0
Jan 26 06:40:01.472: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-kmrs9 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:01.472: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0
Jan 26 06:40:02.216: INFO:
Latency metrics for node i-07dd0af9495bd7a2d
Jan 26 06:40:02.216: INFO:
Logging node info for node i-089a9e95df3068b0a
Jan 26 06:40:02.322: INFO: Node Info: &Node{ObjectMeta:{i-089a9e95df3068b0a 35816ce0-3668-4f6e-a8fd-15fd2906316c 15227 0 2023-01-26 06:25:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089a9e95df3068b0a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089a9e95df3068b0a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:25:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-26 06:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:27:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-26 06:38:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-089a9e95df3068b0a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:27:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.54,},NodeAddress{Type:ExternalIP,Address:18.203.178.61,},NodeAddress{Type:InternalDNS,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-203-178-61.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec270b473b916bebdc318bfa0f9b1a87,SystemUUID:ec270b47-3b91-6beb-dc31-8bfa0f9b1a87,BootID:b319d8a4-ba87-403c-8d6a-5778dcb9a28c,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:63920476,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:44339051,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841311,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965809,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 26 06:40:02.322: INFO:
Logging kubelet events for node i-089a9e95df3068b0a
Jan 26 06:40:02.431: INFO:
Logging pods the kubelet thinks is on node i-089a9e95df3068b0a
Jan 26 06:40:02.549: INFO: etcd-manager-events-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded)
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Container etcd-manager ready: true, restart count 0
Jan 26 06:40:02.549: INFO: kube-apiserver-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+2 container statuses recorded)
Jan 26 06:40:02.549: INFO: Container healthcheck ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Container kube-apiserver ready: true, restart count 2
Jan 26 06:40:02.549: INFO: kube-scheduler-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:02.549: INFO: Container kube-scheduler ready: true, restart count 0
Jan 26 06:40:02.549: INFO: cilium-8rnxh started at 2023-01-26 06:26:49 +0000 UTC (1+1 container statuses recorded)
Jan 26 06:40:02.549: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Container cilium-agent ready: true, restart count 0
Jan 26 06:40:02.549: INFO: ebs-csi-node-62mcc started at 2023-01-26 06:26:49 +0000 UTC (0+3 container statuses recorded)
Jan 26 06:40:02.549: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 26 06:40:02.549: INFO: dns-controller-69987775c6-9h2dj started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:02.549: INFO: Container dns-controller ready: true, restart count 0
Jan 26 06:40:02.549: INFO: etcd-manager-main-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded)
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Container etcd-manager ready: true, restart count 0
Jan 26 06:40:02.549: INFO: kube-controller-manager-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:02.549: INFO: Container kube-controller-manager ready: true, restart count 4
Jan 26 06:40:02.549: INFO: kops-controller-nkbt7 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:02.549: INFO: Container kops-controller ready: true, restart count 0
Jan 26 06:40:02.549: INFO: aws-cloud-controller-manager-xz4hv started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:02.549: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 26 06:40:02.549: INFO: cilium-operator-5dd44dc49f-2h9f5 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded)
Jan 26 06:40:02.549: INFO: Container cilium-operator ready: true, restart count 0
Jan 26 06:40:02.549: INFO: ebs-csi-controller-5bd98b456f-zpvmp started at 2023-01-26 06:26:49 +0000 UTC (0+5 container statuses recorded)
Jan 26 06:40:02.549: INFO: Container csi-attacher ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Container csi-provisioner ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Container csi-resizer ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Container ebs-plugin ready: true, restart count 0
Jan 26 06:40:02.549: INFO: Container liveness-probe ready: true, restart count 0
Jan 26 06:40:02.960: INFO:
Latency metrics for node i-089a9e95df3068b0a
[DeferCleanup (Each)] [sig-node] ConfigMap
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "configmap-689" for this suite. �[38;5;243m01/26/23 06:40:02.96�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sKubelet\swhen\sscheduling\sa\sread\sonly\sbusybox\scontainer\sshould\snot\swrite\sto\sroot\sfilesystem\s\[LinuxOnly\]\s\[NodeConformance\]\s\[Conformance\]$'
test/e2e/framework/pod/pod_client.go:107 k8s.io/kubernetes/test/e2e/framework/pod.(*PodClient).CreateSync(0xc000daa4e0, 0xc002997ec0?) test/e2e/framework/pod/pod_client.go:107 +0x94 k8s.io/kubernetes/test/e2e/common/node.glob..func9.5.1() test/e2e/common/node/kubelet.go:186 +0x213from junit_01.xml
[BeforeEach] [sig-node] Kubelet set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/26/23 06:36:50.296�[0m Jan 26 06:36:50.297: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename kubelet-test �[38;5;243m01/26/23 06:36:50.297�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/26/23 06:36:50.62�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/26/23 06:36:50.833�[0m [BeforeEach] [sig-node] Kubelet test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-node] Kubelet test/e2e/common/node/kubelet.go:41 [It] should not write to root filesystem [LinuxOnly] [NodeConformance] [Conformance] test/e2e/common/node/kubelet.go:184 Jan 26 06:36:51.156: INFO: Waiting up to 5m0s for pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a" in namespace "kubelet-test-1788" to be "running and ready" Jan 26 06:36:51.264: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 107.293524ms Jan 26 06:36:51.264: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:36:53.375: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218789341s Jan 26 06:36:53.375: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:36:55.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4.216323829s Jan 26 06:36:55.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:36:57.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 6.215968027s Jan 26 06:36:57.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:36:59.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 8.215508295s Jan 26 06:36:59.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:01.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 10.215371485s Jan 26 06:37:01.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:03.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 12.215264281s Jan 26 06:37:03.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:05.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 14.215481104s Jan 26 06:37:05.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:07.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 16.216023262s Jan 26 06:37:07.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:09.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 18.215590164s Jan 26 06:37:09.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:11.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 20.214942767s Jan 26 06:37:11.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:13.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 22.215136149s Jan 26 06:37:13.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:15.374: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 24.217402142s Jan 26 06:37:15.374: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:17.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 26.214597404s Jan 26 06:37:17.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:19.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 28.21532376s Jan 26 06:37:19.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:21.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 30.215582198s Jan 26 06:37:21.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:23.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 32.215093023s Jan 26 06:37:23.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:25.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 34.215321406s Jan 26 06:37:25.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:27.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 36.215519225s Jan 26 06:37:27.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:29.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 38.214768168s Jan 26 06:37:29.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:31.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 40.215719647s Jan 26 06:37:31.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:33.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 42.215215276s Jan 26 06:37:33.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:35.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 44.215966607s Jan 26 06:37:35.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:37.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 46.215767592s Jan 26 06:37:37.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:39.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 48.214609699s Jan 26 06:37:39.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:41.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 50.215593969s Jan 26 06:37:41.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:43.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 52.215332468s Jan 26 06:37:43.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:45.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 54.215843203s Jan 26 06:37:45.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:47.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 56.215770055s Jan 26 06:37:47.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:49.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 58.215637018s Jan 26 06:37:49.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:51.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.21693979s Jan 26 06:37:51.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:53.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.215139791s Jan 26 06:37:53.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:55.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.215438637s Jan 26 06:37:55.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:57.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.215699829s Jan 26 06:37:57.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:37:59.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.215747414s Jan 26 06:37:59.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:01.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.214813767s Jan 26 06:38:01.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:03.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.214577691s Jan 26 06:38:03.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:05.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.215204686s Jan 26 06:38:05.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:07.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.215710042s Jan 26 06:38:07.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:09.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.215178539s Jan 26 06:38:09.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:11.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.215639693s Jan 26 06:38:11.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:13.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.215230313s Jan 26 06:38:13.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:15.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.215996462s Jan 26 06:38:15.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:17.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.215573048s Jan 26 06:38:17.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:19.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.216121893s Jan 26 06:38:19.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:21.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.215866542s Jan 26 06:38:21.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:23.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.215480826s Jan 26 06:38:23.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:25.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.215507005s Jan 26 06:38:25.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:27.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.215873543s Jan 26 06:38:27.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:29.374: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.217880809s Jan 26 06:38:29.374: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:31.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.215026773s Jan 26 06:38:31.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:33.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.216056178s Jan 26 06:38:33.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:35.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.21556922s Jan 26 06:38:35.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:37.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.215701097s Jan 26 06:38:37.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:39.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.216371962s Jan 26 06:38:39.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:41.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.215370598s Jan 26 06:38:41.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:43.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.215037909s Jan 26 06:38:43.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:45.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.216067777s Jan 26 06:38:45.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:47.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.215406153s Jan 26 06:38:47.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:49.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.215145298s Jan 26 06:38:49.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:51.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.215783116s Jan 26 06:38:51.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:53.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.215287805s Jan 26 06:38:53.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:55.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.216093706s Jan 26 06:38:55.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:57.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.215629961s Jan 26 06:38:57.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:38:59.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.215643594s Jan 26 06:38:59.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:01.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.215663962s Jan 26 06:39:01.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:03.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.21549897s Jan 26 06:39:03.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:05.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.216025099s Jan 26 06:39:05.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:07.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.215721606s Jan 26 06:39:07.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:09.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.214828583s Jan 26 06:39:09.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:11.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.215785115s Jan 26 06:39:11.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:13.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.216517307s Jan 26 06:39:13.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:15.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.215456995s Jan 26 06:39:15.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:17.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.215442187s Jan 26 06:39:17.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:19.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.214840134s Jan 26 06:39:19.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:21.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.214867511s Jan 26 06:39:21.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:23.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.215350431s Jan 26 06:39:23.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:25.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.215550372s Jan 26 06:39:25.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:27.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.215615965s Jan 26 06:39:27.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:29.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.21486295s Jan 26 06:39:29.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:31.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.215720406s Jan 26 06:39:31.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:33.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.21498792s Jan 26 06:39:33.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:35.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.215327779s Jan 26 06:39:35.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:37.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.214836858s Jan 26 06:39:37.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:39.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.215368921s Jan 26 06:39:39.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:41.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.215645872s Jan 26 06:39:41.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:43.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.215518351s Jan 26 06:39:43.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:45.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.215575129s Jan 26 06:39:45.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:47.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.214755718s Jan 26 06:39:47.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:49.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.214730864s Jan 26 06:39:49.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:51.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.215694494s Jan 26 06:39:51.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:53.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.215004155s Jan 26 06:39:53.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:55.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.215691077s Jan 26 06:39:55.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:57.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.214953146s Jan 26 06:39:57.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:39:59.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.216107232s Jan 26 06:39:59.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:01.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.21525722s Jan 26 06:40:01.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:03.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.21574252s Jan 26 06:40:03.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:05.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.215609395s Jan 26 06:40:05.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:07.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.215666685s Jan 26 06:40:07.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:09.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.215678046s Jan 26 06:40:09.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:11.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.215844004s Jan 26 06:40:11.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:13.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.215181082s Jan 26 06:40:13.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:15.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.215745969s Jan 26 06:40:15.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:17.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.215074007s Jan 26 06:40:17.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:19.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.21579914s Jan 26 06:40:19.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:21.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.215575592s Jan 26 06:40:21.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:23.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.215131106s Jan 26 06:40:23.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:25.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.215338191s Jan 26 06:40:25.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:27.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.215775902s Jan 26 06:40:27.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:29.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.216203905s Jan 26 06:40:29.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:31.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.215037234s Jan 26 06:40:31.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:33.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.215252968s Jan 26 06:40:33.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:35.374: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.217629689s Jan 26 06:40:35.374: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:37.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.214862603s Jan 26 06:40:37.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:39.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.21511564s Jan 26 06:40:39.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:41.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.215300893s Jan 26 06:40:41.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:43.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.215154871s Jan 26 06:40:43.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:45.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.216314942s Jan 26 06:40:45.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:47.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.215168935s Jan 26 06:40:47.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:49.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.214898726s Jan 26 06:40:49.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:51.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.21575302s Jan 26 06:40:51.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:53.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.214984105s Jan 26 06:40:53.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:55.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.214911638s Jan 26 06:40:55.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:57.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.215832848s Jan 26 06:40:57.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:40:59.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.215061702s Jan 26 06:40:59.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:01.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.215164256s Jan 26 06:41:01.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:03.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.215072959s Jan 26 06:41:03.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:05.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.215833937s Jan 26 06:41:05.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:07.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.215770803s Jan 26 06:41:07.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:09.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.215475537s Jan 26 06:41:09.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:11.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.215656423s Jan 26 06:41:11.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:13.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.215201773s Jan 26 06:41:13.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:15.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.215779058s Jan 26 06:41:15.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:17.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.214962687s Jan 26 06:41:17.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:19.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.215590857s Jan 26 06:41:19.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:21.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.21576724s Jan 26 06:41:21.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:23.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.215191969s Jan 26 06:41:23.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:25.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.215720269s Jan 26 06:41:25.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:27.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.21516554s Jan 26 06:41:27.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:29.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.216001144s Jan 26 06:41:29.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:31.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.215413877s Jan 26 06:41:31.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:33.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.215246359s Jan 26 06:41:33.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:35.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.215554904s Jan 26 06:41:35.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:37.373: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.216245822s Jan 26 06:41:37.373: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:39.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.215611819s Jan 26 06:41:39.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:41.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.215858089s Jan 26 06:41:41.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:43.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.215228082s Jan 26 06:41:43.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:45.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.215611956s Jan 26 06:41:45.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:47.371: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.214937883s Jan 26 06:41:47.371: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:49.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.215472914s Jan 26 06:41:49.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:51.372: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.215607076s Jan 26 06:41:51.372: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:51.479: INFO: Pod "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.322784601s Jan 26 06:41:51.479: INFO: The phase of Pod busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a is Pending, waiting for it to be Running (with Ready = true) Jan 26 06:41:51.480: INFO: Unexpected error: <*pod.timeoutError | 0xc00241c390>: { msg: "timed out while waiting for pod kubelet-test-1788/busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a to be running and ready", observedObjects: [ <*v1.Pod | 0xc004d01680>{ TypeMeta: {Kind: "", APIVersion: ""}, ObjectMeta: { Name: "busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a", GenerateName: "", Namespace: "kubelet-test-1788", SelfLink: "", UID: "c52eaace-c934-41b9-9699-b9a2085bd453", ResourceVersion: "13978", Generation: 0, CreationTimestamp: { Time: { wall: 0, ext: 63810311811, loc: { name: "Local", zone: [ {name: "UTC", offset: 0, isDST: false}, ], tx: [ { when: -576460752303423488, index: 0, isstd: false, isutc: false, }, ], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: "UTC", offset: 0, isDST: false}, }, }, }, DeletionTimestamp: nil, DeletionGracePeriodSeconds: nil, Labels: nil, Annotations: nil, OwnerReferences: nil, Finalizers: nil, ManagedFields: [ { Manager: "e2e.test", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63810311811, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:spec\":{\"f:containers\":{\"k:{\\\"name\\\":\\\"busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:securityContext\":{\".\":{},\"f:readOnlyRootFilesystem\":{}},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}", }, Subresource: "", }, { Manager: "kubelet", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63810311811, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}", }, Subresource: "status", }, ], }, Spec: { Volumes: [ { Name: "kube-api-access-ds52s", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, Secret: nil, NFS: nil, ISCSI: nil, Glusterfs: nil, PersistentVolumeClaim: nil, RBD: nil, FlexVolume: nil, Cinder: nil, CephFS: nil, Flocker: nil, DownwardAPI: nil, FC: nil, AzureFile: nil, ConfigMap: nil, VsphereVolume: nil, Quobyte: nil, AzureDisk: nil, PhotonPersistentDisk: nil, Projected: { Sources: [ { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, ], DefaultMode: 420, ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output Jan 26 06:41:51.480: FAIL: timed out while waiting for pod kubelet-test-1788/busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a to be running and ready Full Stack Trace k8s.io/kubernetes/test/e2e/framework/pod.(*PodClient).CreateSync(0xc000daa4e0, 0xc002997ec0?) test/e2e/framework/pod/pod_client.go:107 +0x94 k8s.io/kubernetes/test/e2e/common/node.glob..func9.5.1() test/e2e/common/node/kubelet.go:186 +0x213 [AfterEach] [sig-node] Kubelet test/e2e/framework/node/init/init.go:32 Jan 26 06:41:51.481: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-node] Kubelet test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-node] Kubelet dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/26/23 06:41:51.589�[0m �[1mSTEP:�[0m Collecting events from namespace "kubelet-test-1788". �[38;5;243m01/26/23 06:41:51.589�[0m �[1mSTEP:�[0m Found 11 events. �[38;5;243m01/26/23 06:41:51.696�[0m Jan 26 06:41:51.697: INFO: At 2023-01-26 06:36:51 +0000 UTC - event for busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a: {default-scheduler } Scheduled: Successfully assigned kubelet-test-1788/busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a to i-03743e1aeef854f6a Jan 26 06:41:51.697: INFO: At 2023-01-26 06:36:51 +0000 UTC - event for busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "50a8f214d76032a914dd1ba24c2cb6e6278e3bea5a737db5d7b6524be5ddbd33": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:41:51.697: INFO: At 2023-01-26 06:37:06 +0000 UTC - event for busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "57ff2fd82ef71caba4937993cbe58ecc0a1f7444df763527613a487bd6388167": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:41:51.697: INFO: At 2023-01-26 06:37:21 +0000 UTC - event for busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8206be55825f815be2c6666d86d16762069e69cfe4791675a6d131fdf9045e13": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:41:51.697: INFO: At 2023-01-26 06:37:36 +0000 UTC - event for busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "df7f3ef36b11543d7ca24050faec22cdef33cacc1e55c1027112379b49fdec18": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:41:51.697: INFO: At 2023-01-26 06:37:50 +0000 UTC - event for busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9832297ca82d55b443a6f6c08ef83f3696aa74a2f89adae081b4343329530fc7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:41:51.697: INFO: At 2023-01-26 06:38:02 +0000 UTC - event for busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "77745684e57141b3c3e7997dc550bf65b4fd47ecc313dad89bfb2a12a53b0d21": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:41:51.697: INFO: At 2023-01-26 06:38:15 +0000 UTC - event for busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d07da65614f1a60afeb84d468922ac46cf4c014ce406b23838deed8b865a8f64": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:41:51.697: INFO: At 2023-01-26 06:38:28 +0000 UTC - event for busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cb5ae47dfb348c4234736d3e01838a198af65d92d14b0bb6f5bbfaa316100148": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:41:51.697: INFO: At 2023-01-26 06:38:43 +0000 UTC - event for busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e79c9feb9997efd6e13ebaf91a0970cd2536b58dbaa18b2e826996e9f5165e00": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:41:51.697: INFO: At 2023-01-26 06:38:58 +0000 UTC - event for busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "efb5d184f3f9714f8b6eade3535f26ca706307bee521fc8fd8be24dff5f2657c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:41:51.804: INFO: POD NODE PHASE GRACE CONDITIONS Jan 26 06:41:51.804: INFO: busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a i-03743e1aeef854f6a Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:36:51 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:36:51 +0000 UTC ContainersNotReady containers with unready status: [busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:36:51 +0000 UTC ContainersNotReady containers with unready status: [busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-26 06:36:51 +0000 UTC }] Jan 26 06:41:51.804: INFO: Jan 26 06:41:51.914: INFO: Unable to fetch kubelet-test-1788/busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a/busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a logs: the server rejected our request for an unknown reason (get pods busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a) Jan 26 06:41:52.022: INFO: Logging node info for node i-027758317ed18f24c Jan 26 06:41:52.129: INFO: Node Info: &Node{ObjectMeta:{i-027758317ed18f24c 5be4e0bd-951c-4336-b624-4b1e91c486e9 15442 0 2023-01-26 06:28:01 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-027758317ed18f24c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-027758317ed18f24c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.30 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-027758317ed18f24c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:39:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-027758317ed18f24c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.30,},NodeAddress{Type:ExternalIP,Address:54.78.113.195,},NodeAddress{Type:InternalDNS,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-78-113-195.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec217487a4b2df8f6bfdfc14eba9a7c2,SystemUUID:ec217487-a4b2-df8f-6bfd-fc14eba9a7c2,BootID:54603b90-dc3a-4156-9179-27712e5d6040,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 26 06:41:52.130: INFO: Logging kubelet events for node i-027758317ed18f24c Jan 26 06:41:52.240: INFO: Logging pods the kubelet thinks is on node i-027758317ed18f24c Jan 26 06:41:52.356: INFO: coredns-559769c974-wcbx4 started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container coredns ready: true, restart count 0 Jan 26 06:41:52.356: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8h5jw started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:52.356: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-pq6nw started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:52.356: INFO: coredns-autoscaler-7cb5c5b969-n6dbb started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container autoscaler ready: true, restart count 0 Jan 26 06:41:52.356: INFO: test-rolling-update-with-lb-56d9b65d4c-n5n56 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container agnhost ready: false, restart count 0 Jan 26 06:41:52.356: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-p5fw4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:52.356: INFO: cilium-rf9ss started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:41:52.356: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:41:52.356: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-mdbgh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:52.356: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-qlxcz started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:52.356: INFO: pod-disruption-failure-ignore-1-j4jwr started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container c ready: false, restart count 0 Jan 26 06:41:52.356: INFO: ebs-csi-node-ltj76 started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded) Jan 26 06:41:52.356: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:41:52.356: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:41:52.356: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:41:52.356: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-2ln5x started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:52.356: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4kttc started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:52.356: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-rs2m5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:52.356: INFO: pod-disruption-failure-ignore-0-j8pfd started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container c ready: false, restart count 0 Jan 26 06:41:52.356: INFO: netserver-0 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container webserver ready: false, restart count 0 Jan 26 06:41:52.356: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4frxr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:52.356: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5nlws started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:52.356: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:52.356: INFO: csi-mockplugin-0 started at 2023-01-26 06:38:10 +0000 UTC (0+3 container statuses recorded) Jan 26 06:41:52.356: INFO: Container csi-provisioner ready: false, restart count 0 Jan 26 06:41:52.356: INFO: Container driver-registrar ready: false, restart count 0 Jan 26 06:41:52.356: INFO: Container mock ready: false, restart count 0 Jan 26 06:41:52.767: INFO: Latency metrics for node i-027758317ed18f24c Jan 26 06:41:52.767: INFO: Logging node info for node i-03743e1aeef854f6a Jan 26 06:41:52.874: INFO: Node Info: &Node{ObjectMeta:{i-03743e1aeef854f6a 24dc0f81-a5a8-4cc2-b4c4-d349428290df 14959 0 2023-01-26 06:28:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03743e1aeef854f6a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-03743e1aeef854f6a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.218 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03743e1aeef854f6a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-03743e1aeef854f6a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:21 +0000 UTC,LastTransitionTime:2023-01-26 06:28:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.218,},NodeAddress{Type:ExternalIP,Address:34.242.210.172,},NodeAddress{Type:InternalDNS,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-242-210-172.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20e9e6999a79b936afeaa0b5c2f8d1,SystemUUID:ec20e9e6-999a-79b9-36af-eaa0b5c2f8d1,BootID:78a5ef12-71ee-45de-9a4e-511ab894624a,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1,DevicePath:,},},Config:nil,},} Jan 26 06:41:52.875: INFO: Logging kubelet events for node i-03743e1aeef854f6a Jan 26 06:41:52.989: INFO: Logging pods the kubelet thinks is on node i-03743e1aeef854f6a Jan 26 06:41:53.128: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-fwv5h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.128: INFO: busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 started at 2023-01-26 06:38:51 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container busybox ready: false, restart count 0 Jan 26 06:41:53.128: INFO: pod-1 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container donothing ready: false, restart count 0 Jan 26 06:41:53.128: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-k7vkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.128: INFO: pod-subpath-test-preprovisionedpv-bfzt started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container test-container-subpath-preprovisionedpv-bfzt ready: false, restart count 0 Jan 26 06:41:53.128: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bjg5g started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.128: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4x2rf started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.128: INFO: ss-1 started at 2023-01-26 06:37:47 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container webserver ready: false, restart count 0 Jan 26 06:41:53.128: INFO: busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a started at 2023-01-26 06:36:51 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container busybox-readonly-fsbdd9a70d-f04c-48bc-9501-fdf01b0b9b2a ready: false, restart count 0 Jan 26 06:41:53.128: INFO: explicit-nonroot-uid started at 2023-01-26 06:38:42 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container explicit-nonroot-uid ready: false, restart count 0 Jan 26 06:41:53.128: INFO: ebs-csi-node-9p4ds started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded) Jan 26 06:41:53.128: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:41:53.128: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:41:53.128: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:41:53.128: INFO: cilium-h8sgv started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:41:53.128: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:41:53.128: INFO: test-rolling-update-with-lb-56d9b65d4c-sl4lf started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container agnhost ready: true, restart count 0 Jan 26 06:41:53.128: INFO: hostexec-i-03743e1aeef854f6a-vjpnj started at 2023-01-26 06:38:19 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container agnhost-container ready: true, restart count 0 Jan 26 06:41:53.128: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9ncf5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.128: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9rzll started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.128: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-w7dtm started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.128: INFO: netserver-1 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container webserver ready: false, restart count 0 Jan 26 06:41:53.128: INFO: affinity-nodeport-transition-hk5f5 started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Jan 26 06:41:53.128: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c966n started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.128: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-64l9m started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.128: INFO: alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab ready: false, restart count 0 Jan 26 06:41:53.128: INFO: downwardapi-volume-a4ec348e-9be9-4f89-accc-454ea9b384f2 started at 2023-01-26 06:38:14 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container client-container ready: false, restart count 0 Jan 26 06:41:53.128: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-gg2n2 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.128: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.525: INFO: Latency metrics for node i-03743e1aeef854f6a Jan 26 06:41:53.525: INFO: Logging node info for node i-078e786f96d20a635 Jan 26 06:41:53.632: INFO: Node Info: &Node{ObjectMeta:{i-078e786f96d20a635 f723e0db-adce-4e86-a6eb-74cd60253348 15626 0 2023-01-26 06:28:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-078e786f96d20a635 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-078e786f96d20a635 topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.26 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2478":"i-078e786f96d20a635","ebs.csi.aws.com":"i-078e786f96d20a635"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-26 06:28:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-078e786f96d20a635,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.26,},NodeAddress{Type:ExternalIP,Address:54.77.178.217,},NodeAddress{Type:InternalDNS,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-77-178-217.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24661a036d7f8fb4e32b792d7b9eff,SystemUUID:ec24661a-036d-7f8f-b4e3-2b792d7b9eff,BootID:ea35d483-6a83-4e50-8ffa-20c56aa45bf3,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8 kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8,DevicePath:,},},Config:nil,},} Jan 26 06:41:53.633: INFO: Logging kubelet events for node i-078e786f96d20a635 Jan 26 06:41:53.743: INFO: Logging pods the kubelet thinks is on node i-078e786f96d20a635 Jan 26 06:41:53.871: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-lxcv7 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.871: INFO: rc-test-f4hc8 started at 2023-01-26 06:37:54 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container rc-test ready: false, restart count 0 Jan 26 06:41:53.871: INFO: inline-volume-tester-sbl7m started at 2023-01-26 06:34:40 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 26 06:41:53.871: INFO: hostexec-i-078e786f96d20a635-kwjjx started at 2023-01-26 06:41:53 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container agnhost-container ready: false, restart count 0 Jan 26 06:41:53.871: INFO: netserver-2 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container webserver ready: false, restart count 0 Jan 26 06:41:53.871: INFO: affinity-nodeport-transition-gxp6x started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container affinity-nodeport-transition ready: false, restart count 0 Jan 26 06:41:53.871: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b2pzh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.871: INFO: pod-0 started at 2023-01-26 06:36:14 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container donothing ready: true, restart count 0 Jan 26 06:41:53.871: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cl2g5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.871: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-j5qj6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.871: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-zdwkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.871: INFO: inline-volume-tester-mmz4t started at 2023-01-26 06:39:35 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 26 06:41:53.871: INFO: pod-2 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container donothing ready: false, restart count 0 Jan 26 06:41:53.871: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:36:46 +0000 UTC (0+7 container statuses recorded) Jan 26 06:41:53.871: INFO: Container csi-attacher ready: true, restart count 0 Jan 26 06:41:53.871: INFO: Container csi-provisioner ready: true, restart count 0 Jan 26 06:41:53.871: INFO: Container csi-resizer ready: true, restart count 0 Jan 26 06:41:53.871: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 26 06:41:53.871: INFO: Container hostpath ready: true, restart count 0 Jan 26 06:41:53.871: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:41:53.871: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:41:53.871: INFO: pfpod started at 2023-01-26 06:37:48 +0000 UTC (0+2 container statuses recorded) Jan 26 06:41:53.871: INFO: Container portforwardtester ready: false, restart count 0 Jan 26 06:41:53.871: INFO: Container readiness ready: false, restart count 0 Jan 26 06:41:53.871: INFO: var-expansion-8f3d4023-ad0f-4de9-9fca-b5144eba549f started at 2023-01-26 06:38:20 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container dapi-container ready: false, restart count 0 Jan 26 06:41:53.871: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tl4r4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: false, restart count 0 Jan 26 06:41:53.871: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cckkd started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.871: INFO: ebs-csi-node-bm9ks started at 2023-01-26 06:28:04 +0000 UTC (0+3 container statuses recorded) Jan 26 06:41:53.871: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:41:53.871: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:41:53.871: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:41:53.871: INFO: cilium-tvcl7 started at 2023-01-26 06:28:04 +0000 UTC (1+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:41:53.871: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:41:53.871: INFO: ss-0 started at 2023-01-26 06:36:05 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container webserver ready: true, restart count 0 Jan 26 06:41:53.871: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c5w9z started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.871: INFO: test-rollover-controller-nb66n started at 2023-01-26 06:37:48 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container httpd ready: false, restart count 0 Jan 26 06:41:53.871: INFO: dns-test-cee2145e-bfbc-4913-ab2f-46bbcbb0c067 started at 2023-01-26 06:38:58 +0000 UTC (0+3 container statuses recorded) Jan 26 06:41:53.871: INFO: Container jessie-querier ready: false, restart count 0 Jan 26 06:41:53.871: INFO: Container querier ready: false, restart count 0 Jan 26 06:41:53.871: INFO: Container webserver ready: false, restart count 0 Jan 26 06:41:53.871: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bvftr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.871: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-llwt7 started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:53.871: INFO: test-rolling-update-with-lb-56d9b65d4c-k8ss5 started at 2023-01-26 06:38:02 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container agnhost ready: false, restart count 0 Jan 26 06:41:53.871: INFO: pause started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:53.871: INFO: Container pause ready: false, restart count 0 Jan 26 06:41:54.371: INFO: Latency metrics for node i-078e786f96d20a635 Jan 26 06:41:54.371: INFO: Logging node info for node i-07dd0af9495bd7a2d Jan 26 06:41:54.479: INFO: Node Info: &Node{ObjectMeta:{i-07dd0af9495bd7a2d db95ce0d-a7e3-4367-b695-1206b36a4ed7 16185 0 2023-01-26 06:28:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07dd0af9495bd7a2d kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-07dd0af9495bd7a2d topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.14 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07dd0af9495bd7a2d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:28:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-26 06:34:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-26 06:41:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-07dd0af9495bd7a2d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:41:30 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.14,},NodeAddress{Type:ExternalIP,Address:34.254.60.108,},NodeAddress{Type:InternalDNS,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-254-60-108.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23d9d9da6c43e1b12d6c6adb2bca5c,SystemUUID:ec23d9d9-da6c-43e1-b12d-6c6adb2bca5c,BootID:8844f0d4-74db-4ceb-94f5-285e3dcef78b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 26 06:41:54.479: INFO: Logging kubelet events for node i-07dd0af9495bd7a2d Jan 26 06:41:54.589: INFO: Logging pods the kubelet thinks is on node i-07dd0af9495bd7a2d Jan 26 06:41:54.702: INFO: hostpath-symlink-prep-provisioning-3425 started at 2023-01-26 06:38:58 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container init-volume-provisioning-3425 ready: false, restart count 0 Jan 26 06:41:54.702: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b4l5j started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:54.702: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-v96fn started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:54.702: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-56mcl started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:54.702: INFO: netserver-3 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container webserver ready: false, restart count 0 Jan 26 06:41:54.702: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-6prmp started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:54.702: INFO: cilium-w5n9v started at 2023-01-26 06:28:03 +0000 UTC (1+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:41:54.702: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:41:54.702: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bzv56 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:54.702: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8jm8h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:54.702: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-kmrs9 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:54.702: INFO: coredns-559769c974-hxkxl started at 2023-01-26 06:28:36 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container coredns ready: true, restart count 0 Jan 26 06:41:54.702: INFO: affinity-nodeport-transition-b7tng started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Jan 26 06:41:54.702: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5dbcr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:54.702: INFO: ebs-csi-node-vsjqn started at 2023-01-26 06:28:03 +0000 UTC (0+3 container statuses recorded) Jan 26 06:41:54.702: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:41:54.702: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:41:54.702: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:41:54.702: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tt42n started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:54.702: INFO: httpd started at 2023-01-26 06:39:40 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container httpd ready: false, restart count 0 Jan 26 06:41:54.702: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-47vr6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:54.702: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:41:55.110: INFO: Latency metrics for node i-07dd0af9495bd7a2d Jan 26 06:41:55.110: INFO: Logging node info for node i-089a9e95df3068b0a Jan 26 06:41:55.218: INFO: Node Info: &Node{ObjectMeta:{i-089a9e95df3068b0a 35816ce0-3668-4f6e-a8fd-15fd2906316c 15227 0 2023-01-26 06:25:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089a9e95df3068b0a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089a9e95df3068b0a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:25:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-26 06:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:27:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-26 06:38:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-089a9e95df3068b0a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:38:42 +0000 UTC,LastTransitionTime:2023-01-26 06:27:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.54,},NodeAddress{Type:ExternalIP,Address:18.203.178.61,},NodeAddress{Type:InternalDNS,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-203-178-61.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec270b473b916bebdc318bfa0f9b1a87,SystemUUID:ec270b47-3b91-6beb-dc31-8bfa0f9b1a87,BootID:b319d8a4-ba87-403c-8d6a-5778dcb9a28c,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:63920476,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:44339051,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841311,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965809,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 26 06:41:55.218: INFO: Logging kubelet events for node i-089a9e95df3068b0a Jan 26 06:41:55.328: INFO: Logging pods the kubelet thinks is on node i-089a9e95df3068b0a Jan 26 06:41:55.447: INFO: kube-scheduler-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:55.447: INFO: Container kube-scheduler ready: true, restart count 0 Jan 26 06:41:55.447: INFO: cilium-8rnxh started at 2023-01-26 06:26:49 +0000 UTC (1+1 container statuses recorded) Jan 26 06:41:55.447: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:41:55.447: INFO: ebs-csi-node-62mcc started at 2023-01-26 06:26:49 +0000 UTC (0+3 container statuses recorded) Jan 26 06:41:55.447: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:41:55.447: INFO: dns-controller-69987775c6-9h2dj started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:55.447: INFO: Container dns-controller ready: true, restart count 0 Jan 26 06:41:55.447: INFO: etcd-manager-events-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded) Jan 26 06:41:55.447: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Container etcd-manager ready: true, restart count 0 Jan 26 06:41:55.447: INFO: kube-apiserver-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+2 container statuses recorded) Jan 26 06:41:55.447: INFO: Container healthcheck ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Container kube-apiserver ready: true, restart count 2 Jan 26 06:41:55.447: INFO: kops-controller-nkbt7 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:55.447: INFO: Container kops-controller ready: true, restart count 0 Jan 26 06:41:55.447: INFO: aws-cloud-controller-manager-xz4hv started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:55.447: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 26 06:41:55.447: INFO: cilium-operator-5dd44dc49f-2h9f5 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:55.447: INFO: Container cilium-operator ready: true, restart count 0 Jan 26 06:41:55.447: INFO: ebs-csi-controller-5bd98b456f-zpvmp started at 2023-01-26 06:26:49 +0000 UTC (0+5 container statuses recorded) Jan 26 06:41:55.447: INFO: Container csi-attacher ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Container csi-provisioner ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Container csi-resizer ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:41:55.447: INFO: etcd-manager-main-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded) Jan 26 06:41:55.447: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Jan 26 06:41:55.447: INFO: Container etcd-manager ready: true, restart count 0 Jan 26 06:41:55.447: INFO: kube-controller-manager-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 26 06:41:55.447: INFO: Container kube-controller-manager ready: true, restart count 4 Jan 26 06:41:55.831: INFO: Latency metrics for node i-089a9e95df3068b0a [DeferCleanup (Each)] [sig-node] Kubelet tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "kubelet-test-1788" for this suite. �[38;5;243m01/26/23 06:41:55.831�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sProbing\scontainer\sshould\sbe\srestarted\swith\san\sexec\sliveness\sprobe\swith\stimeout\s\[MinimumKubeletVersion\:1\.20\]\s\[NodeConformance\]$'
test/e2e/common/node/container_probe.go:955 k8s.io/kubernetes/test/e2e/common/node.RunLivenessTest(0xc000a981e0, 0xc0024c8480, 0x1, 0x3?) test/e2e/common/node/container_probe.go:955 +0x39a k8s.io/kubernetes/test/e2e/common/node.glob..func2.10() test/e2e/common/node/container_probe.go:240 +0x17afrom junit_01.xml
[BeforeEach] [sig-node] Probing container set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/26/23 06:38:50.922�[0m Jan 26 06:38:50.922: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename container-probe �[38;5;243m01/26/23 06:38:50.923�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/26/23 06:38:51.242�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/26/23 06:38:51.453�[0m [BeforeEach] [sig-node] Probing container test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-node] Probing container test/e2e/common/node/container_probe.go:63 [It] should be restarted with an exec liveness probe with timeout [MinimumKubeletVersion:1.20] [NodeConformance] test/e2e/common/node/container_probe.go:231 �[1mSTEP:�[0m Creating pod busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 in namespace container-probe-9116 �[38;5;243m01/26/23 06:38:51.663�[0m Jan 26 06:38:51.772: INFO: Waiting up to 5m0s for pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516" in namespace "container-probe-9116" to be "not pending" Jan 26 06:38:51.878: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 106.42388ms Jan 26 06:38:53.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2.213778003s Jan 26 06:38:55.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4.213627713s Jan 26 06:38:57.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 6.213119177s Jan 26 06:38:59.987: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 8.214723406s Jan 26 06:39:01.989: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 10.216758174s Jan 26 06:39:03.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 12.213504167s Jan 26 06:39:05.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 14.213823387s Jan 26 06:39:07.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 16.213621833s Jan 26 06:39:09.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 18.213452117s Jan 26 06:39:11.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 20.213924981s Jan 26 06:39:13.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 22.213431416s Jan 26 06:39:15.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 24.213667126s Jan 26 06:39:17.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 26.213331787s Jan 26 06:39:19.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 28.213669305s Jan 26 06:39:21.987: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 30.214880224s Jan 26 06:39:23.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 32.213897611s Jan 26 06:39:25.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 34.213384029s Jan 26 06:39:27.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 36.21369266s Jan 26 06:39:29.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 38.213272735s Jan 26 06:39:31.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 40.213015731s Jan 26 06:39:33.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 42.213821295s Jan 26 06:39:35.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 44.213445293s Jan 26 06:39:37.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 46.213700383s Jan 26 06:39:39.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 48.214031393s Jan 26 06:39:41.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 50.213529624s Jan 26 06:39:43.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 52.21328106s Jan 26 06:39:45.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 54.213725247s Jan 26 06:39:47.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 56.213761993s Jan 26 06:39:49.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 58.213658131s Jan 26 06:39:51.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.2130485s Jan 26 06:39:53.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.213898613s Jan 26 06:39:55.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.213749327s Jan 26 06:39:57.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.213499244s Jan 26 06:39:59.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.212948862s Jan 26 06:40:01.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.213848592s Jan 26 06:40:03.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.212929127s Jan 26 06:40:05.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.214034004s Jan 26 06:40:07.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.21418717s Jan 26 06:40:09.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.213152767s Jan 26 06:40:11.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.213039859s Jan 26 06:40:13.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.214090119s Jan 26 06:40:15.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.213538711s Jan 26 06:40:17.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.214018908s Jan 26 06:40:19.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.213220712s Jan 26 06:40:21.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.213322772s Jan 26 06:40:23.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.213563394s Jan 26 06:40:25.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.213892904s Jan 26 06:40:27.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.214367907s Jan 26 06:40:29.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.213328096s Jan 26 06:40:31.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.213841893s Jan 26 06:40:33.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.213915973s Jan 26 06:40:35.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.213865367s Jan 26 06:40:37.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.214079663s Jan 26 06:40:39.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.213973513s Jan 26 06:40:41.987: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.214955446s Jan 26 06:40:43.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.213059487s Jan 26 06:40:45.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.213967637s Jan 26 06:40:47.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.213892236s Jan 26 06:40:49.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.213293103s Jan 26 06:40:51.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.213268627s Jan 26 06:40:53.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.214087074s Jan 26 06:40:55.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.213993806s Jan 26 06:40:57.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.213708567s Jan 26 06:40:59.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.213705229s Jan 26 06:41:01.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.213869031s Jan 26 06:41:03.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.213966404s Jan 26 06:41:05.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.21350266s Jan 26 06:41:07.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.21319305s Jan 26 06:41:09.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.213091935s Jan 26 06:41:11.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.213235629s Jan 26 06:41:13.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.213808171s Jan 26 06:41:15.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.213884867s Jan 26 06:41:17.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.213690316s Jan 26 06:41:19.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.214148976s Jan 26 06:41:21.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.212820516s Jan 26 06:41:23.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.213221684s Jan 26 06:41:25.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.214019451s Jan 26 06:41:27.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.213995776s Jan 26 06:41:29.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.213083103s Jan 26 06:41:31.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.21411077s Jan 26 06:41:33.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.213718698s Jan 26 06:41:35.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.213762116s Jan 26 06:41:37.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.21349993s Jan 26 06:41:39.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.213641756s Jan 26 06:41:41.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.212836014s Jan 26 06:41:43.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.213544393s Jan 26 06:41:45.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.21399027s Jan 26 06:41:47.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.213825513s Jan 26 06:41:49.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.21305939s Jan 26 06:41:51.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.214107081s Jan 26 06:41:53.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.212778522s Jan 26 06:41:55.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.213767653s Jan 26 06:41:57.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.213849283s Jan 26 06:41:59.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.213822295s Jan 26 06:42:01.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.214172503s Jan 26 06:42:03.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.213731252s Jan 26 06:42:05.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.213688089s Jan 26 06:42:07.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.213172395s Jan 26 06:42:09.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.213996452s Jan 26 06:42:11.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.213984353s Jan 26 06:42:13.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.213050023s Jan 26 06:42:15.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.214116865s Jan 26 06:42:17.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.214227113s Jan 26 06:42:19.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.2139238s Jan 26 06:42:21.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.213756517s Jan 26 06:42:23.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.213718022s Jan 26 06:42:25.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.213565557s Jan 26 06:42:27.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.213849269s Jan 26 06:42:29.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.213764676s Jan 26 06:42:31.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.214042629s Jan 26 06:42:33.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.213727337s Jan 26 06:42:35.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.213736445s Jan 26 06:42:37.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.213138908s Jan 26 06:42:39.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.213762875s Jan 26 06:42:41.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.213932033s Jan 26 06:42:43.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.214099199s Jan 26 06:42:45.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.213977305s Jan 26 06:42:47.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.213899404s Jan 26 06:42:49.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.21393644s Jan 26 06:42:51.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.213903478s Jan 26 06:42:53.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.213774135s Jan 26 06:42:55.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.213570235s Jan 26 06:42:57.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.212906395s Jan 26 06:42:59.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.213613894s Jan 26 06:43:01.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.212977831s Jan 26 06:43:03.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.214119582s Jan 26 06:43:05.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.213341277s Jan 26 06:43:07.987: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.215214095s Jan 26 06:43:09.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.213592155s Jan 26 06:43:11.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.213749858s Jan 26 06:43:13.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.213397723s Jan 26 06:43:15.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.213085027s Jan 26 06:43:17.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.213868905s Jan 26 06:43:19.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.213567446s Jan 26 06:43:21.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.213775419s Jan 26 06:43:23.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.213941525s Jan 26 06:43:25.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.213917633s Jan 26 06:43:27.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.213495469s Jan 26 06:43:29.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.213941752s Jan 26 06:43:31.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.21412267s Jan 26 06:43:33.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.213438429s Jan 26 06:43:35.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.213150403s Jan 26 06:43:37.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.213998039s Jan 26 06:43:39.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.214108966s Jan 26 06:43:41.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.213043176s Jan 26 06:43:43.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.212884993s Jan 26 06:43:45.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.213624745s Jan 26 06:43:47.985: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.212796716s Jan 26 06:43:49.986: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.213781739s Jan 26 06:43:51.987: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.215200957s Jan 26 06:43:52.093: INFO: Pod "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.321346837s Jan 26 06:43:52.094: INFO: Unexpected error: starting pod busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 in namespace container-probe-9116: <*pod.timeoutError | 0xc00368b350>: { msg: "timed out while waiting for pod container-probe-9116/busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 to be not pending", observedObjects: [ <*v1.Pod | 0xc001233b00>{ TypeMeta: {Kind: "", APIVersion: ""}, ObjectMeta: { Name: "busybox-79d7be08-adbb-4b1d-ab66-d16e19642516", GenerateName: "", Namespace: "container-probe-9116", SelfLink: "", UID: "344592ad-3daa-45e2-b6d0-fa92caab4c1f", ResourceVersion: "15308", Generation: 0, CreationTimestamp: { Time: { wall: 0, ext: 63810311931, loc: { name: "Local", zone: [ {name: "UTC", offset: 0, isDST: false}, ], tx: [ { when: -576460752303423488, index: 0, isstd: false, isutc: false, }, ], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: "UTC", offset: 0, isDST: false}, }, }, }, DeletionTimestamp: nil, DeletionGracePeriodSeconds: nil, Labels: {"test": "liveness"}, Annotations: nil, OwnerReferences: nil, Finalizers: nil, ManagedFields: [ { Manager: "e2e.test", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63810311931, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:metadata\":{\"f:labels\":{\".\":{},\"f:test\":{}}},\"f:spec\":{\"f:containers\":{\"k:{\\\"name\\\":\\\"busybox\\\"}\":{\".\":{},\"f:command\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:livenessProbe\":{\".\":{},\"f:exec\":{\".\":{},\"f:command\":{}},\"f:failureThreshold\":{},\"f:initialDelaySeconds\":{},\"f:periodSeconds\":{},\"f:successThreshold\":{},\"f:timeoutSeconds\":{}},\"f:name\":{},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}", }, Subresource: "", }, { Manager: "kubelet", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63810311931, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}", }, Subresource: "status", }, ], }, Spec: { Volumes: [ { Name: "kube-api-access-8m7g7", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, Secret: nil, NFS: nil, ISCSI: nil, Glusterfs: nil, PersistentVolumeClaim: nil, RBD: nil, FlexVolume: nil, Cinder: nil, CephFS: nil, Flocker: nil, DownwardAPI: nil, FC: nil, AzureFile: nil, ConfigMap: nil, VsphereVolume: nil, Quobyte: nil, AzureDisk: nil, PhotonPersistentDisk: nil, Projected: { Sources: [ { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., ... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output Jan 26 06:43:52.094: FAIL: starting pod busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 in namespace container-probe-9116: timed out while waiting for pod container-probe-9116/busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 to be not pending Full Stack Trace k8s.io/kubernetes/test/e2e/common/node.RunLivenessTest(0xc000a981e0, 0xc0024c8480, 0x1, 0x3?) test/e2e/common/node/container_probe.go:955 +0x39a k8s.io/kubernetes/test/e2e/common/node.glob..func2.10() test/e2e/common/node/container_probe.go:240 +0x17a �[1mSTEP:�[0m deleting the pod �[38;5;243m01/26/23 06:43:52.094�[0m [AfterEach] [sig-node] Probing container test/e2e/framework/node/init/init.go:32 Jan 26 06:43:52.215: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-node] Probing container test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-node] Probing container dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/26/23 06:43:52.323�[0m �[1mSTEP:�[0m Collecting events from namespace "container-probe-9116". �[38;5;243m01/26/23 06:43:52.323�[0m �[1mSTEP:�[0m Found 11 events. �[38;5;243m01/26/23 06:43:52.43�[0m Jan 26 06:43:52.430: INFO: At 2023-01-26 06:38:51 +0000 UTC - event for busybox-79d7be08-adbb-4b1d-ab66-d16e19642516: {default-scheduler } Scheduled: Successfully assigned container-probe-9116/busybox-79d7be08-adbb-4b1d-ab66-d16e19642516 to i-03743e1aeef854f6a Jan 26 06:43:52.430: INFO: At 2023-01-26 06:38:52 +0000 UTC - event for busybox-79d7be08-adbb-4b1d-ab66-d16e19642516: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "60d2f3b8aadbb350b7c62d2e9b2f7d766129adcad94e9bf0eb855c3ba4d8538e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:52.430: INFO: At 2023-01-26 06:39:05 +0000 UTC - event for busybox-79d7be08-adbb-4b1d-ab66-d16e19642516: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1b091ce62d10cf7df7b8f259a3514a51bf14326e37c33898ecf1e842609f0900": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:52.430: INFO: At 2023-01-26 06:39:20 +0000 UTC - event for busybox-79d7be08-adbb-4b1d-ab66-d16e19642516: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b35e25914f1a6c2af96a05ba3809e33eda8c21b38c08ad872d8dc2ad98a6ba16": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:52.430: INFO: At 2023-01-26 06:39:32 +0000 UTC - event for busybox-79d7be08-adbb-4b1d-ab66-d16e19642516: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "81242529c8eebd8090ec9886b0393505c5236f833e374adf11f44006910896bc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:52.430: INFO: At 2023-01-26 06:39:46 +0000 UTC - event for busybox-79d7be08-adbb-4b1d-ab66-d16e19642516: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dd8b5f140f187371d4a910ed32fbc821e7c0eebc592be8478df9003a857f8fee": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:52.430: INFO: At 2023-01-26 06:40:02 +0000 UTC - event for busybox-79d7be08-adbb-4b1d-ab66-d16e19642516: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e4de0b1ecf66da99e07f4d751a02846d6c1fac1d0e15e322d49b201e720b22f5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:52.430: INFO: At 2023-01-26 06:40:17 +0000 UTC - event for busybox-79d7be08-adbb-4b1d-ab66-d16e19642516: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4c8354c28e55ba568eb901b9cec47fd366fe30747b17e3f7620542367dabc7c1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:52.430: INFO: At 2023-01-26 06:40:30 +0000 UTC - event for busybox-79d7be08-adbb-4b1d-ab66-d16e19642516: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "247fb816bb43a402ebc6c651ec565253ccfc49d916311e3f503efabf994581c0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:52.430: INFO: At 2023-01-26 06:40:44 +0000 UTC - event for busybox-79d7be08-adbb-4b1d-ab66-d16e19642516: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8ba4495ed7f64f7aa0331bb34a5db25498b34a253bb94d6c9836d237d040bebb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:52.430: INFO: At 2023-01-26 06:40:57 +0000 UTC - event for busybox-79d7be08-adbb-4b1d-ab66-d16e19642516: {kubelet i-03743e1aeef854f6a} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "77500c164f904a364ab0d9f38a1273d662e5f470f11734b35778be7042f9d621": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 26 06:43:52.536: INFO: POD NODE PHASE GRACE CONDITIONS Jan 26 06:43:52.536: INFO: Jan 26 06:43:52.643: INFO: Logging node info for node i-027758317ed18f24c Jan 26 06:43:52.749: INFO: Node Info: &Node{ObjectMeta:{i-027758317ed18f24c 5be4e0bd-951c-4336-b624-4b1e91c486e9 17012 0 2023-01-26 06:28:01 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-027758317ed18f24c kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-027758317ed18f24c topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.30 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-027758317ed18f24c"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kubelet Update v1 2023-01-26 06:39:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-027758317ed18f24c,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:01 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:04 +0000 UTC,LastTransitionTime:2023-01-26 06:28:13 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.30,},NodeAddress{Type:ExternalIP,Address:54.78.113.195,},NodeAddress{Type:InternalDNS,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-027758317ed18f24c.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-78-113-195.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec217487a4b2df8f6bfdfc14eba9a7c2,SystemUUID:ec217487-a4b2-df8f-6bfd-fc14eba9a7c2,BootID:54603b90-dc3a-4156-9179-27712e5d6040,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 26 06:43:52.749: INFO: Logging kubelet events for node i-027758317ed18f24c Jan 26 06:43:52.858: INFO: Logging pods the kubelet thinks is on node i-027758317ed18f24c Jan 26 06:43:53.077: INFO: ebs-csi-node-ltj76 started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:53.078: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:53.078: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:53.078: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:53.078: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-2ln5x started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.078: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4kttc started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.078: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-rs2m5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.078: INFO: pod-disruption-failure-ignore-0-j8pfd started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container c ready: false, restart count 0 Jan 26 06:43:53.078: INFO: netserver-0 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:53.078: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4frxr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.078: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5nlws started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.078: INFO: csi-mockplugin-0 started at 2023-01-26 06:38:10 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:53.078: INFO: Container csi-provisioner ready: false, restart count 0 Jan 26 06:43:53.078: INFO: Container driver-registrar ready: false, restart count 0 Jan 26 06:43:53.078: INFO: Container mock ready: false, restart count 0 Jan 26 06:43:53.078: INFO: coredns-559769c974-wcbx4 started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container coredns ready: true, restart count 0 Jan 26 06:43:53.078: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8h5jw started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.078: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-pq6nw started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.078: INFO: coredns-autoscaler-7cb5c5b969-n6dbb started at 2023-01-26 06:28:13 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container autoscaler ready: true, restart count 0 Jan 26 06:43:53.078: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-p5fw4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.078: INFO: cilium-rf9ss started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:43:53.078: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:43:53.078: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-mdbgh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.078: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-qlxcz started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.078: INFO: pod-disruption-failure-ignore-1-j4jwr started at 2023-01-26 06:35:08 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container c ready: false, restart count 0 Jan 26 06:43:53.078: INFO: hostexec-i-027758317ed18f24c-9cp6h started at 2023-01-26 06:42:56 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container agnhost-container ready: true, restart count 0 Jan 26 06:43:53.078: INFO: local-injector started at 2023-01-26 06:43:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.078: INFO: Container local-injector ready: false, restart count 0 Jan 26 06:43:53.485: INFO: Latency metrics for node i-027758317ed18f24c Jan 26 06:43:53.485: INFO: Logging node info for node i-03743e1aeef854f6a Jan 26 06:43:53.591: INFO: Node Info: &Node{ObjectMeta:{i-03743e1aeef854f6a 24dc0f81-a5a8-4cc2-b4c4-d349428290df 17015 0 2023-01-26 06:28:00 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03743e1aeef854f6a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-03743e1aeef854f6a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.218 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03743e1aeef854f6a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:38:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:43:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-03743e1aeef854f6a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:43:27 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:43:27 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:43:27 +0000 UTC,LastTransitionTime:2023-01-26 06:28:00 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:43:27 +0000 UTC,LastTransitionTime:2023-01-26 06:28:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.218,},NodeAddress{Type:ExternalIP,Address:34.242.210.172,},NodeAddress{Type:InternalDNS,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03743e1aeef854f6a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-242-210-172.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec20e9e6999a79b936afeaa0b5c2f8d1,SystemUUID:ec20e9e6-999a-79b9-36af-eaa0b5c2f8d1,BootID:78a5ef12-71ee-45de-9a4e-511ab894624a,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ed73a2f7e92345c1,DevicePath:,},},Config:nil,},} Jan 26 06:43:53.592: INFO: Logging kubelet events for node i-03743e1aeef854f6a Jan 26 06:43:53.701: INFO: Logging pods the kubelet thinks is on node i-03743e1aeef854f6a Jan 26 06:43:53.814: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-w7dtm started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.814: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9ncf5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.814: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-9rzll started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.814: INFO: affinity-nodeport-transition-hk5f5 started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Jan 26 06:43:53.814: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c966n started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.814: INFO: netserver-1 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:53.814: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-64l9m started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.814: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-gg2n2 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.814: INFO: alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container alpine-nnp-nil-b4adc999-875b-4d01-8740-c6d921c7cbab ready: false, restart count 0 Jan 26 06:43:53.814: INFO: hostpath-symlink-prep-provisioning-3964 started at 2023-01-26 06:42:54 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container init-volume-provisioning-3964 ready: false, restart count 0 Jan 26 06:43:53.814: INFO: pod-1 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container donothing ready: false, restart count 0 Jan 26 06:43:53.814: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-fwv5h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.814: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bjg5g started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.814: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-4x2rf started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.814: INFO: pod-test started at 2023-01-26 06:42:59 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container pod-test ready: false, restart count 0 Jan 26 06:43:53.814: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-k7vkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:53.814: INFO: ebs-csi-node-9p4ds started at 2023-01-26 06:28:01 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:53.814: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:53.814: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:53.814: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:53.814: INFO: cilium-h8sgv started at 2023-01-26 06:28:01 +0000 UTC (1+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:43:53.814: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:43:53.814: INFO: ss-1 started at 2023-01-26 06:37:47 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container webserver ready: true, restart count 0 Jan 26 06:43:53.814: INFO: pod-secrets-c82db9a8-73b4-406c-9009-6dc23007fb9e started at 2023-01-26 06:43:10 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container secret-volume-test ready: false, restart count 0 Jan 26 06:43:53.814: INFO: sample-webhook-deployment-865554f4d9-vfstd started at 2023-01-26 06:43:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:53.814: INFO: Container sample-webhook ready: false, restart count 0 Jan 26 06:43:54.222: INFO: Latency metrics for node i-03743e1aeef854f6a Jan 26 06:43:54.222: INFO: Logging node info for node i-078e786f96d20a635 Jan 26 06:43:54.328: INFO: Node Info: &Node{ObjectMeta:{i-078e786f96d20a635 f723e0db-adce-4e86-a6eb-74cd60253348 17020 0 2023-01-26 06:28:03 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-078e786f96d20a635 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-078e786f96d20a635 topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.39.26 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-2478":"i-078e786f96d20a635","ebs.csi.aws.com":"i-078e786f96d20a635"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kops-controller Update v1 2023-01-26 06:28:04 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:39:36 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-078e786f96d20a635,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:03 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:39:36 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.39.26,},NodeAddress{Type:ExternalIP,Address:54.77.178.217,},NodeAddress{Type:InternalDNS,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-078e786f96d20a635.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-54-77-178-217.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec24661a036d7f8fb4e32b792d7b9eff,SystemUUID:ec24661a-036d-7f8f-b4e3-2b792d7b9eff,BootID:ea35d483-6a83-4e50-8ffa-20c56aa45bf3,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715 kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8 kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32d98b1a-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0c96788df50e760a4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-2478^32ddf45e-9d44-11ed-828e-9e76f3b97715,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-02f7e8f9aa49277c8,DevicePath:,},},Config:nil,},} Jan 26 06:43:54.329: INFO: Logging kubelet events for node i-078e786f96d20a635 Jan 26 06:43:54.437: INFO: Logging pods the kubelet thinks is on node i-078e786f96d20a635 Jan 26 06:43:54.552: INFO: pod-e8f677e8-f25b-4b11-9e72-60c497d771a7 started at 2023-01-26 06:41:58 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.552: INFO: Container write-pod ready: false, restart count 0 Jan 26 06:43:54.552: INFO: inline-volume-tester-mmz4t started at 2023-01-26 06:39:35 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.552: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 26 06:43:54.552: INFO: pod-2 started at 2023-01-26 06:36:15 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.552: INFO: Container donothing ready: false, restart count 0 Jan 26 06:43:54.552: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:36:46 +0000 UTC (0+7 container statuses recorded) Jan 26 06:43:54.552: INFO: Container csi-attacher ready: true, restart count 0 Jan 26 06:43:54.552: INFO: Container csi-provisioner ready: true, restart count 0 Jan 26 06:43:54.553: INFO: Container csi-resizer ready: true, restart count 0 Jan 26 06:43:54.553: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 26 06:43:54.553: INFO: Container hostpath ready: true, restart count 0 Jan 26 06:43:54.553: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:54.553: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:54.553: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tl4r4 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: false, restart count 0 Jan 26 06:43:54.553: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cckkd started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:54.553: INFO: ebs-csi-node-bm9ks started at 2023-01-26 06:28:04 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:54.553: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:54.553: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:54.553: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:54.553: INFO: cilium-tvcl7 started at 2023-01-26 06:28:04 +0000 UTC (1+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:43:54.553: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:43:54.553: INFO: ss-0 started at 2023-01-26 06:36:05 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container webserver ready: true, restart count 0 Jan 26 06:43:54.553: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-c5w9z started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:54.553: INFO: dns-test-cee2145e-bfbc-4913-ab2f-46bbcbb0c067 started at 2023-01-26 06:38:58 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:54.553: INFO: Container jessie-querier ready: false, restart count 0 Jan 26 06:43:54.553: INFO: Container querier ready: false, restart count 0 Jan 26 06:43:54.553: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:54.553: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bvftr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:54.553: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-llwt7 started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:54.553: INFO: pause started at 2023-01-26 06:40:03 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container pause ready: false, restart count 0 Jan 26 06:43:54.553: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-lxcv7 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:54.553: INFO: inline-volume-tester-sbl7m started at 2023-01-26 06:34:40 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 26 06:43:54.553: INFO: hostexec-i-078e786f96d20a635-kwjjx started at 2023-01-26 06:41:53 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container agnhost-container ready: true, restart count 0 Jan 26 06:43:54.553: INFO: netserver-2 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:54.553: INFO: affinity-nodeport-transition-gxp6x started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container affinity-nodeport-transition ready: false, restart count 0 Jan 26 06:43:54.553: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b2pzh started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:54.553: INFO: pod-0 started at 2023-01-26 06:36:14 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container donothing ready: true, restart count 0 Jan 26 06:43:54.553: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-cl2g5 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:54.553: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-j5qj6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:54.553: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-zdwkv started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:54.553: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:54.960: INFO: Latency metrics for node i-078e786f96d20a635 Jan 26 06:43:54.961: INFO: Logging node info for node i-07dd0af9495bd7a2d Jan 26 06:43:55.067: INFO: Node Info: &Node{ObjectMeta:{i-07dd0af9495bd7a2d db95ce0d-a7e3-4367-b695-1206b36a4ed7 17027 0 2023-01-26 06:28:02 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-07dd0af9495bd7a2d kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:eu-west-1a topology.hostpath.csi/node:i-07dd0af9495bd7a2d topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.14 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-07dd0af9495bd7a2d"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:28:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:28:03 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kube-controller-manager Update v1 2023-01-26 06:43:21 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-26 06:43:22 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:capacity":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-07dd0af9495bd7a2d,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:43:22 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:43:22 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:43:22 +0000 UTC,LastTransitionTime:2023-01-26 06:28:02 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:43:22 +0000 UTC,LastTransitionTime:2023-01-26 06:28:17 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.14,},NodeAddress{Type:ExternalIP,Address:34.254.60.108,},NodeAddress{Type:InternalDNS,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-07dd0af9495bd7a2d.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-34-254-60-108.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23d9d9da6c43e1b12d6c6adb2bca5c,SystemUUID:ec23d9d9-da6c-43e1-b12d-6c6adb2bca5c,BootID:8844f0d4-74db-4ceb-94f5-285e3dcef78b,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-03c40ffb98a556d55],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-03c40ffb98a556d55,DevicePath:,},},Config:nil,},} Jan 26 06:43:55.067: INFO: Logging kubelet events for node i-07dd0af9495bd7a2d Jan 26 06:43:55.178: INFO: Logging pods the kubelet thinks is on node i-07dd0af9495bd7a2d Jan 26 06:43:55.299: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-kmrs9 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:55.299: INFO: coredns-559769c974-hxkxl started at 2023-01-26 06:28:36 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container coredns ready: true, restart count 0 Jan 26 06:43:55.299: INFO: affinity-nodeport-transition-b7tng started at 2023-01-26 06:39:04 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container affinity-nodeport-transition ready: true, restart count 0 Jan 26 06:43:55.299: INFO: csi-hostpathplugin-0 started at 2023-01-26 06:42:01 +0000 UTC (0+7 container statuses recorded) Jan 26 06:43:55.299: INFO: Container csi-attacher ready: false, restart count 0 Jan 26 06:43:55.299: INFO: Container csi-provisioner ready: false, restart count 0 Jan 26 06:43:55.299: INFO: Container csi-resizer ready: false, restart count 0 Jan 26 06:43:55.299: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 26 06:43:55.299: INFO: Container hostpath ready: false, restart count 0 Jan 26 06:43:55.299: INFO: Container liveness-probe ready: false, restart count 0 Jan 26 06:43:55.299: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 26 06:43:55.299: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-5dbcr started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:55.299: INFO: ebs-csi-node-vsjqn started at 2023-01-26 06:28:03 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:55.299: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:55.299: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:55.299: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:55.299: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-tt42n started at 2023-01-26 06:34:30 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:55.299: INFO: httpd started at 2023-01-26 06:39:40 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container httpd ready: false, restart count 0 Jan 26 06:43:55.299: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-47vr6 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:55.299: INFO: ss-2 started at 2023-01-26 06:43:19 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:55.299: INFO: hostpath-symlink-prep-provisioning-3425 started at 2023-01-26 06:38:58 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container init-volume-provisioning-3425 ready: false, restart count 0 Jan 26 06:43:55.299: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-b4l5j started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:55.299: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-v96fn started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:55.299: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-56mcl started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:55.299: INFO: netserver-3 started at 2023-01-26 06:39:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container webserver ready: false, restart count 0 Jan 26 06:43:55.299: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-6prmp started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:55.299: INFO: csi-mockplugin-attacher-0 started at 2023-01-26 06:43:27 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container csi-attacher ready: false, restart count 0 Jan 26 06:43:55.299: INFO: cilium-w5n9v started at 2023-01-26 06:28:03 +0000 UTC (1+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:43:55.299: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:43:55.299: INFO: csi-mockplugin-0 started at 2023-01-26 06:43:27 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:55.299: INFO: Container csi-provisioner ready: false, restart count 0 Jan 26 06:43:55.299: INFO: Container driver-registrar ready: false, restart count 0 Jan 26 06:43:55.299: INFO: Container mock ready: false, restart count 0 Jan 26 06:43:55.299: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-bzv56 started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:55.299: INFO: cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e-8jm8h started at 2023-01-26 06:34:31 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:55.299: INFO: Container cleanup40-4adf54ee-232d-4556-a2e1-7edd94946d1e ready: true, restart count 0 Jan 26 06:43:55.748: INFO: Latency metrics for node i-07dd0af9495bd7a2d Jan 26 06:43:55.748: INFO: Logging node info for node i-089a9e95df3068b0a Jan 26 06:43:55.855: INFO: Node Info: &Node{ObjectMeta:{i-089a9e95df3068b0a 35816ce0-3668-4f6e-a8fd-15fd2906316c 16996 0 2023-01-26 06:25:46 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:eu-west-1 failure-domain.beta.kubernetes.io/zone:eu-west-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-089a9e95df3068b0a kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:eu-west-1a topology.kubernetes.io/region:eu-west-1 topology.kubernetes.io/zone:eu-west-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.36.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-089a9e95df3068b0a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-26 06:25:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-26 06:26:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-26 06:26:53 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kube-controller-manager Update v1 2023-01-26 06:27:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}},"f:taints":{}}} } {kubelet Update v1 2023-01-26 06:43:48 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///eu-west-1a/i-089a9e95df3068b0a,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862937600 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758080000 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-26 06:43:48 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-26 06:43:48 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-26 06:43:48 +0000 UTC,LastTransitionTime:2023-01-26 06:25:46 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-26 06:43:48 +0000 UTC,LastTransitionTime:2023-01-26 06:27:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.36.54,},NodeAddress{Type:ExternalIP,Address:18.203.178.61,},NodeAddress{Type:InternalDNS,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-089a9e95df3068b0a.eu-west-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-18-203-178-61.eu-west-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec270b473b916bebdc318bfa0f9b1a87,SystemUUID:ec270b47-3b91-6beb-dc31-8bfa0f9b1a87,BootID:b319d8a4-ba87-403c-8d6a-5778dcb9a28c,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:6f72b851544986cb0921b53ea655ec04c36131248f16d4ad110cb3ca0c369dc1 registry.k8s.io/etcd:3.5.4-0],SizeBytes:102157811,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:13f53ed1d91e2e11aac476ee9a0269fdda6cc4874eba903efd40daf50c55eee5 registry.k8s.io/etcd:3.5.3-0],SizeBytes:102143581,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4afb99b4690b418ffc2ceb67e1a17376457e441c1f09ab55447f0aaf992fa646 registry.k8s.io/etcd:3.4.3-0],SizeBytes:100947667,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:9ce33ba33d8e738a5b85ed50b5080ac746deceed4a7496c550927a7a19ca3b6d registry.k8s.io/etcd:3.5.0-0],SizeBytes:99868722,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:64b9ea357325d5db9f8a723dcf503b5a449177b17ac87d69481e126bb724c263 registry.k8s.io/etcd:3.5.1-0],SizeBytes:98888614,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:4ad90a11b55313b182afc186b9876c8e891531b8db4c9bf1541953021618d0e2 registry.k8s.io/etcd:3.4.13-0],SizeBytes:86742272,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:0d2ab6b15b4fe0b903b9e81192d942fb39c29be61fe341cd16db5d0165b0435c registry.k8s.io/etcd:3.3.17-0],SizeBytes:85524408,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 registry.k8s.io/etcd:3.3.10-0],SizeBytes:76162358,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:81677375343460c8b223d5217ed2ee037d2578b470b3260637a735f57e5bdf04 registry.k8s.io/etcdadm/etcd-manager:v3.0.20230119-slim],SizeBytes:63920476,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:905d7ca17fd02bc24c0eba9a062753aba15db3e31422390bc3238eb762339b20 registry.k8s.io/etcd:3.2.24-1],SizeBytes:63423287,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:44339051,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841311,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965809,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 26 06:43:55.855: INFO: Logging kubelet events for node i-089a9e95df3068b0a Jan 26 06:43:55.965: INFO: Logging pods the kubelet thinks is on node i-089a9e95df3068b0a Jan 26 06:43:56.079: INFO: etcd-manager-events-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded) Jan 26 06:43:56.079: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Container etcd-manager ready: true, restart count 0 Jan 26 06:43:56.079: INFO: kube-apiserver-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+2 container statuses recorded) Jan 26 06:43:56.079: INFO: Container healthcheck ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Container kube-apiserver ready: true, restart count 2 Jan 26 06:43:56.079: INFO: kube-scheduler-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:56.079: INFO: Container kube-scheduler ready: true, restart count 0 Jan 26 06:43:56.079: INFO: cilium-8rnxh started at 2023-01-26 06:26:49 +0000 UTC (1+1 container statuses recorded) Jan 26 06:43:56.079: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Container cilium-agent ready: true, restart count 0 Jan 26 06:43:56.079: INFO: ebs-csi-node-62mcc started at 2023-01-26 06:26:49 +0000 UTC (0+3 container statuses recorded) Jan 26 06:43:56.079: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 26 06:43:56.079: INFO: dns-controller-69987775c6-9h2dj started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:56.079: INFO: Container dns-controller ready: true, restart count 0 Jan 26 06:43:56.079: INFO: etcd-manager-main-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (10+1 container statuses recorded) Jan 26 06:43:56.079: INFO: Init container init-etcd-3-2-24 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-3-10 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-3-17 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-4-13 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-4-3 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-5-0 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-5-1 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-5-3 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-5-4 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Init container init-etcd-3-5-6 ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Container etcd-manager ready: true, restart count 0 Jan 26 06:43:56.079: INFO: kube-controller-manager-i-089a9e95df3068b0a started at 2023-01-26 06:24:21 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:56.079: INFO: Container kube-controller-manager ready: true, restart count 4 Jan 26 06:43:56.079: INFO: kops-controller-nkbt7 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:56.079: INFO: Container kops-controller ready: true, restart count 0 Jan 26 06:43:56.079: INFO: aws-cloud-controller-manager-xz4hv started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:56.079: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 26 06:43:56.079: INFO: cilium-operator-5dd44dc49f-2h9f5 started at 2023-01-26 06:26:49 +0000 UTC (0+1 container statuses recorded) Jan 26 06:43:56.079: INFO: Container cilium-operator ready: true, restart count 0 Jan 26 06:43:56.079: INFO: ebs-csi-controller-5bd98b456f-zpvmp started at 2023-01-26 06:26:49 +0000 UTC (0+5 container statuses recorded) Jan 26 06:43:56.079: INFO: Container csi-attacher ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Container csi-provisioner ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Container csi-resizer ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Container ebs-plugin ready: true, restart count 0 Jan 26 06:43:56.079: INFO: Container liveness-probe ready: true, restart count 0 Jan 26 06:43:56.462: INFO: Latency metrics for node i-089a9e95df3068b0a [DeferCleanup (Each)] [sig-node] Probing container tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "container-probe-9116" for this suite. �[38;5;243m01/26/23 06:43:56.462�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sSecurity\sContext\sWhen\screating\sa\scontainer\swith\srunAsNonRoot\sshould\srun\swith\san\sexplicit\snon\-root\suser\sID\s\[LinuxOnly\]$'
test/e2e/framework/pod/pod_client.go:240
k8s.io/kubernetes/test/e2e/framework/pod.(*PodClient).WaitForSuccess(0xc0002a6960?, {0x7605552, 0x14}, 0x2e?)
test/e2e/framework/pod/pod_client.go:240 +0x1f1
k8s.io/kubernetes/test/e2e/common/node.glob..func21.4.2()
test/e2e/common/node/security_context.go:395 +0xd9
Full failure message:
Jan 26 06:43:42.937: wait for pod "explicit-nonroot-uid" to succeed
Expected success, but got an error:
<*pod.timeoutError | 0xc0049acba0>: {
msg: "timed out while waiting for pod security-context-test-8886/explicit-nonroot-uid to be Succeeded or Failed",
observedObjects: [
<*v1.Pod | 0xc003624900>{
TypeMeta: {Kind: "", APIVersion: ""},
ObjectMeta: {
Name: "explicit-nonroot-uid",
GenerateName: "",
Namespace: "security-context-test-8886",
SelfLink: "",
UID: "7