Result | FAILURE |
Tests | 18 failed / 869 succeeded |
Started | |
Elapsed | 38m57s |
Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(OnRootMismatch\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\svolume\scontents\sownership\schanged\svia\schgrp\sin\sfirst\spod\,\snew\spod\swith\ssame\sfsgroup\sskips\sownership\schanges\sto\sthe\svolume\scontents$'
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc00165cf00, 0xc004843e10, 0x1, {0x0, 0x0}, {0x0, 0x0}) test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151 k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3() test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298from junit_01.xml
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy test/e2e/storage/framework/testsuite.go:51 [BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/06/23 06:36:37.282�[0m Jan 6 06:36:37.282: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename fsgroupchangepolicy �[38;5;243m01/06/23 06:36:37.283�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/06/23 06:36:37.378�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/06/23 06:36:37.438�[0m [BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy test/e2e/framework/metrics/init/init.go:31 [It] (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed via chgrp in first pod, new pod with same fsgroup skips ownership changes to the volume contents test/e2e/storage/testsuites/fsgroupchangepolicy.go:210 Jan 6 06:36:37.499: INFO: Creating resource for dynamic PV Jan 6 06:36:37.499: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} �[1mSTEP:�[0m creating a StorageClass fsgroupchangepolicy-8508-e2e-scnwx7l �[38;5;243m01/06/23 06:36:37.499�[0m �[1mSTEP:�[0m creating a claim �[38;5;243m01/06/23 06:36:37.531�[0m Jan 6 06:36:37.531: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil �[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-8508 with fsgroup 1000 �[38;5;243m01/06/23 06:36:37.596�[0m Jan 6 06:36:37.629: INFO: Waiting up to 5m0s for pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de" in namespace "fsgroupchangepolicy-8508" to be "running" Jan 6 06:36:37.660: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 31.029437ms Jan 6 06:36:39.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062613103s Jan 6 06:36:41.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4.063678815s Jan 6 06:36:43.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 6.062366011s Jan 6 06:36:45.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 8.062257919s Jan 6 06:36:47.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 10.062849293s Jan 6 06:36:49.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 12.063387018s Jan 6 06:36:51.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 14.062227744s Jan 6 06:36:53.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 16.062604545s Jan 6 06:36:55.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 18.062232235s Jan 6 06:36:57.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 20.062471437s Jan 6 06:36:59.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 22.062542714s Jan 6 06:37:01.691: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 24.062087975s Jan 6 06:37:03.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 26.0630518s Jan 6 06:37:05.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 28.063805816s Jan 6 06:37:07.694: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 30.064948796s Jan 6 06:37:09.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 32.063388826s Jan 6 06:37:11.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 34.062894829s Jan 6 06:37:13.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 36.063023611s Jan 6 06:37:15.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 38.063218111s Jan 6 06:37:17.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 40.062838427s Jan 6 06:37:19.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 42.062351072s Jan 6 06:37:21.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 44.063296338s Jan 6 06:37:23.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 46.062865299s Jan 6 06:37:25.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 48.062324583s Jan 6 06:37:27.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 50.062848214s Jan 6 06:37:29.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 52.062861921s Jan 6 06:37:31.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 54.062374366s Jan 6 06:37:33.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 56.062576695s Jan 6 06:37:35.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 58.062797832s Jan 6 06:37:37.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.062538187s Jan 6 06:37:39.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.062391536s Jan 6 06:37:41.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.06263195s Jan 6 06:37:43.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.063546158s Jan 6 06:37:45.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.062837855s Jan 6 06:37:47.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.063008984s Jan 6 06:37:49.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.062615132s Jan 6 06:37:51.694: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.064508699s Jan 6 06:37:53.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.06324086s Jan 6 06:37:55.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.063372546s Jan 6 06:37:57.691: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.062020941s Jan 6 06:37:59.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.063013079s Jan 6 06:38:01.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.063181107s Jan 6 06:38:03.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.062698255s Jan 6 06:38:05.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.062580535s Jan 6 06:38:07.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.062421378s Jan 6 06:38:09.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.06251602s Jan 6 06:38:11.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.062924554s Jan 6 06:38:13.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.062930242s Jan 6 06:38:15.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.063023834s Jan 6 06:38:17.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.063055091s Jan 6 06:38:19.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.062759257s Jan 6 06:38:21.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.06266879s Jan 6 06:38:23.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.06266924s Jan 6 06:38:25.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.063029911s Jan 6 06:38:27.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.063163994s Jan 6 06:38:29.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.062786203s Jan 6 06:38:31.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.062714373s Jan 6 06:38:33.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.062754252s Jan 6 06:38:35.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.063147136s Jan 6 06:38:37.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.063033931s Jan 6 06:38:39.694: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.064725604s Jan 6 06:38:41.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.062813138s Jan 6 06:38:43.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.062562916s Jan 6 06:38:45.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.063280625s Jan 6 06:38:47.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.06243167s Jan 6 06:38:49.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.062487761s Jan 6 06:38:51.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.062792684s Jan 6 06:38:53.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.062808546s Jan 6 06:38:55.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.062992016s Jan 6 06:38:57.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.062971497s Jan 6 06:38:59.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.063049966s Jan 6 06:39:01.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.063336172s Jan 6 06:39:03.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.063040768s Jan 6 06:39:05.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.06300504s Jan 6 06:39:07.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.062808035s Jan 6 06:39:09.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.062862697s Jan 6 06:39:11.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.062763593s Jan 6 06:39:13.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.062497526s Jan 6 06:39:15.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.063130173s Jan 6 06:39:17.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.062822311s Jan 6 06:39:19.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.062731683s Jan 6 06:39:21.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.062799808s Jan 6 06:39:23.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.062336435s Jan 6 06:39:25.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.062500002s Jan 6 06:39:27.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.062870473s Jan 6 06:39:29.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.062364826s Jan 6 06:39:31.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.062511192s Jan 6 06:39:33.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.062539492s Jan 6 06:39:35.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.062980083s Jan 6 06:39:37.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.062339032s Jan 6 06:39:39.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.062321277s Jan 6 06:39:41.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.062489556s Jan 6 06:39:43.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.062844769s Jan 6 06:39:45.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.062809063s Jan 6 06:39:47.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.06262888s Jan 6 06:39:49.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.062556065s Jan 6 06:39:51.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.062571806s Jan 6 06:39:53.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.063138831s Jan 6 06:39:55.691: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.062182067s Jan 6 06:39:57.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.063527518s Jan 6 06:39:59.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.062909366s Jan 6 06:40:01.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.063109863s Jan 6 06:40:03.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.063223072s Jan 6 06:40:05.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.062828819s Jan 6 06:40:07.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.062559206s Jan 6 06:40:09.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.062953016s Jan 6 06:40:11.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.062495467s Jan 6 06:40:13.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.062817921s Jan 6 06:40:15.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.063089074s Jan 6 06:40:17.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.063128403s Jan 6 06:40:19.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.062853425s Jan 6 06:40:21.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.06262581s Jan 6 06:40:23.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.062877927s Jan 6 06:40:25.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.062598294s Jan 6 06:40:27.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.062792727s Jan 6 06:40:29.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.062716093s Jan 6 06:40:31.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.062564257s Jan 6 06:40:33.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.062841986s Jan 6 06:40:35.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.063042752s Jan 6 06:40:37.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.062821117s Jan 6 06:40:39.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.062759498s Jan 6 06:40:41.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.062695077s Jan 6 06:40:43.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.063160279s Jan 6 06:40:45.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.062255947s Jan 6 06:40:47.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.062990189s Jan 6 06:40:49.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.062838225s Jan 6 06:40:51.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.062921221s Jan 6 06:40:53.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.062921024s Jan 6 06:40:55.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.063018323s Jan 6 06:40:57.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.062907955s Jan 6 06:40:59.691: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.061907165s Jan 6 06:41:01.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.063911174s Jan 6 06:41:03.694: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.065099931s Jan 6 06:41:05.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.063627086s Jan 6 06:41:07.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.063045426s Jan 6 06:41:09.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.063000828s Jan 6 06:41:11.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.062748663s Jan 6 06:41:13.694: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.064475974s Jan 6 06:41:15.693: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.063447102s Jan 6 06:41:17.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.062688664s Jan 6 06:41:19.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.062640256s Jan 6 06:41:21.691: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.062144735s Jan 6 06:41:23.694: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.064268692s Jan 6 06:41:25.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.062766133s Jan 6 06:41:27.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.062402531s Jan 6 06:41:29.691: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.062155181s Jan 6 06:41:31.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.062634344s Jan 6 06:41:33.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.062746952s Jan 6 06:41:35.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.062670914s Jan 6 06:41:37.692: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.06265698s Jan 6 06:41:37.724: INFO: Pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.094713775s Jan 6 06:41:37.724: INFO: Unexpected error: <*errors.errorString | 0xc000e0c920>: { s: "pod \"pod-a782d690-ad63-4815-a2c4-dad0d0dd28de\" is not Running: timed out while waiting for pod fsgroupchangepolicy-8508/pod-a782d690-ad63-4815-a2c4-dad0d0dd28de to be running", } Jan 6 06:41:37.724: FAIL: pod "pod-a782d690-ad63-4815-a2c4-dad0d0dd28de" is not Running: timed out while waiting for pod fsgroupchangepolicy-8508/pod-a782d690-ad63-4815-a2c4-dad0d0dd28de to be running Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc00165cf00, 0xc004843e10, 0x1, {0x0, 0x0}, {0x0, 0x0}) test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151 k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3() test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298 �[1mSTEP:�[0m Deleting pvc �[38;5;243m01/06/23 06:41:37.724�[0m Jan 6 06:41:37.787: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comxb9r8" Jan 6 06:41:37.821: INFO: Waiting up to 5m0s for PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e to get deleted Jan 6 06:41:37.852: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (30.990566ms) Jan 6 06:41:42.884: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (5.063028283s) Jan 6 06:41:47.916: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (10.094901909s) Jan 6 06:41:52.948: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (15.126761718s) Jan 6 06:41:57.980: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (20.15851967s) Jan 6 06:42:03.011: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (25.189966982s) Jan 6 06:42:08.043: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (30.221752752s) Jan 6 06:42:13.074: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (35.252948989s) Jan 6 06:42:18.106: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (40.285251608s) Jan 6 06:42:23.138: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (45.316991715s) Jan 6 06:42:28.170: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (50.348474148s) Jan 6 06:42:33.202: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (55.380695811s) Jan 6 06:42:38.233: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m0.411886006s) Jan 6 06:42:43.265: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m5.444262349s) Jan 6 06:42:48.297: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m10.475508146s) Jan 6 06:42:53.328: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m15.507127479s) Jan 6 06:42:58.360: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m20.538540218s) Jan 6 06:43:03.392: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m25.57107929s) Jan 6 06:43:08.430: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m30.608451764s) Jan 6 06:43:13.461: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m35.640080645s) Jan 6 06:43:18.494: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m40.672441958s) Jan 6 06:43:23.526: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m45.704715213s) Jan 6 06:43:28.559: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m50.737616469s) Jan 6 06:43:33.590: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (1m55.769255134s) Jan 6 06:43:38.622: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m0.801285159s) Jan 6 06:43:43.654: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m5.832580086s) Jan 6 06:43:48.686: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m10.864763613s) Jan 6 06:43:53.730: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m15.908732602s) Jan 6 06:43:58.763: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m20.941422713s) Jan 6 06:44:03.795: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m25.973781331s) Jan 6 06:44:08.827: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m31.00638955s) Jan 6 06:44:13.859: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m36.038388619s) Jan 6 06:44:18.891: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m41.069649563s) Jan 6 06:44:23.925: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m46.103553739s) Jan 6 06:44:28.956: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m51.13488112s) Jan 6 06:44:33.988: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (2m56.166923445s) Jan 6 06:44:39.021: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m1.199673242s) Jan 6 06:44:44.052: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m6.231042858s) Jan 6 06:44:49.084: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m11.263026201s) Jan 6 06:44:54.116: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m16.294910756s) Jan 6 06:44:59.148: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m21.327151503s) Jan 6 06:45:04.180: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m26.358956317s) Jan 6 06:45:09.211: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m31.390271921s) Jan 6 06:45:14.245: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m36.423486115s) Jan 6 06:45:19.277: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m41.455674057s) Jan 6 06:45:24.309: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m46.487959008s) Jan 6 06:45:29.341: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m51.519586749s) Jan 6 06:45:34.381: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (3m56.559762483s) Jan 6 06:45:39.413: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m1.592159998s) Jan 6 06:45:44.445: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m6.623940733s) Jan 6 06:45:49.481: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m11.659493746s) Jan 6 06:45:54.512: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m16.691293625s) Jan 6 06:45:59.544: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m21.722873139s) Jan 6 06:46:04.576: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m26.755301122s) Jan 6 06:46:09.608: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m31.786497994s) Jan 6 06:46:14.639: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m36.818360011s) Jan 6 06:46:19.672: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m41.850467908s) Jan 6 06:46:24.704: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m46.882631924s) Jan 6 06:46:29.736: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m51.914721385s) Jan 6 06:46:34.769: INFO: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e found and phase=Bound (4m56.948251925s) �[1mSTEP:�[0m Deleting sc �[38;5;243m01/06/23 06:46:39.77�[0m Jan 6 06:46:39.804: INFO: Unexpected error: while cleanup resource: <errors.aggregate | len:1, cap:1>: [ <errors.aggregate | len:1, cap:1>[ <*fmt.wrapError | 0xc003424000>{ msg: "persistent Volume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e not deleted by dynamic provisioner: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e still exists within 5m0s", err: <*errors.errorString | 0xc000b3a030>{ s: "PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e still exists within 5m0s", }, }, ], ] Jan 6 06:46:39.804: FAIL: while cleanup resource: persistent Volume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e not deleted by dynamic provisioner: PersistentVolume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e still exists within 5m0s Full Stack Trace k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2() test/e2e/storage/testsuites/fsgroupchangepolicy.go:128 +0x14e panic({0x70eb680, 0xc0006e32d0}) /usr/local/go/src/runtime/panic.go:884 +0x212 k8s.io/kubernetes/test/e2e/framework.Fail({0xc0019f4000, 0xae}, {0xc003ec1c30?, 0xc0019f4000?, 0xc003ec1c58?}) test/e2e/framework/log.go:61 +0x145 k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7fa4200, 0xc000e0c920}, {0x0?, 0x2?, 0x7fa403733f18?}) test/e2e/framework/expect.go:76 +0x267 k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...) test/e2e/framework/expect.go:43 k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc00165cf00, 0xc004843e10, 0x1, {0x0, 0x0}, {0x0, 0x0}) test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151 k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3() test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298 [AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy test/e2e/framework/node/init/init.go:32 Jan 6 06:46:39.805: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/06/23 06:46:39.838�[0m �[1mSTEP:�[0m Collecting events from namespace "fsgroupchangepolicy-8508". �[38;5;243m01/06/23 06:46:39.838�[0m �[1mSTEP:�[0m Found 16 events. �[38;5;243m01/06/23 06:46:39.869�[0m Jan 6 06:46:39.869: INFO: At 2023-01-06 06:36:37 +0000 UTC - event for ebs.csi.aws.comxb9r8: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding Jan 6 06:46:39.869: INFO: At 2023-01-06 06:36:37 +0000 UTC - event for ebs.csi.aws.comxb9r8: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator Jan 6 06:46:39.869: INFO: At 2023-01-06 06:36:37 +0000 UTC - event for ebs.csi.aws.comxb9r8: {ebs.csi.aws.com_ebs-csi-controller-89b649c94-slv9n_96bd1433-cf64-485c-b5d2-941bd7a85edb } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-8508/ebs.csi.aws.comxb9r8" Jan 6 06:46:39.869: INFO: At 2023-01-06 06:36:40 +0000 UTC - event for ebs.csi.aws.comxb9r8: {ebs.csi.aws.com_ebs-csi-controller-89b649c94-slv9n_96bd1433-cf64-485c-b5d2-941bd7a85edb } ProvisioningSucceeded: Successfully provisioned volume pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e Jan 6 06:46:39.869: INFO: At 2023-01-06 06:36:41 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {default-scheduler } Scheduled: Successfully assigned fsgroupchangepolicy-8508/pod-a782d690-ad63-4815-a2c4-dad0d0dd28de to i-00e2a3416f09a146a Jan 6 06:46:39.869: INFO: At 2023-01-06 06:36:43 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-6551fe3e-7dd5-42c0-ae68-9dac0cb4067e" Jan 6 06:46:39.869: INFO: At 2023-01-06 06:36:44 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c21ea85346cbeb616a87fd634c1e5b3104c1b23e790e74eaeb734e1823e4b741": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:46:39.869: INFO: At 2023-01-06 06:36:56 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9ff9505884830489870109a70f865e80e5c487269e96e4675310f99eed7f5c52": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:46:39.869: INFO: At 2023-01-06 06:37:10 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "74435f49e76a7152b8528e7fc0cfbaa01a9f42b9afe6b8bc76bf25f6781f7245": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:46:39.869: INFO: At 2023-01-06 06:37:21 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "382bf111d67e5651c0524e539daab8500990e984ee7ff9a349ad80d8320ddfc5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:46:39.869: INFO: At 2023-01-06 06:37:32 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7f69ea8ae0086a58167b84ab4cb9fe54638e6d414996ebe7c04f1ec3795cf02c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:46:39.869: INFO: At 2023-01-06 06:37:45 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f7113399d2951bff9b191d0b8c5b8913204bcfa2a2812cdee832c6a77241737b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:46:39.869: INFO: At 2023-01-06 06:37:56 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fe993d24999f2ee4f940efea9cf3a5c36d680885ac297ace86a9f5be3af033d6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:46:39.869: INFO: At 2023-01-06 06:38:08 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "531dd47fb4839e09890cb8fa56953ad5f79a316f8dd7da574dcec317da8294b6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:46:39.869: INFO: At 2023-01-06 06:38:23 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2449bd1c85efe61a9841fcbbbf841cd7c43731fb7728c9af89d3dbf0f92e5c8b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:46:39.869: INFO: At 2023-01-06 06:38:35 +0000 UTC - event for pod-a782d690-ad63-4815-a2c4-dad0d0dd28de: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3ee0e1f14223aa3092c24eb21c05ac57fd7890a57c4a4a67ae00eab697475968": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:46:39.902: INFO: POD NODE PHASE GRACE CONDITIONS Jan 6 06:46:39.902: INFO: pod-a782d690-ad63-4815-a2c4-dad0d0dd28de i-00e2a3416f09a146a Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:41 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:43:08 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:43:08 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:41 +0000 UTC }] Jan 6 06:46:39.902: INFO: Jan 6 06:46:39.979: INFO: Logging node info for node i-00e2a3416f09a146a Jan 6 06:46:40.010: INFO: Node Info: &Node{ObjectMeta:{i-00e2a3416f09a146a 8b86fb5a-68fd-4aec-8591-934be54479d5 32359 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00e2a3416f09a146a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-00e2a3416f09a146a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.186 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-9818":"i-00e2a3416f09a146a","ebs.csi.aws.com":"i-00e2a3416f09a146a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-06 06:46:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-06 06:46:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00e2a3416f09a146a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:34 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:34 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:34 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:46:34 +0000 UTC,LastTransitionTime:2023-01-06 06:25:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.186,},NodeAddress{Type:ExternalIP,Address:3.97.12.121,},NodeAddress{Type:InternalDNS,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-97-12-121.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2895effafa575efe2674497633226d,SystemUUID:ec2895ef-fafa-575e-fe26-74497633226d,BootID:79823d62-e8bb-4de7-91b6-78fb8137f2da,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-9818^d6d99c3b-8d8d-11ed-8772-9e3a9b7376f1 kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99 kubernetes.io/csi/ebs.csi.aws.com^vol-08b08684602e466c1 kubernetes.io/csi/ebs.csi.aws.com^vol-09f2b196bc778eb4f],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-9818^d6d99c3b-8d8d-11ed-8772-9e3a9b7376f1,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-09f2b196bc778eb4f,DevicePath:,},},Config:nil,},} Jan 6 06:46:40.010: INFO: Logging kubelet events for node i-00e2a3416f09a146a Jan 6 06:46:40.045: INFO: Logging pods the kubelet thinks is on node i-00e2a3416f09a146a Jan 6 06:46:40.112: INFO: csi-mockplugin-0 started at 2023-01-06 06:45:43 +0000 UTC (0+3 container statuses recorded) Jan 6 06:46:40.112: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:46:40.112: INFO: Container driver-registrar ready: true, restart count 0 Jan 6 06:46:40.112: INFO: Container mock ready: true, restart count 0 Jan 6 06:46:40.112: INFO: ebs-csi-node-w4gks started at 2023-01-06 06:25:38 +0000 UTC (0+3 container statuses recorded) Jan 6 06:46:40.112: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:46:40.112: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:46:40.112: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:46:40.112: INFO: pod-a782d690-ad63-4815-a2c4-dad0d0dd28de started at 2023-01-06 06:36:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.112: INFO: Container write-pod ready: true, restart count 0 Jan 6 06:46:40.112: INFO: external-injector started at 2023-01-06 06:46:32 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.112: INFO: Container external-injector ready: true, restart count 0 Jan 6 06:46:40.112: INFO: test-grpc-6bc53043-59dc-4cdf-a7f0-c72c0a545617 started at 2023-01-06 06:46:26 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.112: INFO: Container etcd ready: true, restart count 0 Jan 6 06:46:40.112: INFO: netserver-0 started at 2023-01-06 06:46:35 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.112: INFO: Container webserver ready: false, restart count 0 Jan 6 06:46:40.112: INFO: pod-ephm-test-projected-zswd started at 2023-01-06 06:46:29 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.112: INFO: Container test-container-subpath-projected-zswd ready: false, restart count 0 Jan 6 06:46:40.112: INFO: affinity-clusterip-rfdtt started at 2023-01-06 06:46:31 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.112: INFO: Container affinity-clusterip ready: true, restart count 0 Jan 6 06:46:40.112: INFO: csi-mockplugin-resizer-0 started at 2023-01-06 06:45:43 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.112: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:46:40.112: INFO: csi-mockplugin-attacher-0 started at 2023-01-06 06:45:43 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.112: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:46:40.112: INFO: pod-subpath-test-dynamicpv-hhd5 started at 2023-01-06 06:46:26 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.112: INFO: Container test-container-subpath-dynamicpv-hhd5 ready: false, restart count 0 Jan 6 06:46:40.112: INFO: cilium-4tnhd started at 2023-01-06 06:25:38 +0000 UTC (1+1 container statuses recorded) Jan 6 06:46:40.112: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:46:40.112: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:46:40.112: INFO: pvc-volume-tester-v68cl started at 2023-01-06 06:46:27 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.112: INFO: Container volume-tester ready: false, restart count 0 Jan 6 06:46:40.425: INFO: Latency metrics for node i-00e2a3416f09a146a Jan 6 06:46:40.425: INFO: Logging node info for node i-038260c95b7cbf8dd Jan 6 06:46:40.457: INFO: Node Info: &Node{ObjectMeta:{i-038260c95b7cbf8dd ba495758-87ae-4472-b9d2-10e6fd017588 32202 0 2023-01-06 06:25:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-038260c95b7cbf8dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-038260c95b7cbf8dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.153 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-9263":"csi-mock-csi-mock-volumes-9263","ebs.csi.aws.com":"i-038260c95b7cbf8dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-06 06:46:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-038260c95b7cbf8dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:32 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:32 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:32 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:46:32 +0000 UTC,LastTransitionTime:2023-01-06 06:26:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.153,},NodeAddress{Type:ExternalIP,Address:35.183.20.213,},NodeAddress{Type:InternalDNS,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-183-20-213.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dcb30d66cfec0075096c81f360304,SystemUUID:ec2dcb30-d66c-fec0-0750-96c81f360304,BootID:d74ef702-20db-4c1a-ac66-e72d9b82565b,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:46:40.457: INFO: Logging kubelet events for node i-038260c95b7cbf8dd Jan 6 06:46:40.490: INFO: Logging pods the kubelet thinks is on node i-038260c95b7cbf8dd Jan 6 06:46:40.531: INFO: cilium-9n89s started at 2023-01-06 06:25:58 +0000 UTC (1+1 container statuses recorded) Jan 6 06:46:40.531: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:46:40.531: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:46:40.531: INFO: pod-terminate-status-2-4 started at <nil> (0+0 container statuses recorded) Jan 6 06:46:40.531: INFO: ebs-csi-node-bds8q started at 2023-01-06 06:25:58 +0000 UTC (0+3 container statuses recorded) Jan 6 06:46:40.531: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:46:40.531: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:46:40.531: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:46:40.531: INFO: affinity-clusterip-2zxmx started at 2023-01-06 06:46:31 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.531: INFO: Container affinity-clusterip ready: true, restart count 0 Jan 6 06:46:40.531: INFO: pod-terminate-status-1-3 started at <nil> (0+0 container statuses recorded) Jan 6 06:46:40.531: INFO: pod-host-path-test started at <nil> (0+0 container statuses recorded) Jan 6 06:46:40.531: INFO: coredns-559769c974-tj9mr started at 2023-01-06 06:26:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.531: INFO: Container coredns ready: true, restart count 0 Jan 6 06:46:40.531: INFO: busybox-25e303f3-1125-4656-a63d-d570155a7dd2 started at 2023-01-06 06:46:22 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.531: INFO: Container busybox ready: true, restart count 0 Jan 6 06:46:40.531: INFO: csi-mockplugin-0 started at 2023-01-06 06:45:42 +0000 UTC (0+4 container statuses recorded) Jan 6 06:46:40.531: INFO: Container busybox ready: true, restart count 0 Jan 6 06:46:40.531: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:46:40.531: INFO: Container driver-registrar ready: true, restart count 0 Jan 6 06:46:40.531: INFO: Container mock ready: true, restart count 0 Jan 6 06:46:40.531: INFO: netserver-1 started at <nil> (0+0 container statuses recorded) Jan 6 06:46:40.531: INFO: busybox-04228b56-ea9a-4c7e-933b-5fea0270aa34 started at 2023-01-06 06:46:34 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.531: INFO: Container busybox ready: false, restart count 0 Jan 6 06:46:40.735: INFO: Latency metrics for node i-038260c95b7cbf8dd Jan 6 06:46:40.735: INFO: Logging node info for node i-03c3347a40904af85 Jan 6 06:46:40.766: INFO: Node Info: &Node{ObjectMeta:{i-03c3347a40904af85 acf58f94-6029-4390-a68e-e4dc4881fbb2 32594 0 2023-01-06 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03c3347a40904af85 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-03c3347a40904af85 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.54 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-6384":"i-03c3347a40904af85","ebs.csi.aws.com":"i-03c3347a40904af85"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-06 06:46:38 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-01-06 06:46:40 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-03c3347a40904af85,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:31 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:31 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:31 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:46:31 +0000 UTC,LastTransitionTime:2023-01-06 06:26:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.54,},NodeAddress{Type:ExternalIP,Address:15.223.65.129,},NodeAddress{Type:InternalDNS,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-223-65-129.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be680388baaf810ad9be3463c2150,SystemUUID:ec2be680-388b-aaf8-10ad-9be3463c2150,BootID:e07e85b2-353d-46e6-bf6b-941e6e0ae86a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-6384^df788cda-8d8d-11ed-9ae5-aac044e6b1b1,DevicePath:,},},Config:nil,},} Jan 6 06:46:40.766: INFO: Logging kubelet events for node i-03c3347a40904af85 Jan 6 06:46:40.801: INFO: Logging pods the kubelet thinks is on node i-03c3347a40904af85 Jan 6 06:46:40.838: INFO: affinity-clusterip-t2zgq started at 2023-01-06 06:46:31 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.838: INFO: Container affinity-clusterip ready: false, restart count 0 Jan 6 06:46:40.838: INFO: liveness-3ad13e77-8d0b-4ffd-a4a6-a6ecf657a9fa started at 2023-01-06 06:45:42 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.838: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:46:40.838: INFO: csi-mockplugin-0 started at <nil> (0+0 container statuses recorded) Jan 6 06:46:40.839: INFO: foo-xbk99 started at 2023-01-06 06:45:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.839: INFO: Container c ready: true, restart count 0 Jan 6 06:46:40.839: INFO: netserver-2 started at <nil> (0+0 container statuses recorded) Jan 6 06:46:40.839: INFO: pvc-volume-tester-ft5q7 started at <nil> (0+0 container statuses recorded) Jan 6 06:46:40.839: INFO: service-headless-toggled-zqv5x started at 2023-01-06 06:45:15 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.839: INFO: Container service-headless-toggled ready: true, restart count 0 Jan 6 06:46:40.839: INFO: rc-test-w9dl2 started at 2023-01-06 06:46:32 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.839: INFO: Container rc-test ready: false, restart count 0 Jan 6 06:46:40.839: INFO: cilium-ww8tr started at 2023-01-06 06:26:09 +0000 UTC (1+1 container statuses recorded) Jan 6 06:46:40.839: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:46:40.839: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:46:40.839: INFO: ebs-csi-node-lvpjv started at 2023-01-06 06:26:09 +0000 UTC (0+3 container statuses recorded) Jan 6 06:46:40.839: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:46:40.839: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:46:40.839: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:46:40.839: INFO: pfpod started at 2023-01-06 06:46:03 +0000 UTC (0+2 container statuses recorded) Jan 6 06:46:40.839: INFO: Container portforwardtester ready: false, restart count 0 Jan 6 06:46:40.839: INFO: Container readiness ready: true, restart count 0 Jan 6 06:46:40.839: INFO: agnhost started at 2023-01-06 06:46:27 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.839: INFO: Container agnhost ready: true, restart count 0 Jan 6 06:46:40.839: INFO: csi-mockplugin-attacher-0 started at <nil> (0+0 container statuses recorded) Jan 6 06:46:40.839: INFO: replace-27883126-8lt5v started at 2023-01-06 06:46:00 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.839: INFO: Container c ready: true, restart count 0 Jan 6 06:46:40.839: INFO: pod-ephm-test-configmap-pmcg started at 2023-01-06 06:45:27 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.839: INFO: Container test-container-subpath-configmap-pmcg ready: false, restart count 0 Jan 6 06:46:40.839: INFO: foo-h2lhx started at 2023-01-06 06:45:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.839: INFO: Container c ready: true, restart count 0 Jan 6 06:46:40.839: INFO: service-headless-rc6hv started at 2023-01-06 06:45:09 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:40.839: INFO: Container service-headless ready: true, restart count 0 Jan 6 06:46:40.839: INFO: csi-mockplugin-resizer-0 started at <nil> (0+0 container statuses recorded) Jan 6 06:46:41.037: INFO: Latency metrics for node i-03c3347a40904af85 Jan 6 06:46:41.037: INFO: Logging node info for node i-04cab7fc0ec1601e6 Jan 6 06:46:41.069: INFO: Node Info: &Node{ObjectMeta:{i-04cab7fc0ec1601e6 2d853506-d4dc-4e6a-ad93-16f5ebcea997 32363 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04cab7fc0ec1601e6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04cab7fc0ec1601e6 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.215 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-2987":"i-04cab7fc0ec1601e6","csi-mock-csi-mock-volumes-3089":"i-04cab7fc0ec1601e6","ebs.csi.aws.com":"i-04cab7fc0ec1601e6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-06 06:46:35 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04cab7fc0ec1601e6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:31 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:31 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:46:31 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:46:31 +0000 UTC,LastTransitionTime:2023-01-06 06:25:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.215,},NodeAddress{Type:ExternalIP,Address:15.222.251.140,},NodeAddress{Type:InternalDNS,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-251-140.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2b15a5f89be6a782a1e3e9076afdcb,SystemUUID:ec2b15a5-f89b-e6a7-82a1-e3e9076afdcb,BootID:c698d6b6-6a59-41c3-8d65-390a1e2ed279,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:46:41.069: INFO: Logging kubelet events for node i-04cab7fc0ec1601e6 Jan 6 06:46:41.104: INFO: Logging pods the kubelet thinks is on node i-04cab7fc0ec1601e6 Jan 6 06:46:41.141: INFO: liveness-2e745266-7796-4deb-a87f-62267ef8576e started at 2023-01-06 06:43:29 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.141: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:46:41.141: INFO: netserver-3 started at 2023-01-06 06:46:36 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.141: INFO: Container webserver ready: false, restart count 0 Jan 6 06:46:41.141: INFO: pvc-volume-tester-gxgrc started at 2023-01-06 06:46:32 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.141: INFO: Container volume-tester ready: true, restart count 0 Jan 6 06:46:41.141: INFO: sample-webhook-deployment-865554f4d9-npzg4 started at 2023-01-06 06:46:38 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.141: INFO: Container sample-webhook ready: false, restart count 0 Jan 6 06:46:41.141: INFO: csi-mockplugin-0 started at 2023-01-06 06:45:21 +0000 UTC (0+3 container statuses recorded) Jan 6 06:46:41.141: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:46:41.141: INFO: Container driver-registrar ready: true, restart count 0 Jan 6 06:46:41.141: INFO: Container mock ready: true, restart count 0 Jan 6 06:46:41.141: INFO: ebs-csi-node-db2rw started at 2023-01-06 06:25:37 +0000 UTC (0+3 container statuses recorded) Jan 6 06:46:41.141: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:46:41.141: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:46:41.141: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:46:41.141: INFO: coredns-559769c974-qmgjs started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.141: INFO: Container coredns ready: true, restart count 0 Jan 6 06:46:41.141: INFO: csi-mockplugin-resizer-0 started at 2023-01-06 06:45:48 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.141: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:46:41.141: INFO: coredns-autoscaler-7cb5c5b969-6txvw started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.141: INFO: Container autoscaler ready: true, restart count 0 Jan 6 06:46:41.141: INFO: csi-mockplugin-0 started at 2023-01-06 06:45:47 +0000 UTC (0+3 container statuses recorded) Jan 6 06:46:41.141: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:46:41.141: INFO: Container driver-registrar ready: true, restart count 0 Jan 6 06:46:41.141: INFO: Container mock ready: true, restart count 0 Jan 6 06:46:41.141: INFO: cilium-n8ld4 started at 2023-01-06 06:25:37 +0000 UTC (1+1 container statuses recorded) Jan 6 06:46:41.141: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:46:41.141: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:46:41.322: INFO: Latency metrics for node i-04cab7fc0ec1601e6 Jan 6 06:46:41.322: INFO: Logging node info for node i-0dfd4e56c03b27188 Jan 6 06:46:41.358: INFO: Node Info: &Node{ObjectMeta:{i-0dfd4e56c03b27188 2628d33e-cb25-41db-a644-b167c0d84591 23472 0 2023-01-06 06:23:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0dfd4e56c03b27188 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.87 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0dfd4e56c03b27188"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-06 06:23:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-06 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-06 06:42:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0dfd4e56c03b27188,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:24:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.87,},NodeAddress{Type:ExternalIP,Address:15.222.64.3,},NodeAddress{Type:InternalDNS,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-64-3.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23482dbb2dc570b65c2c6afcd72a4c,SystemUUID:ec23482d-bb2d-c570-b65c-2c6afcd72a4c,BootID:e04f4923-c80f-4e9b-852a-b2b114eb6541,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43434708,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805585,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967331,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:46:41.358: INFO: Logging kubelet events for node i-0dfd4e56c03b27188 Jan 6 06:46:41.392: INFO: Logging pods the kubelet thinks is on node i-0dfd4e56c03b27188 Jan 6 06:46:41.428: INFO: cilium-j2vh5 started at 2023-01-06 06:24:25 +0000 UTC (1+1 container statuses recorded) Jan 6 06:46:41.428: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:46:41.428: INFO: Container cilium-agent ready: true, restart count 1 Jan 6 06:46:41.428: INFO: dns-controller-69987775c6-76fgw started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.428: INFO: Container dns-controller ready: true, restart count 0 Jan 6 06:46:41.428: INFO: cilium-operator-5dd44dc49f-wnkl6 started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.428: INFO: Container cilium-operator ready: true, restart count 1 Jan 6 06:46:41.428: INFO: ebs-csi-controller-89b649c94-slv9n started at 2023-01-06 06:24:25 +0000 UTC (0+5 container statuses recorded) Jan 6 06:46:41.428: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:46:41.428: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:46:41.428: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:46:41.428: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:46:41.428: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:46:41.428: INFO: kube-controller-manager-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.428: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 6 06:46:41.428: INFO: ebs-csi-node-x7dz5 started at 2023-01-06 06:24:25 +0000 UTC (0+3 container statuses recorded) Jan 6 06:46:41.428: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:46:41.428: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:46:41.428: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:46:41.428: INFO: aws-cloud-controller-manager-snk2c started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.428: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 6 06:46:41.428: INFO: kube-scheduler-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.428: INFO: Container kube-scheduler ready: true, restart count 0 Jan 6 06:46:41.428: INFO: kops-controller-27r6m started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.428: INFO: Container kops-controller ready: true, restart count 0 Jan 6 06:46:41.428: INFO: etcd-manager-events-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.428: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:46:41.428: INFO: etcd-manager-main-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:46:41.428: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:46:41.428: INFO: kube-apiserver-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+2 container statuses recorded) Jan 6 06:46:41.428: INFO: Container healthcheck ready: true, restart count 0 Jan 6 06:46:41.428: INFO: Container kube-apiserver ready: true, restart count 1 Jan 6 06:46:41.586: INFO: Latency metrics for node i-0dfd4e56c03b27188 [DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "fsgroupchangepolicy-8508" for this suite. �[38;5;243m01/06/23 06:46:41.586�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sCustomResourceConversionWebhook\s\[Privileged\:ClusterAdmin\]\sshould\sbe\sable\sto\sconvert\sa\snon\shomogeneous\slist\sof\sCRs\s\[Conformance\]$'
test/e2e/apimachinery/crd_conversion_webhook.go:327 k8s.io/kubernetes/test/e2e/apimachinery.deployCustomResourceWebhookAndService(0xc000ac2960, {0xc001cab770, 0x2c}, 0xc002235bd0, 0x24e3, 0x24e4) test/e2e/apimachinery/crd_conversion_webhook.go:327 +0xe19 k8s.io/kubernetes/test/e2e/apimachinery.glob..func5.1() test/e2e/apimachinery/crd_conversion_webhook.go:136 +0x206from junit_01.xml
[BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/06/23 06:37:57.729�[0m Jan 6 06:37:57.729: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename crd-webhook �[38;5;243m01/06/23 06:37:57.73�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/06/23 06:37:57.825�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/06/23 06:37:57.886�[0m [BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/crd_conversion_webhook.go:128 �[1mSTEP:�[0m Setting up server cert �[38;5;243m01/06/23 06:37:57.947�[0m �[1mSTEP:�[0m Create role binding to let cr conversion webhook read extension-apiserver-authentication �[38;5;243m01/06/23 06:37:58.424�[0m �[1mSTEP:�[0m Deploying the custom resource conversion webhook pod �[38;5;243m01/06/23 06:37:58.457�[0m �[1mSTEP:�[0m Wait for the deployment to be ready �[38;5;243m01/06/23 06:37:58.525�[0m Jan 6 06:37:58.622: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:00.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:02.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:04.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:06.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:08.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:10.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:12.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:14.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:16.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:18.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:20.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:22.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:24.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:26.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:28.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:30.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:32.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:34.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:36.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:38.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:40.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:42.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:44.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:46.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:48.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:50.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:52.794: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:54.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:56.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:38:58.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:00.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:02.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:04.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:06.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:08.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:10.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:12.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:14.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:16.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:18.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:20.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:22.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:24.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:26.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:28.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:30.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:32.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:34.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:36.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:38.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:40.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:42.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:44.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:46.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:48.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:50.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:52.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:54.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:56.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:39:58.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:00.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:02.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:04.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:06.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:08.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:10.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:12.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:14.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:16.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:18.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:20.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:22.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:24.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:26.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:28.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:30.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:32.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:34.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:36.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:38.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:40.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:42.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:44.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:46.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:48.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:50.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:52.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:54.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:56.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:40:58.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:00.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:02.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:04.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:06.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:08.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:10.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:12.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:14.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:16.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:18.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:20.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:22.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:24.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:26.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:28.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:30.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:32.660: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:34.657: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:36.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:38.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:40.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:42.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:44.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:46.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:48.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:50.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:52.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:54.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:56.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:41:58.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:00.655: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:02.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:04.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:06.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:08.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:10.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:12.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:14.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:16.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:18.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:20.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:22.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:24.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:26.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:28.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:30.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:32.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:34.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:36.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:38.661: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:40.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:42.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:44.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:46.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:48.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:50.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:52.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:54.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:56.654: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:58.653: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:58.684: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Jan 6 06:42:58.684: INFO: Unexpected error: waiting for sample-crd-conversion-webhook-deployment deployment status valid: <*errors.errorString | 0xc000f788f0>: { s: "error waiting for deployment \"sample-crd-conversion-webhook-deployment\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"False\", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:\"MinimumReplicasUnavailable\", Message:\"Deployment does not have minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"sample-crd-conversion-webhook-deployment-74ff66dd47\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}", } Jan 6 06:42:58.684: FAIL: waiting for sample-crd-conversion-webhook-deployment deployment status valid: error waiting for deployment "sample-crd-conversion-webhook-deployment" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:1, UpdatedReplicas:1, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 6, 6, 37, 58, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"sample-crd-conversion-webhook-deployment-74ff66dd47\" is progressing."}}, CollisionCount:(*int32)(nil)} Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.deployCustomResourceWebhookAndService(0xc000ac2960, {0xc001cab770, 0x2c}, 0xc002235bd0, 0x24e3, 0x24e4) test/e2e/apimachinery/crd_conversion_webhook.go:327 +0xe19 k8s.io/kubernetes/test/e2e/apimachinery.glob..func5.1() test/e2e/apimachinery/crd_conversion_webhook.go:136 +0x206 [AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] test/e2e/framework/node/init/init.go:32 Jan 6 06:42:58.685: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [AfterEach] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] test/e2e/apimachinery/crd_conversion_webhook.go:139 [DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/06/23 06:42:58.845�[0m �[1mSTEP:�[0m Collecting events from namespace "crd-webhook-5010". �[38;5;243m01/06/23 06:42:58.845�[0m �[1mSTEP:�[0m Found 13 events. �[38;5;243m01/06/23 06:42:58.877�[0m Jan 6 06:42:58.877: INFO: At 2023-01-06 06:37:58 +0000 UTC - event for sample-crd-conversion-webhook-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set sample-crd-conversion-webhook-deployment-74ff66dd47 to 1 Jan 6 06:42:58.877: INFO: At 2023-01-06 06:37:58 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47: {replicaset-controller } SuccessfulCreate: Created pod: sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv Jan 6 06:42:58.877: INFO: At 2023-01-06 06:37:58 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv: {default-scheduler } Scheduled: Successfully assigned crd-webhook-5010/sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv to i-00e2a3416f09a146a Jan 6 06:42:58.877: INFO: At 2023-01-06 06:37:59 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c57d61d3ea02e6bbf24b49e0c549f7fee02a346505f7b56a4d00d6321715edeb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.877: INFO: At 2023-01-06 06:38:13 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6bbdaf12c5256c6b39ce6acd617394c509354a1605cd806202e507f3e84f3558": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.877: INFO: At 2023-01-06 06:38:26 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "55afb350a22a25b383a8a9dd8208743ce213200896ac0806fe32e565a844eaab": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.877: INFO: At 2023-01-06 06:38:40 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bbda3fd0ea2a203df5e3b6617b58d4e9260eff890210709c291a09138c152fd6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.877: INFO: At 2023-01-06 06:38:54 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e43e0d71bdde72e2ea47c7b7b0b8b6baaf0968b75cc4316c012a036924b690c8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.877: INFO: At 2023-01-06 06:39:09 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "734ebec603f7fdbb1450c4d452b1eae03801d7776e79cc2caa5c915c329209dd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.877: INFO: At 2023-01-06 06:39:24 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7a512408eaf988161856a13e96d3262d6eb3a44e55d9c39e16b1fc66640edbc4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.877: INFO: At 2023-01-06 06:39:37 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "00e0b0f669e2bc2a9404ac409fac680706030a6b7cd042512c5907dfaa7c1aa9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.877: INFO: At 2023-01-06 06:39:51 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6a25c4d9379d71661a400daa3ad2328cce18323f6c33c1d1534869a9104ab64c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.877: INFO: At 2023-01-06 06:40:06 +0000 UTC - event for sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8fd0deeb5c7646e760333cef749b71dab095ac85c4dc2283ba4e1904118e9c8f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.908: INFO: POD NODE PHASE GRACE CONDITIONS Jan 6 06:42:58.908: INFO: Jan 6 06:42:58.940: INFO: Logging node info for node i-00e2a3416f09a146a Jan 6 06:42:58.971: INFO: Node Info: &Node{ObjectMeta:{i-00e2a3416f09a146a 8b86fb5a-68fd-4aec-8591-934be54479d5 23360 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00e2a3416f09a146a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-00e2a3416f09a146a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.186 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00e2a3416f09a146a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:41:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:41:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00e2a3416f09a146a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.186,},NodeAddress{Type:ExternalIP,Address:3.97.12.121,},NodeAddress{Type:InternalDNS,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-97-12-121.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2895effafa575efe2674497633226d,SystemUUID:ec2895ef-fafa-575e-fe26-74497633226d,BootID:79823d62-e8bb-4de7-91b6-78fb8137f2da,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99 kubernetes.io/csi/ebs.csi.aws.com^vol-0dfd8d85db9fb3624],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0dfd8d85db9fb3624,DevicePath:,},},Config:nil,},} Jan 6 06:42:58.971: INFO: Logging kubelet events for node i-00e2a3416f09a146a Jan 6 06:42:59.004: INFO: Logging pods the kubelet thinks is on node i-00e2a3416f09a146a Jan 6 06:42:59.073: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-z6bp5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.073: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-rd5kq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.073: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-5v5xp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:59.073: INFO: rs-xjfv2 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:59.073: INFO: affinity-clusterip-timeout-94b4c started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:42:59.073: INFO: pod-3e08c759-655f-40a7-9a02-b3d5823ccebc started at 2023-01-06 06:39:29 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container test-container ready: false, restart count 0 Jan 6 06:42:59.073: INFO: rs-q6qrb started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:59.073: INFO: external-injector started at 2023-01-06 06:41:52 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container external-injector ready: false, restart count 0 Jan 6 06:42:59.073: INFO: cilium-4tnhd started at 2023-01-06 06:25:38 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:59.073: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:42:59.073: INFO: dns-test-809ded8f-de8a-4c44-9545-585f12522763 started at 2023-01-06 06:36:36 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:59.073: INFO: Container jessie-querier ready: false, restart count 0 Jan 6 06:42:59.073: INFO: Container querier ready: false, restart count 0 Jan 6 06:42:59.073: INFO: Container webserver ready: false, restart count 0 Jan 6 06:42:59.073: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g7ftv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.073: INFO: rs-mpx98 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:59.073: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-727r8 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.073: INFO: sample-webhook-deployment-865554f4d9-xx66r started at 2023-01-06 06:41:15 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container sample-webhook ready: false, restart count 0 Jan 6 06:42:59.073: INFO: ebs-csi-node-w4gks started at 2023-01-06 06:25:38 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:59.073: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:59.073: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:59.073: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:59.073: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-9jl5j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.073: INFO: pod-a782d690-ad63-4815-a2c4-dad0d0dd28de started at 2023-01-06 06:36:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:42:59.073: INFO: hostpath-symlink-prep-provisioning-7481 started at 2023-01-06 06:42:57 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container init-volume-provisioning-7481 ready: false, restart count 0 Jan 6 06:42:59.073: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-wvnkl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.073: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bqlxl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.073: INFO: affinity-clusterip-transition-9mbw6 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container affinity-clusterip-transition ready: true, restart count 0 Jan 6 06:42:59.073: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nljmx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.073: INFO: hostexec started at 2023-01-06 06:42:54 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:59.073: INFO: pod-subpath-test-projected-7vlp started at 2023-01-06 06:38:17 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container test-container-subpath-projected-7vlp ready: false, restart count 0 Jan 6 06:42:59.073: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n4gvl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.073: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.248: INFO: Latency metrics for node i-00e2a3416f09a146a Jan 6 06:42:59.248: INFO: Logging node info for node i-038260c95b7cbf8dd Jan 6 06:42:59.280: INFO: Node Info: &Node{ObjectMeta:{i-038260c95b7cbf8dd ba495758-87ae-4472-b9d2-10e6fd017588 23083 0 2023-01-06 06:25:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-038260c95b7cbf8dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-038260c95b7cbf8dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.153 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-188":"i-038260c95b7cbf8dd","csi-hostpath-provisioning-4332":"i-038260c95b7cbf8dd","ebs.csi.aws.com":"i-038260c95b7cbf8dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:41:18 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:41:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-038260c95b7cbf8dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:26:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.153,},NodeAddress{Type:ExternalIP,Address:35.183.20.213,},NodeAddress{Type:InternalDNS,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-183-20-213.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dcb30d66cfec0075096c81f360304,SystemUUID:ec2dcb30-d66c-fec0-0750-96c81f360304,BootID:d74ef702-20db-4c1a-ac66-e72d9b82565b,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252 kubernetes.io/csi/csi-hostpath-provisioning-4332^1e8f61b4-8d8d-11ed-93d1-620a615b4ed2],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-4332^1e8f61b4-8d8d-11ed-93d1-620a615b4ed2,DevicePath:,},},Config:nil,},} Jan 6 06:42:59.280: INFO: Logging kubelet events for node i-038260c95b7cbf8dd Jan 6 06:42:59.313: INFO: Logging pods the kubelet thinks is on node i-038260c95b7cbf8dd Jan 6 06:42:59.381: INFO: coredns-559769c974-tj9mr started at 2023-01-06 06:26:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container coredns ready: true, restart count 0 Jan 6 06:42:59.381: INFO: rs-z75vx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:59.381: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-lh5x9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:59.381: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-vrx5z started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.381: INFO: hostexec-i-038260c95b7cbf8dd-ldm4j started at 2023-01-06 06:38:03 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:59.381: INFO: pod-subpath-test-dynamicpv-sntd started at 2023-01-06 06:41:17 +0000 UTC (1+2 container statuses recorded) Jan 6 06:42:59.381: INFO: Init container test-init-subpath-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:42:59.381: INFO: Container test-container-subpath-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:42:59.381: INFO: Container test-container-volume-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:42:59.381: INFO: cilium-9n89s started at 2023-01-06 06:25:58 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:42:59.381: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:53 +0000 UTC (0+7 container statuses recorded) Jan 6 06:42:59.381: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container hostpath ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:59.381: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-6bp9g started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.381: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jnnxp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:59.381: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-ddpcp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.381: INFO: rs-zmb4t started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:59.381: INFO: ebs-csi-node-bds8q started at 2023-01-06 06:25:58 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:59.381: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:59.381: INFO: pod-subpath-test-dynamicpv-482k started at 2023-01-06 06:41:16 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container test-container-subpath-dynamicpv-482k ready: false, restart count 0 Jan 6 06:42:59.381: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kssp4 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.381: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:36 +0000 UTC (0+7 container statuses recorded) Jan 6 06:42:59.381: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container hostpath ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:59.381: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:59.381: INFO: pod-a47b83f9-cc6f-4f6a-9143-1f820cb0f680 started at 2023-01-06 06:38:08 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:42:59.381: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-p252s started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.381: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4x2wx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.381: INFO: affinity-clusterip-transition-nlpm8 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:42:59.381: INFO: hostexec-i-038260c95b7cbf8dd-mzglw started at 2023-01-06 06:40:56 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:59.381: INFO: pod-subpath-test-preprovisionedpv-6m4h started at 2023-01-06 06:41:10 +0000 UTC (1+2 container statuses recorded) Jan 6 06:42:59.381: INFO: Init container test-init-subpath-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:42:59.381: INFO: Container test-container-subpath-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:42:59.381: INFO: Container test-container-volume-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:42:59.381: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pkzq2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.381: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4cf9x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.381: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.651: INFO: Latency metrics for node i-038260c95b7cbf8dd Jan 6 06:42:59.651: INFO: Logging node info for node i-03c3347a40904af85 Jan 6 06:42:59.682: INFO: Node Info: &Node{ObjectMeta:{i-03c3347a40904af85 acf58f94-6029-4390-a68e-e4dc4881fbb2 23391 0 2023-01-06 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03c3347a40904af85 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-03c3347a40904af85 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03c3347a40904af85"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:37:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:42:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-03c3347a40904af85,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.54,},NodeAddress{Type:ExternalIP,Address:15.223.65.129,},NodeAddress{Type:InternalDNS,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-223-65-129.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be680388baaf810ad9be3463c2150,SystemUUID:ec2be680-388b-aaf8-10ad-9be3463c2150,BootID:e07e85b2-353d-46e6-bf6b-941e6e0ae86a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4,DevicePath:,},},Config:nil,},} Jan 6 06:42:59.683: INFO: Logging kubelet events for node i-03c3347a40904af85 Jan 6 06:42:59.716: INFO: Logging pods the kubelet thinks is on node i-03c3347a40904af85 Jan 6 06:42:59.755: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-xskq7 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.755: INFO: pod-6faed302-3756-4d38-8d98-81f254795610 started at 2023-01-06 06:42:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:42:59.755: INFO: pod-2 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:59.755: INFO: rs-zvxqx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:59.755: INFO: cilium-ww8tr started at 2023-01-06 06:26:09 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:59.755: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:42:59.755: INFO: ebs-csi-node-lvpjv started at 2023-01-06 06:26:09 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:59.755: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:59.755: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:59.755: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:59.755: INFO: pod-configmaps-b6eb366a-a1a5-44ab-ac82-5dd5e2aed984 started at 2023-01-06 06:41:23 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container agnhost-container ready: false, restart count 0 Jan 6 06:42:59.755: INFO: downwardapi-volume-52e6a5ae-b501-4ba1-be31-d95abea8b4c8 started at 2023-01-06 06:42:47 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container client-container ready: false, restart count 0 Jan 6 06:42:59.755: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g8tzv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.755: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pxg45 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.755: INFO: inline-volume-tester-n28z7 started at 2023-01-06 06:35:53 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 6 06:42:59.755: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pq9p9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.755: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-s7f2j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.755: INFO: test-ss-0 started at 2023-01-06 06:35:50 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container webserver ready: false, restart count 0 Jan 6 06:42:59.755: INFO: affinity-clusterip-timeout-56jbj started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 Jan 6 06:42:59.755: INFO: affinity-clusterip-transition-j2cw9 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:42:59.755: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-q8g6m started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.755: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4ch6k started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.755: INFO: rs-kb44r started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:59.755: INFO: podecd1684a-4613-4907-b951-ddd2cbe92f5f started at 2023-01-06 06:38:00 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container nginx ready: false, restart count 0 Jan 6 06:42:59.755: INFO: hostexec-i-03c3347a40904af85-8ntd8 started at 2023-01-06 06:42:16 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:59.755: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-tkmjc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:59.755: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jtjnf started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.755: INFO: rs-q66kq started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:59.755: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-62rpq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.755: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.755: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:41:47 +0000 UTC (0+7 container statuses recorded) Jan 6 06:42:59.755: INFO: Container csi-attacher ready: false, restart count 0 Jan 6 06:42:59.755: INFO: Container csi-provisioner ready: false, restart count 0 Jan 6 06:42:59.755: INFO: Container csi-resizer ready: false, restart count 0 Jan 6 06:42:59.755: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 6 06:42:59.755: INFO: Container hostpath ready: false, restart count 0 Jan 6 06:42:59.755: INFO: Container liveness-probe ready: false, restart count 0 Jan 6 06:42:59.755: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 6 06:42:59.948: INFO: Latency metrics for node i-03c3347a40904af85 Jan 6 06:42:59.948: INFO: Logging node info for node i-04cab7fc0ec1601e6 Jan 6 06:42:59.980: INFO: Node Info: &Node{ObjectMeta:{i-04cab7fc0ec1601e6 2d853506-d4dc-4e6a-ad93-16f5ebcea997 22694 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04cab7fc0ec1601e6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04cab7fc0ec1601e6 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-04cab7fc0ec1601e6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-06 06:40:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04cab7fc0ec1601e6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.215,},NodeAddress{Type:ExternalIP,Address:15.222.251.140,},NodeAddress{Type:InternalDNS,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-251-140.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2b15a5f89be6a782a1e3e9076afdcb,SystemUUID:ec2b15a5-f89b-e6a7-82a1-e3e9076afdcb,BootID:c698d6b6-6a59-41c3-8d65-390a1e2ed279,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:42:59.980: INFO: Logging kubelet events for node i-04cab7fc0ec1601e6 Jan 6 06:43:00.013: INFO: Logging pods the kubelet thinks is on node i-04cab7fc0ec1601e6 Jan 6 06:43:00.055: INFO: ebs-csi-node-db2rw started at 2023-01-06 06:25:37 +0000 UTC (0+3 container statuses recorded) Jan 6 06:43:00.055: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:00.055: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:00.055: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:43:00.055: INFO: cilium-n8ld4 started at 2023-01-06 06:25:37 +0000 UTC (1+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:43:00.055: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:43:00.055: INFO: coredns-559769c974-qmgjs started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container coredns ready: true, restart count 0 Jan 6 06:43:00.055: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nfchl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.055: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kdmj6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.055: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-sj6xh started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.055: INFO: pod-0 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:00.055: INFO: coredns-autoscaler-7cb5c5b969-6txvw started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container autoscaler ready: true, restart count 0 Jan 6 06:43:00.055: INFO: affinity-clusterip-timeout-qvtbc started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:43:00.055: INFO: pod-1 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:00.055: INFO: rs-4ks6z started at 2023-01-06 06:36:23 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:00.055: INFO: rs-6vhk6 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:00.055: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bzw88 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.055: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kvds2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.055: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4fsc6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.055: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4wmx5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.055: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-dz4q9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.055: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-svh2x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:43:00.055: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n99wc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.055: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.290: INFO: Latency metrics for node i-04cab7fc0ec1601e6 Jan 6 06:43:00.290: INFO: Logging node info for node i-0dfd4e56c03b27188 Jan 6 06:43:00.323: INFO: Node Info: &Node{ObjectMeta:{i-0dfd4e56c03b27188 2628d33e-cb25-41db-a644-b167c0d84591 23472 0 2023-01-06 06:23:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0dfd4e56c03b27188 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.87 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0dfd4e56c03b27188"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-06 06:23:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-06 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-06 06:42:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0dfd4e56c03b27188,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:24:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.87,},NodeAddress{Type:ExternalIP,Address:15.222.64.3,},NodeAddress{Type:InternalDNS,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-64-3.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23482dbb2dc570b65c2c6afcd72a4c,SystemUUID:ec23482d-bb2d-c570-b65c-2c6afcd72a4c,BootID:e04f4923-c80f-4e9b-852a-b2b114eb6541,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43434708,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805585,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967331,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:43:00.323: INFO: Logging kubelet events for node i-0dfd4e56c03b27188 Jan 6 06:43:00.361: INFO: Logging pods the kubelet thinks is on node i-0dfd4e56c03b27188 Jan 6 06:43:00.397: INFO: aws-cloud-controller-manager-snk2c started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.397: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 6 06:43:00.397: INFO: cilium-j2vh5 started at 2023-01-06 06:24:25 +0000 UTC (1+1 container statuses recorded) Jan 6 06:43:00.397: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:43:00.397: INFO: Container cilium-agent ready: true, restart count 1 Jan 6 06:43:00.397: INFO: dns-controller-69987775c6-76fgw started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.397: INFO: Container dns-controller ready: true, restart count 0 Jan 6 06:43:00.397: INFO: cilium-operator-5dd44dc49f-wnkl6 started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.397: INFO: Container cilium-operator ready: true, restart count 1 Jan 6 06:43:00.397: INFO: ebs-csi-controller-89b649c94-slv9n started at 2023-01-06 06:24:25 +0000 UTC (0+5 container statuses recorded) Jan 6 06:43:00.397: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:43:00.397: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:43:00.397: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:43:00.397: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:00.397: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:00.397: INFO: kube-controller-manager-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.397: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 6 06:43:00.397: INFO: ebs-csi-node-x7dz5 started at 2023-01-06 06:24:25 +0000 UTC (0+3 container statuses recorded) Jan 6 06:43:00.397: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:00.397: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:00.397: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:43:00.397: INFO: kube-apiserver-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+2 container statuses recorded) Jan 6 06:43:00.397: INFO: Container healthcheck ready: true, restart count 0 Jan 6 06:43:00.397: INFO: Container kube-apiserver ready: true, restart count 1 Jan 6 06:43:00.397: INFO: kube-scheduler-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.397: INFO: Container kube-scheduler ready: true, restart count 0 Jan 6 06:43:00.397: INFO: kops-controller-27r6m started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.397: INFO: Container kops-controller ready: true, restart count 0 Jan 6 06:43:00.397: INFO: etcd-manager-events-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.397: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:43:00.397: INFO: etcd-manager-main-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.397: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:43:00.565: INFO: Latency metrics for node i-0dfd4e56c03b27188 [DeferCleanup (Each)] [sig-api-machinery] CustomResourceConversionWebhook [Privileged:ClusterAdmin] tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "crd-webhook-5010" for this suite. �[38;5;243m01/06/23 06:43:00.565�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-api\-machinery\]\sGenerated\sclientset\sshould\screate\spods\,\sset\sthe\sdeletionTimestamp\sand\sdeletionGracePeriodSeconds\sof\sthe\spod$'
test/e2e/apimachinery/generated_clientset.go:151 k8s.io/kubernetes/test/e2e/apimachinery.glob..func14.1() test/e2e/apimachinery/generated_clientset.go:151 +0x6b5from junit_01.xml
[BeforeEach] [sig-api-machinery] Generated clientset set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/06/23 06:38:00.672�[0m Jan 6 06:38:00.672: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename clientset �[38;5;243m01/06/23 06:38:00.673�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/06/23 06:38:00.767�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/06/23 06:38:00.829�[0m [BeforeEach] [sig-api-machinery] Generated clientset test/e2e/framework/metrics/init/init.go:31 [It] should create pods, set the deletionTimestamp and deletionGracePeriodSeconds of the pod test/e2e/apimachinery/generated_clientset.go:105 �[1mSTEP:�[0m constructing the pod �[38;5;243m01/06/23 06:38:00.89�[0m �[1mSTEP:�[0m setting up watch �[38;5;243m01/06/23 06:38:00.89�[0m �[1mSTEP:�[0m creating the pod �[38;5;243m01/06/23 06:38:00.951�[0m �[1mSTEP:�[0m verifying the pod is in kubernetes �[38;5;243m01/06/23 06:38:00.987�[0m �[1mSTEP:�[0m verifying pod creation was observed �[38;5;243m01/06/23 06:38:01.018�[0m Jan 6 06:38:01.018: INFO: Waiting up to 5m0s for pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f" in namespace "clientset-9420" to be "running" Jan 6 06:38:01.050: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 31.10704ms Jan 6 06:38:03.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063225509s Jan 6 06:38:05.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4.063290138s Jan 6 06:38:07.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 6.063133644s Jan 6 06:38:09.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 8.063577527s Jan 6 06:38:11.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 10.063314278s Jan 6 06:38:13.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 12.062995058s Jan 6 06:38:15.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 14.0632079s Jan 6 06:38:17.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 16.063168491s Jan 6 06:38:19.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 18.062907662s Jan 6 06:38:21.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 20.062799357s Jan 6 06:38:23.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 22.063875911s Jan 6 06:38:25.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 24.062821483s Jan 6 06:38:27.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 26.063364185s Jan 6 06:38:29.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 28.063776387s Jan 6 06:38:31.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 30.063058779s Jan 6 06:38:33.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 32.063616057s Jan 6 06:38:35.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 34.063186507s Jan 6 06:38:37.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 36.063105732s Jan 6 06:38:39.083: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 38.064102145s Jan 6 06:38:41.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 40.063565974s Jan 6 06:38:43.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 42.063568471s Jan 6 06:38:45.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 44.062990127s Jan 6 06:38:47.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 46.062809361s Jan 6 06:38:49.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 48.063424483s Jan 6 06:38:51.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 50.06328388s Jan 6 06:38:53.084: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 52.065664301s Jan 6 06:38:55.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 54.0638132s Jan 6 06:38:57.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 56.063091289s Jan 6 06:38:59.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 58.063136021s Jan 6 06:39:01.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.063301919s Jan 6 06:39:03.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.063228417s Jan 6 06:39:05.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.063219025s Jan 6 06:39:07.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.063936953s Jan 6 06:39:09.083: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.064309353s Jan 6 06:39:11.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.063723054s Jan 6 06:39:13.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.063133755s Jan 6 06:39:15.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.063482311s Jan 6 06:39:17.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.063784426s Jan 6 06:39:19.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.063204633s Jan 6 06:39:21.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.063190371s Jan 6 06:39:23.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.063443765s Jan 6 06:39:25.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.063054718s Jan 6 06:39:27.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.063525315s Jan 6 06:39:29.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.063697912s Jan 6 06:39:31.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.063269909s Jan 6 06:39:33.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.063702546s Jan 6 06:39:35.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.063264974s Jan 6 06:39:37.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.062935218s Jan 6 06:39:39.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.063592671s Jan 6 06:39:41.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.062735519s Jan 6 06:39:43.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.062644703s Jan 6 06:39:45.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.063549902s Jan 6 06:39:47.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.062771242s Jan 6 06:39:49.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.063405985s Jan 6 06:39:51.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.062559498s Jan 6 06:39:53.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.062942932s Jan 6 06:39:55.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.063570456s Jan 6 06:39:57.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.063125023s Jan 6 06:39:59.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.063495983s Jan 6 06:40:01.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.063136116s Jan 6 06:40:03.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.062730147s Jan 6 06:40:05.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.063780474s Jan 6 06:40:07.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.063051376s Jan 6 06:40:09.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.06342058s Jan 6 06:40:11.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.06373295s Jan 6 06:40:13.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.062971905s Jan 6 06:40:15.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.063102908s Jan 6 06:40:17.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.063733131s Jan 6 06:40:19.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.062618458s Jan 6 06:40:21.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.063225102s Jan 6 06:40:23.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.063094659s Jan 6 06:40:25.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.062652541s Jan 6 06:40:27.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.063249803s Jan 6 06:40:29.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.063511862s Jan 6 06:40:31.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.063636637s Jan 6 06:40:33.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.062694976s Jan 6 06:40:35.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.062867306s Jan 6 06:40:37.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.063865525s Jan 6 06:40:39.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.062737088s Jan 6 06:40:41.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.062907633s Jan 6 06:40:43.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.063391548s Jan 6 06:40:45.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.063183682s Jan 6 06:40:47.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.063564216s Jan 6 06:40:49.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.063558721s Jan 6 06:40:51.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.062619276s Jan 6 06:40:53.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.063767061s Jan 6 06:40:55.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.063043029s Jan 6 06:40:57.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.063563083s Jan 6 06:40:59.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.0629218s Jan 6 06:41:01.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.063478574s Jan 6 06:41:03.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.062444754s Jan 6 06:41:05.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.062921157s Jan 6 06:41:07.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.063524486s Jan 6 06:41:09.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.063893642s Jan 6 06:41:11.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.063660111s Jan 6 06:41:13.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.063223507s Jan 6 06:41:15.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.062628775s Jan 6 06:41:17.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.063543303s Jan 6 06:41:19.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.063275463s Jan 6 06:41:21.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.063308645s Jan 6 06:41:23.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.063450562s Jan 6 06:41:25.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.063403418s Jan 6 06:41:27.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.062711347s Jan 6 06:41:29.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.063099211s Jan 6 06:41:31.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.062885665s Jan 6 06:41:33.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.063298209s Jan 6 06:41:35.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.063347806s Jan 6 06:41:37.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.062958999s Jan 6 06:41:39.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.063819676s Jan 6 06:41:41.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.062626067s Jan 6 06:41:43.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.063165724s Jan 6 06:41:45.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.062983735s Jan 6 06:41:47.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.063257033s Jan 6 06:41:49.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.062665983s Jan 6 06:41:51.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.062820984s Jan 6 06:41:53.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.063077515s Jan 6 06:41:55.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.062775957s Jan 6 06:41:57.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.063220857s Jan 6 06:41:59.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.063312873s Jan 6 06:42:01.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.063397561s Jan 6 06:42:03.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.063158859s Jan 6 06:42:05.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.063345157s Jan 6 06:42:07.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.06317115s Jan 6 06:42:09.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.063226352s Jan 6 06:42:11.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.062933718s Jan 6 06:42:13.083: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.064429182s Jan 6 06:42:15.083: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.064269252s Jan 6 06:42:17.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.063806956s Jan 6 06:42:19.083: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.064050375s Jan 6 06:42:21.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.062516092s Jan 6 06:42:23.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.063294626s Jan 6 06:42:25.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.062909279s Jan 6 06:42:27.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.062916802s Jan 6 06:42:29.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.062439537s Jan 6 06:42:31.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.063600712s Jan 6 06:42:33.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.062719508s Jan 6 06:42:35.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.063531977s Jan 6 06:42:37.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.062858895s Jan 6 06:42:39.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.063555405s Jan 6 06:42:41.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.06347092s Jan 6 06:42:43.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.063209921s Jan 6 06:42:45.085: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.066243746s Jan 6 06:42:47.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.063319819s Jan 6 06:42:49.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.063573848s Jan 6 06:42:51.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.063509537s Jan 6 06:42:53.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.063309066s Jan 6 06:42:55.081: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.062802681s Jan 6 06:42:57.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.063559074s Jan 6 06:42:59.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.063374976s Jan 6 06:43:01.082: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.063100483s Jan 6 06:43:01.112: INFO: Pod "podecd1684a-4613-4907-b951-ddd2cbe92f5f": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.094016224s Jan 6 06:43:01.113: INFO: Unexpected error: <*pod.timeoutError | 0xc004f6afc0>: { msg: "timed out while waiting for pod clientset-9420/podecd1684a-4613-4907-b951-ddd2cbe92f5f to be running", observedObjects: [ <*v1.Pod | 0xc0029f6000>{ TypeMeta: {Kind: "", APIVersion: ""}, ObjectMeta: { Name: "podecd1684a-4613-4907-b951-ddd2cbe92f5f", GenerateName: "", Namespace: "clientset-9420", SelfLink: "", UID: "792294f9-8670-4a91-b53d-89083e0bb7a4", ResourceVersion: "22029", Generation: 0, CreationTimestamp: { Time: { wall: 0, ext: 63808583880, loc: { name: "Local", zone: [ {name: "UTC", offset: 0, isDST: false}, ], tx: [ { when: -576460752303423488, index: 0, isstd: false, isutc: false, }, ], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: "UTC", offset: 0, isDST: false}, }, }, }, DeletionTimestamp: nil, DeletionGracePeriodSeconds: nil, Labels: {"name": "foo", "time": "890700089"}, Annotations: nil, OwnerReferences: nil, Finalizers: nil, ManagedFields: [ { Manager: "e2e.test", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63808583880, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:metadata\":{\"f:labels\":{\".\":{},\"f:name\":{},\"f:time\":{}}},\"f:spec\":{\"f:containers\":{\"k:{\\\"name\\\":\\\"nginx\\\"}\":{\".\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:livenessProbe\":{\".\":{},\"f:failureThreshold\":{},\"f:httpGet\":{\".\":{},\"f:path\":{},\"f:port\":{},\"f:scheme\":{}},\"f:initialDelaySeconds\":{},\"f:periodSeconds\":{},\"f:successThreshold\":{},\"f:timeoutSeconds\":{}},\"f:name\":{},\"f:ports\":{\".\":{},\"k:{\\\"containerPort\\\":80,\\\"protocol\\\":\\\"TCP\\\"}\":{\".\":{},\"f:containerPort\":{},\"f:protocol\":{}}},\"f:resources\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}", }, Subresource: "", }, { Manager: "kubelet", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63808583880, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}", }, Subresource: "status", }, ], }, Spec: { Volumes: [ { Name: "kube-api-access-mft8h", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil, Secret: nil, NFS: nil, ISCSI: nil, Glusterfs: nil, PersistentVolumeClaim: nil, RBD: nil, FlexVolume: nil, Cinder: nil, CephFS: nil, Flocker: nil, DownwardAPI: nil, FC: nil, AzureFile: nil, ConfigMap: nil, VsphereVolume: nil, Quobyte: nil, AzureDisk: nil, PhotonPersistentDisk: nil, Projected: { Sources: [ { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, { Secret: ..., DownwardAPI: ..., ConfigMap: ..., ServiceAccountToken: ..., }, { Secret: ..., Downw... Gomega truncated this representation as it exceeds 'format.MaxLength'. Consider having the object provide a custom 'GomegaStringer' representation or adjust the parameters in Gomega's 'format' package. Learn more here: https://onsi.github.io/gomega/#adjusting-output Jan 6 06:43:01.114: FAIL: timed out while waiting for pod clientset-9420/podecd1684a-4613-4907-b951-ddd2cbe92f5f to be running Full Stack Trace k8s.io/kubernetes/test/e2e/apimachinery.glob..func14.1() test/e2e/apimachinery/generated_clientset.go:151 +0x6b5 [AfterEach] [sig-api-machinery] Generated clientset test/e2e/framework/node/init/init.go:32 Jan 6 06:43:01.114: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-api-machinery] Generated clientset test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-api-machinery] Generated clientset dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/06/23 06:43:01.146�[0m �[1mSTEP:�[0m Collecting events from namespace "clientset-9420". �[38;5;243m01/06/23 06:43:01.146�[0m �[1mSTEP:�[0m Found 11 events. �[38;5;243m01/06/23 06:43:01.178�[0m Jan 6 06:43:01.178: INFO: At 2023-01-06 06:38:00 +0000 UTC - event for podecd1684a-4613-4907-b951-ddd2cbe92f5f: {default-scheduler } Scheduled: Successfully assigned clientset-9420/podecd1684a-4613-4907-b951-ddd2cbe92f5f to i-03c3347a40904af85 Jan 6 06:43:01.178: INFO: At 2023-01-06 06:38:01 +0000 UTC - event for podecd1684a-4613-4907-b951-ddd2cbe92f5f: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9df6dd3f9cd6bc889d03263ff21318eaf67a77802828fcd65f86b5aeaf0ea844": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:43:01.178: INFO: At 2023-01-06 06:38:15 +0000 UTC - event for podecd1684a-4613-4907-b951-ddd2cbe92f5f: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c85ace432c6c85927337994e2dfe5fdf7d5d2dae4396f0491a9942b79843bb18": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:43:01.178: INFO: At 2023-01-06 06:38:27 +0000 UTC - event for podecd1684a-4613-4907-b951-ddd2cbe92f5f: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "635479e72c8c43c96d06ed3819688fb5b05e4b5344974180e5b1206ac744cc00": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:43:01.178: INFO: At 2023-01-06 06:38:42 +0000 UTC - event for podecd1684a-4613-4907-b951-ddd2cbe92f5f: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e3f948d9f31697a8dff38b3bdfe4a79256b89a4ed656de07f9a581617af8314d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:43:01.178: INFO: At 2023-01-06 06:38:54 +0000 UTC - event for podecd1684a-4613-4907-b951-ddd2cbe92f5f: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3d1df16940849e8f5247af991e5adef574db17d6b57d8217853ad58f1d938d3a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:43:01.178: INFO: At 2023-01-06 06:39:08 +0000 UTC - event for podecd1684a-4613-4907-b951-ddd2cbe92f5f: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cb9be0b0002c01e3b96ddadf470d056dc42b8f3ab2912c942d2428e5aafb73cc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:43:01.178: INFO: At 2023-01-06 06:39:19 +0000 UTC - event for podecd1684a-4613-4907-b951-ddd2cbe92f5f: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ca98c87b9e05f65a3799c904e36a20a04e11054582b5ec7dffaceed6f52fb83f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:43:01.178: INFO: At 2023-01-06 06:39:33 +0000 UTC - event for podecd1684a-4613-4907-b951-ddd2cbe92f5f: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "71acf47c64ed8bcf4213ac827e51657ec27bede1a1077d6c1f1ba692ee877fe8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:43:01.178: INFO: At 2023-01-06 06:39:47 +0000 UTC - event for podecd1684a-4613-4907-b951-ddd2cbe92f5f: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "09133c37403be557a6e2957cc873928958b4d9f711e9fcf955f1683c4606d82f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:43:01.178: INFO: At 2023-01-06 06:40:01 +0000 UTC - event for podecd1684a-4613-4907-b951-ddd2cbe92f5f: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5d28b6bd25841d1ccacf8f0fb3ada202539706ea5f0ee16e24f173acb7b35194": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:43:01.209: INFO: POD NODE PHASE GRACE CONDITIONS Jan 6 06:43:01.209: INFO: podecd1684a-4613-4907-b951-ddd2cbe92f5f i-03c3347a40904af85 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:38:00 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:38:00 +0000 UTC ContainersNotReady containers with unready status: [nginx]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:38:00 +0000 UTC ContainersNotReady containers with unready status: [nginx]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:38:00 +0000 UTC }] Jan 6 06:43:01.209: INFO: Jan 6 06:43:01.242: INFO: Unable to fetch clientset-9420/podecd1684a-4613-4907-b951-ddd2cbe92f5f/nginx logs: the server rejected our request for an unknown reason (get pods podecd1684a-4613-4907-b951-ddd2cbe92f5f) Jan 6 06:43:01.275: INFO: Logging node info for node i-00e2a3416f09a146a Jan 6 06:43:01.310: INFO: Node Info: &Node{ObjectMeta:{i-00e2a3416f09a146a 8b86fb5a-68fd-4aec-8591-934be54479d5 23360 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00e2a3416f09a146a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-00e2a3416f09a146a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.186 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00e2a3416f09a146a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:41:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:41:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00e2a3416f09a146a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.186,},NodeAddress{Type:ExternalIP,Address:3.97.12.121,},NodeAddress{Type:InternalDNS,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-97-12-121.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2895effafa575efe2674497633226d,SystemUUID:ec2895ef-fafa-575e-fe26-74497633226d,BootID:79823d62-e8bb-4de7-91b6-78fb8137f2da,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99 kubernetes.io/csi/ebs.csi.aws.com^vol-0dfd8d85db9fb3624],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0dfd8d85db9fb3624,DevicePath:,},},Config:nil,},} Jan 6 06:43:01.310: INFO: Logging kubelet events for node i-00e2a3416f09a146a Jan 6 06:43:01.345: INFO: Logging pods the kubelet thinks is on node i-00e2a3416f09a146a Jan 6 06:43:01.391: INFO: affinity-clusterip-timeout-94b4c started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:43:01.391: INFO: pod-3e08c759-655f-40a7-9a02-b3d5823ccebc started at 2023-01-06 06:39:29 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container test-container ready: false, restart count 0 Jan 6 06:43:01.391: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-z6bp5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:01.391: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-rd5kq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:01.391: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-5v5xp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:43:01.391: INFO: rs-xjfv2 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:01.391: INFO: external-injector started at 2023-01-06 06:41:52 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container external-injector ready: false, restart count 0 Jan 6 06:43:01.391: INFO: rs-q6qrb started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:01.391: INFO: cilium-4tnhd started at 2023-01-06 06:25:38 +0000 UTC (1+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:43:01.391: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:43:01.391: INFO: pod-configmaps-51474e78-2206-4891-9e15-f0630feea471 started at 2023-01-06 06:43:00 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container env-test ready: false, restart count 0 Jan 6 06:43:01.391: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g7ftv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:01.391: INFO: rs-mpx98 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container donothing ready: true, restart count 0 Jan 6 06:43:01.391: INFO: dns-test-809ded8f-de8a-4c44-9545-585f12522763 started at 2023-01-06 06:36:36 +0000 UTC (0+3 container statuses recorded) Jan 6 06:43:01.391: INFO: Container jessie-querier ready: false, restart count 0 Jan 6 06:43:01.391: INFO: Container querier ready: false, restart count 0 Jan 6 06:43:01.391: INFO: Container webserver ready: false, restart count 0 Jan 6 06:43:01.391: INFO: ebs-csi-node-w4gks started at 2023-01-06 06:25:38 +0000 UTC (0+3 container statuses recorded) Jan 6 06:43:01.391: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:01.391: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:01.391: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:43:01.391: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-9jl5j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:01.391: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-727r8 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:01.391: INFO: sample-webhook-deployment-865554f4d9-xx66r started at 2023-01-06 06:41:15 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container sample-webhook ready: false, restart count 0 Jan 6 06:43:01.391: INFO: pod-a782d690-ad63-4815-a2c4-dad0d0dd28de started at 2023-01-06 06:36:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:43:01.391: INFO: hostpath-symlink-prep-provisioning-7481 started at 2023-01-06 06:42:57 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container init-volume-provisioning-7481 ready: false, restart count 0 Jan 6 06:43:01.391: INFO: affinity-clusterip-transition-9mbw6 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container affinity-clusterip-transition ready: true, restart count 0 Jan 6 06:43:01.391: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-wvnkl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:01.391: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bqlxl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:01.391: INFO: pod-subpath-test-projected-7vlp started at 2023-01-06 06:38:17 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container test-container-subpath-projected-7vlp ready: false, restart count 0 Jan 6 06:43:01.391: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n4gvl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:01.391: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nljmx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:01.391: INFO: hostexec started at 2023-01-06 06:42:54 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:01.391: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:43:02.031: INFO: Latency metrics for node i-00e2a3416f09a146a Jan 6 06:43:02.031: INFO: Logging node info for node i-038260c95b7cbf8dd Jan 6 06:43:02.063: INFO: Node Info: &Node{ObjectMeta:{i-038260c95b7cbf8dd ba495758-87ae-4472-b9d2-10e6fd017588 23083 0 2023-01-06 06:25:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-038260c95b7cbf8dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-038260c95b7cbf8dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.153 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-188":"i-038260c95b7cbf8dd","csi-hostpath-provisioning-4332":"i-038260c95b7cbf8dd","ebs.csi.aws.com":"i-038260c95b7cbf8dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:41:18 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:41:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-038260c95b7cbf8dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:26:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.153,},NodeAddress{Type:ExternalIP,Address:35.183.20.213,},NodeAddress{Type:InternalDNS,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-183-20-213.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dcb30d66cfec0075096c81f360304,SystemUUID:ec2dcb30-d66c-fec0-0750-96c81f360304,BootID:d74ef702-20db-4c1a-ac66-e72d9b82565b,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252 kubernetes.io/csi/csi-hostpath-provisioning-4332^1e8f61b4-8d8d-11ed-93d1-620a615b4ed2],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-4332^1e8f61b4-8d8d-11ed-93d1-620a615b4ed2,DevicePath:,},},Config:nil,},} Jan 6 06:43:02.063: INFO: Logging kubelet events for node i-038260c95b7cbf8dd Jan 6 06:43:02.098: INFO: Logging pods the kubelet thinks is on node i-038260c95b7cbf8dd Jan 6 06:43:02.137: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4x2wx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.138: INFO: affinity-clusterip-transition-nlpm8 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:43:02.138: INFO: hostexec-i-038260c95b7cbf8dd-mzglw started at 2023-01-06 06:40:56 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:43:02.138: INFO: pod-subpath-test-preprovisionedpv-6m4h started at 2023-01-06 06:41:10 +0000 UTC (1+2 container statuses recorded) Jan 6 06:43:02.138: INFO: Init container test-init-subpath-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:43:02.138: INFO: Container test-container-subpath-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:43:02.138: INFO: Container test-container-volume-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:43:02.138: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pkzq2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.138: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4cf9x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.138: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-p252s started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.138: INFO: coredns-559769c974-tj9mr started at 2023-01-06 06:26:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container coredns ready: true, restart count 0 Jan 6 06:43:02.138: INFO: rs-z75vx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:02.138: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-lh5x9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:43:02.138: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-vrx5z started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.138: INFO: pod-subpath-test-dynamicpv-sntd started at 2023-01-06 06:41:17 +0000 UTC (1+2 container statuses recorded) Jan 6 06:43:02.138: INFO: Init container test-init-subpath-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:43:02.138: INFO: Container test-container-subpath-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:43:02.138: INFO: Container test-container-volume-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:43:02.138: INFO: cilium-9n89s started at 2023-01-06 06:25:58 +0000 UTC (1+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:43:02.138: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:53 +0000 UTC (0+7 container statuses recorded) Jan 6 06:43:02.138: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container hostpath ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:43:02.138: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-6bp9g started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.138: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jnnxp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:43:02.138: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-ddpcp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.138: INFO: rs-zmb4t started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container donothing ready: true, restart count 0 Jan 6 06:43:02.138: INFO: hostexec-i-038260c95b7cbf8dd-ldm4j started at 2023-01-06 06:38:03 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:43:02.138: INFO: ebs-csi-node-bds8q started at 2023-01-06 06:25:58 +0000 UTC (0+3 container statuses recorded) Jan 6 06:43:02.138: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:43:02.138: INFO: pod-subpath-test-dynamicpv-482k started at 2023-01-06 06:41:16 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container test-container-subpath-dynamicpv-482k ready: false, restart count 0 Jan 6 06:43:02.138: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kssp4 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.138: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:36 +0000 UTC (0+7 container statuses recorded) Jan 6 06:43:02.138: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container hostpath ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:02.138: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:43:02.138: INFO: pod-a47b83f9-cc6f-4f6a-9143-1f820cb0f680 started at 2023-01-06 06:38:08 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.138: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:43:02.464: INFO: Latency metrics for node i-038260c95b7cbf8dd Jan 6 06:43:02.464: INFO: Logging node info for node i-03c3347a40904af85 Jan 6 06:43:02.495: INFO: Node Info: &Node{ObjectMeta:{i-03c3347a40904af85 acf58f94-6029-4390-a68e-e4dc4881fbb2 23391 0 2023-01-06 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03c3347a40904af85 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-03c3347a40904af85 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03c3347a40904af85"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:37:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:42:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-03c3347a40904af85,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.54,},NodeAddress{Type:ExternalIP,Address:15.223.65.129,},NodeAddress{Type:InternalDNS,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-223-65-129.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be680388baaf810ad9be3463c2150,SystemUUID:ec2be680-388b-aaf8-10ad-9be3463c2150,BootID:e07e85b2-353d-46e6-bf6b-941e6e0ae86a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4,DevicePath:,},},Config:nil,},} Jan 6 06:43:02.496: INFO: Logging kubelet events for node i-03c3347a40904af85 Jan 6 06:43:02.531: INFO: Logging pods the kubelet thinks is on node i-03c3347a40904af85 Jan 6 06:43:02.570: INFO: hostexec-i-03c3347a40904af85-8ntd8 started at 2023-01-06 06:42:16 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:43:02.570: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-tkmjc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:43:02.570: INFO: podecd1684a-4613-4907-b951-ddd2cbe92f5f started at 2023-01-06 06:38:00 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container nginx ready: false, restart count 0 Jan 6 06:43:02.570: INFO: rs-q66kq started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container donothing ready: true, restart count 0 Jan 6 06:43:02.570: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jtjnf started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.570: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:41:47 +0000 UTC (0+7 container statuses recorded) Jan 6 06:43:02.570: INFO: Container csi-attacher ready: false, restart count 0 Jan 6 06:43:02.570: INFO: Container csi-provisioner ready: false, restart count 0 Jan 6 06:43:02.570: INFO: Container csi-resizer ready: false, restart count 0 Jan 6 06:43:02.570: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 6 06:43:02.570: INFO: Container hostpath ready: false, restart count 0 Jan 6 06:43:02.570: INFO: Container liveness-probe ready: false, restart count 0 Jan 6 06:43:02.570: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 6 06:43:02.570: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-62rpq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.570: INFO: pod-6faed302-3756-4d38-8d98-81f254795610 started at 2023-01-06 06:42:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:43:02.570: INFO: pod-2 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container donothing ready: true, restart count 0 Jan 6 06:43:02.570: INFO: rs-zvxqx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container donothing ready: true, restart count 0 Jan 6 06:43:02.570: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-xskq7 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.570: INFO: ebs-csi-node-lvpjv started at 2023-01-06 06:26:09 +0000 UTC (0+3 container statuses recorded) Jan 6 06:43:02.570: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:02.570: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:02.570: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:43:02.570: INFO: pod-configmaps-b6eb366a-a1a5-44ab-ac82-5dd5e2aed984 started at 2023-01-06 06:41:23 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container agnhost-container ready: false, restart count 0 Jan 6 06:43:02.570: INFO: downwardapi-volume-52e6a5ae-b501-4ba1-be31-d95abea8b4c8 started at 2023-01-06 06:42:47 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container client-container ready: false, restart count 0 Jan 6 06:43:02.570: INFO: cilium-ww8tr started at 2023-01-06 06:26:09 +0000 UTC (1+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:43:02.570: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:43:02.570: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pxg45 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.570: INFO: inline-volume-tester-n28z7 started at 2023-01-06 06:35:53 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 6 06:43:02.570: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g8tzv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.570: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pq9p9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.570: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-s7f2j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.570: INFO: test-ss-0 started at 2023-01-06 06:35:50 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container webserver ready: false, restart count 0 Jan 6 06:43:02.570: INFO: affinity-clusterip-timeout-56jbj started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 Jan 6 06:43:02.570: INFO: affinity-clusterip-transition-j2cw9 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:43:02.570: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-q8g6m started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.570: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4ch6k started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.570: INFO: rs-kb44r started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.570: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:02.784: INFO: Latency metrics for node i-03c3347a40904af85 Jan 6 06:43:02.784: INFO: Logging node info for node i-04cab7fc0ec1601e6 Jan 6 06:43:02.816: INFO: Node Info: &Node{ObjectMeta:{i-04cab7fc0ec1601e6 2d853506-d4dc-4e6a-ad93-16f5ebcea997 22694 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04cab7fc0ec1601e6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04cab7fc0ec1601e6 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-04cab7fc0ec1601e6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-06 06:40:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04cab7fc0ec1601e6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.215,},NodeAddress{Type:ExternalIP,Address:15.222.251.140,},NodeAddress{Type:InternalDNS,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-251-140.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2b15a5f89be6a782a1e3e9076afdcb,SystemUUID:ec2b15a5-f89b-e6a7-82a1-e3e9076afdcb,BootID:c698d6b6-6a59-41c3-8d65-390a1e2ed279,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:43:02.816: INFO: Logging kubelet events for node i-04cab7fc0ec1601e6 Jan 6 06:43:02.850: INFO: Logging pods the kubelet thinks is on node i-04cab7fc0ec1601e6 Jan 6 06:43:02.903: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4fsc6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.903: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bzw88 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.903: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kvds2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.903: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n99wc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.903: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4wmx5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.903: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-dz4q9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.903: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-svh2x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:43:02.903: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kdmj6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.903: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-sj6xh started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.903: INFO: pod-0 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:02.903: INFO: ebs-csi-node-db2rw started at 2023-01-06 06:25:37 +0000 UTC (0+3 container statuses recorded) Jan 6 06:43:02.903: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:02.903: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:02.903: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:43:02.903: INFO: cilium-n8ld4 started at 2023-01-06 06:25:37 +0000 UTC (1+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:43:02.903: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:43:02.903: INFO: coredns-559769c974-qmgjs started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container coredns ready: true, restart count 0 Jan 6 06:43:02.903: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nfchl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:02.903: INFO: rs-6vhk6 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:02.903: INFO: coredns-autoscaler-7cb5c5b969-6txvw started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container autoscaler ready: true, restart count 0 Jan 6 06:43:02.903: INFO: affinity-clusterip-timeout-qvtbc started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:43:02.903: INFO: pod-1 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:02.903: INFO: rs-4ks6z started at 2023-01-06 06:36:23 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:02.903: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:03.072: INFO: Latency metrics for node i-04cab7fc0ec1601e6 Jan 6 06:43:03.072: INFO: Logging node info for node i-0dfd4e56c03b27188 Jan 6 06:43:03.103: INFO: Node Info: &Node{ObjectMeta:{i-0dfd4e56c03b27188 2628d33e-cb25-41db-a644-b167c0d84591 23472 0 2023-01-06 06:23:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0dfd4e56c03b27188 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.87 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0dfd4e56c03b27188"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-06 06:23:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-06 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-06 06:42:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0dfd4e56c03b27188,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:24:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.87,},NodeAddress{Type:ExternalIP,Address:15.222.64.3,},NodeAddress{Type:InternalDNS,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-64-3.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23482dbb2dc570b65c2c6afcd72a4c,SystemUUID:ec23482d-bb2d-c570-b65c-2c6afcd72a4c,BootID:e04f4923-c80f-4e9b-852a-b2b114eb6541,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43434708,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805585,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967331,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:43:03.103: INFO: Logging kubelet events for node i-0dfd4e56c03b27188 Jan 6 06:43:03.143: INFO: Logging pods the kubelet thinks is on node i-0dfd4e56c03b27188 Jan 6 06:43:03.179: INFO: kops-controller-27r6m started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:03.179: INFO: Container kops-controller ready: true, restart count 0 Jan 6 06:43:03.179: INFO: etcd-manager-events-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:03.179: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:43:03.179: INFO: etcd-manager-main-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:03.179: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:43:03.179: INFO: kube-apiserver-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+2 container statuses recorded) Jan 6 06:43:03.179: INFO: Container healthcheck ready: true, restart count 0 Jan 6 06:43:03.179: INFO: Container kube-apiserver ready: true, restart count 1 Jan 6 06:43:03.179: INFO: kube-scheduler-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:03.179: INFO: Container kube-scheduler ready: true, restart count 0 Jan 6 06:43:03.179: INFO: dns-controller-69987775c6-76fgw started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:03.179: INFO: Container dns-controller ready: true, restart count 0 Jan 6 06:43:03.179: INFO: cilium-operator-5dd44dc49f-wnkl6 started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:03.179: INFO: Container cilium-operator ready: true, restart count 1 Jan 6 06:43:03.179: INFO: ebs-csi-controller-89b649c94-slv9n started at 2023-01-06 06:24:25 +0000 UTC (0+5 container statuses recorded) Jan 6 06:43:03.179: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:43:03.179: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:43:03.179: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:43:03.179: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:03.179: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:03.179: INFO: kube-controller-manager-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:03.179: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 6 06:43:03.179: INFO: ebs-csi-node-x7dz5 started at 2023-01-06 06:24:25 +0000 UTC (0+3 container statuses recorded) Jan 6 06:43:03.179: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:03.179: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:03.179: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:43:03.179: INFO: aws-cloud-controller-manager-snk2c started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:03.179: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 6 06:43:03.179: INFO: cilium-j2vh5 started at 2023-01-06 06:24:25 +0000 UTC (1+1 container statuses recorded) Jan 6 06:43:03.179: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:43:03.179: INFO: Container cilium-agent ready: true, restart count 1 Jan 6 06:43:03.360: INFO: Latency metrics for node i-0dfd4e56c03b27188 [DeferCleanup (Each)] [sig-api-machinery] Generated clientset tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "clientset-9420" for this suite. �[38;5;243m01/06/23 06:43:03.36�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDeployment\sshould\srun\sthe\slifecycle\sof\sa\sDeployment\s\[Conformance\]$'
test/e2e/apps/deployment.go:390 k8s.io/kubernetes/test/e2e/apps.glob..func5.13() test/e2e/apps/deployment.go:390 +0x22fcfrom junit_01.xml
[BeforeEach] [sig-apps] Deployment set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/06/23 06:35:38.902�[0m Jan 6 06:35:38.903: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename deployment �[38;5;243m01/06/23 06:35:38.904�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/06/23 06:35:38.999�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/06/23 06:35:39.06�[0m [BeforeEach] [sig-apps] Deployment test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-apps] Deployment test/e2e/apps/deployment.go:91 [It] should run the lifecycle of a Deployment [Conformance] test/e2e/apps/deployment.go:185 �[1mSTEP:�[0m creating a Deployment �[38;5;243m01/06/23 06:35:39.156�[0m �[1mSTEP:�[0m waiting for Deployment to be created �[38;5;243m01/06/23 06:35:39.192�[0m �[1mSTEP:�[0m waiting for all Replicas to be Ready �[38;5;243m01/06/23 06:35:39.233�[0m Jan 6 06:35:39.264: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 and labels map[test-deployment-static:true] Jan 6 06:35:39.264: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 and labels map[test-deployment-static:true] Jan 6 06:35:39.264: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 and labels map[test-deployment-static:true] Jan 6 06:35:39.264: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 and labels map[test-deployment-static:true] Jan 6 06:35:39.264: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 and labels map[test-deployment-static:true] Jan 6 06:35:39.264: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 and labels map[test-deployment-static:true] Jan 6 06:35:39.264: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 and labels map[test-deployment-static:true] Jan 6 06:35:39.264: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 and labels map[test-deployment-static:true] Jan 6 06:35:44.522: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 and labels map[test-deployment-static:true] Jan 6 06:35:44.522: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 and labels map[test-deployment-static:true] Jan 6 06:35:48.478: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 and labels map[test-deployment-static:true] �[1mSTEP:�[0m patching the Deployment �[38;5;243m01/06/23 06:35:48.478�[0m W0106 06:35:48.513002 6799 warnings.go:70] unknown field "spec.template.spec.TerminationGracePeriodSeconds" Jan 6 06:35:48.551: INFO: observed event type ADDED �[1mSTEP:�[0m waiting for Replicas to scale �[38;5;243m01/06/23 06:35:48.551�[0m Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 0 Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 Jan 6 06:35:48.584: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 Jan 6 06:35:48.585: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 Jan 6 06:35:48.585: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 Jan 6 06:35:48.585: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 Jan 6 06:35:48.585: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 Jan 6 06:35:48.585: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 Jan 6 06:35:48.585: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 Jan 6 06:35:48.585: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 Jan 6 06:35:48.585: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 Jan 6 06:35:48.591: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 Jan 6 06:35:48.591: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 Jan 6 06:35:54.180: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 Jan 6 06:35:54.180: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 Jan 6 06:35:54.200: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 �[1mSTEP:�[0m listing Deployments �[38;5;243m01/06/23 06:35:54.2�[0m Jan 6 06:35:54.233: INFO: Found test-deployment with labels: map[test-deployment:patched test-deployment-static:true] �[1mSTEP:�[0m updating the Deployment �[38;5;243m01/06/23 06:35:54.233�[0m Jan 6 06:35:54.305: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 �[1mSTEP:�[0m fetching the DeploymentStatus �[38;5;243m01/06/23 06:35:54.305�[0m Jan 6 06:35:54.374: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] Jan 6 06:35:54.374: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] Jan 6 06:35:54.374: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] Jan 6 06:35:54.374: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] Jan 6 06:35:54.374: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 1 and labels map[test-deployment:updated test-deployment-static:true] Jan 6 06:36:05.130: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 and labels map[test-deployment:updated test-deployment-static:true] Jan 6 06:36:05.149: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 and labels map[test-deployment:updated test-deployment-static:true] Jan 6 06:36:05.157: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 and labels map[test-deployment:updated test-deployment-static:true] Jan 6 06:36:05.177: INFO: observed Deployment test-deployment in namespace deployment-7210 with ReadyReplicas 2 and labels map[test-deployment:updated test-deployment-static:true] Jan 6 06:40:54.344: INFO: Unexpected error: failed to see replicas of test-deployment in namespace deployment-7210 scale to requested amount of 2: <*errors.errorString | 0xc0001efa20>: { s: "timed out waiting for the condition", } Jan 6 06:40:54.344: FAIL: failed to see replicas of test-deployment in namespace deployment-7210 scale to requested amount of 2: timed out waiting for the condition Full Stack Trace k8s.io/kubernetes/test/e2e/apps.glob..func5.13() test/e2e/apps/deployment.go:390 +0x22fc [AfterEach] [sig-apps] Deployment test/e2e/apps/deployment.go:84 Jan 6 06:40:54.376: INFO: Deployment "test-deployment": &Deployment{ObjectMeta:{test-deployment deployment-7210 f4578548-755b-4d5d-b79b-565e148399d9 20519 3 2023-01-06 06:35:39 +0000 UTC <nil> <nil> map[test-deployment:updated test-deployment-static:true] map[deployment.kubernetes.io/revision:3] [] [] [{e2e.test Update apps/v1 2023-01-06 06:35:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:test-deployment":{},"f:test-deployment-static":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:test-deployment-static":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-06 06:36:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}}},"f:status":{"f:availableReplicas":{},"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Progressing\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{},"f:unavailableReplicas":{},"f:updatedReplicas":{}}} status}]},Spec:DeploymentSpec{Replicas:*2,Selector:&v1.LabelSelector{MatchLabels:map[string]string{test-deployment-static: true,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[test-deployment-static:true] map[] [] [] []} {[] [] [{test-deployment registry.k8s.io/e2e-test-images/httpd:2.4.38-4 [] [] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc0044a20d8 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},Strategy:DeploymentStrategy{Type:RollingUpdate,RollingUpdate:&RollingUpdateDeployment{MaxUnavailable:25%!,(MISSING)MaxSurge:25%!,(MISSING)},},MinReadySeconds:0,RevisionHistoryLimit:*10,Paused:false,ProgressDeadlineSeconds:*600,},Status:DeploymentStatus{ObservedGeneration:3,Replicas:3,UpdatedReplicas:2,AvailableReplicas:2,UnavailableReplicas:1,Conditions:[]DeploymentCondition{DeploymentCondition{Type:Available,Status:True,Reason:MinimumReplicasAvailable,Message:Deployment has minimum availability.,LastUpdateTime:2023-01-06 06:36:05 +0000 UTC,LastTransitionTime:2023-01-06 06:36:05 +0000 UTC,},DeploymentCondition{Type:Progressing,Status:True,Reason:ReplicaSetUpdated,Message:ReplicaSet "test-deployment-7b7876f9d6" is progressing.,LastUpdateTime:2023-01-06 06:36:05 +0000 UTC,LastTransitionTime:2023-01-06 06:35:39 +0000 UTC,},},ReadyReplicas:2,CollisionCount:nil,},} Jan 6 06:40:54.408: INFO: New ReplicaSet "test-deployment-7b7876f9d6" of Deployment "test-deployment": &ReplicaSet{ObjectMeta:{test-deployment-7b7876f9d6 deployment-7210 6e2a43ba-af42-49ca-aa9f-10032babcfd5 20518 2 2023-01-06 06:35:54 +0000 UTC <nil> <nil> map[pod-template-hash:7b7876f9d6 test-deployment-static:true] map[deployment.kubernetes.io/desired-replicas:2 deployment.kubernetes.io/max-replicas:3 deployment.kubernetes.io/revision:3] [{apps/v1 Deployment test-deployment f4578548-755b-4d5d-b79b-565e148399d9 0xc0044a24a7 0xc0044a24a8}] [] [{kube-controller-manager Update apps/v1 2023-01-06 06:36:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"f4578548-755b-4d5d-b79b-565e148399d9\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-06 06:36:05 +0000 UTC FieldsV1 {"f:status":{"f:availableReplicas":{},"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*2,Selector:&v1.LabelSelector{MatchLabels:map[string]string{pod-template-hash: 7b7876f9d6,test-deployment-static: true,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[pod-template-hash:7b7876f9d6 test-deployment-static:true] map[] [] [] []} {[] [] [{test-deployment registry.k8s.io/e2e-test-images/httpd:2.4.38-4 [] [] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc0044a2530 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:2,FullyLabeledReplicas:2,ObservedGeneration:2,ReadyReplicas:1,AvailableReplicas:1,Conditions:[]ReplicaSetCondition{},},} Jan 6 06:40:54.408: INFO: All old ReplicaSets of Deployment "test-deployment": Jan 6 06:40:54.408: INFO: &ReplicaSet{ObjectMeta:{test-deployment-f4dbc4647 deployment-7210 9e912440-9aa6-4ca0-a027-4103732d50d7 20222 3 2023-01-06 06:35:39 +0000 UTC <nil> <nil> map[pod-template-hash:f4dbc4647 test-deployment-static:true] map[deployment.kubernetes.io/desired-replicas:1 deployment.kubernetes.io/max-replicas:2 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment test-deployment f4578548-755b-4d5d-b79b-565e148399d9 0xc0044a2687 0xc0044a2688}] [] [{kube-controller-manager Update apps/v1 2023-01-06 06:35:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"f4578548-755b-4d5d-b79b-565e148399d9\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-06 06:35:54 +0000 UTC FieldsV1 {"f:status":{"f:observedGeneration":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*0,Selector:&v1.LabelSelector{MatchLabels:map[string]string{pod-template-hash: f4dbc4647,test-deployment-static: true,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[pod-template-hash:f4dbc4647 test-deployment-static:true] map[] [] [] []} {[] [] [{test-deployment registry.k8s.io/e2e-test-images/agnhost:2.43 [] [] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc0044a2710 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:0,FullyLabeledReplicas:0,ObservedGeneration:3,ReadyReplicas:0,AvailableReplicas:0,Conditions:[]ReplicaSetCondition{},},} Jan 6 06:40:54.408: INFO: &ReplicaSet{ObjectMeta:{test-deployment-7df74c55ff deployment-7210 ed0cbf0a-2485-42ca-840b-f737989d5da5 20514 3 2023-01-06 06:35:48 +0000 UTC <nil> <nil> map[pod-template-hash:7df74c55ff test-deployment-static:true] map[deployment.kubernetes.io/desired-replicas:2 deployment.kubernetes.io/max-replicas:3 deployment.kubernetes.io/revision:2] [{apps/v1 Deployment test-deployment f4578548-755b-4d5d-b79b-565e148399d9 0xc0044a2597 0xc0044a2598}] [] [{kube-controller-manager Update apps/v1 2023-01-06 06:36:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"f4578548-755b-4d5d-b79b-565e148399d9\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-06 06:36:05 +0000 UTC FieldsV1 {"f:status":{"f:availableReplicas":{},"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*1,Selector:&v1.LabelSelector{MatchLabels:map[string]string{pod-template-hash: 7df74c55ff,test-deployment-static: true,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{ 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[pod-template-hash:7df74c55ff test-deployment-static:true] map[] [] [] []} {[] [] [{test-deployment registry.k8s.io/pause:3.9 [] [] [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc0044a2620 <nil> ClusterFirst map[] <nil> false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} [] nil default-scheduler [] [] <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:1,FullyLabeledReplicas:1,ObservedGeneration:3,ReadyReplicas:1,AvailableReplicas:1,Conditions:[]ReplicaSetCondition{},},} Jan 6 06:40:54.440: INFO: Pod "test-deployment-7b7876f9d6-6rvwb" is available: &Pod{ObjectMeta:{test-deployment-7b7876f9d6-6rvwb test-deployment-7b7876f9d6- deployment-7210 fedf5598-7620-4a09-9aa2-565eade3d79a 20505 0 2023-01-06 06:35:54 +0000 UTC <nil> <nil> map[pod-template-hash:7b7876f9d6 test-deployment-static:true] map[] [{apps/v1 ReplicaSet test-deployment-7b7876f9d6 6e2a43ba-af42-49ca-aa9f-10032babcfd5 0xc0044240d7 0xc0044240d8}] [] [{kube-controller-manager Update v1 2023-01-06 06:35:54 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"6e2a43ba-af42-49ca-aa9f-10032babcfd5\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-06 06:36:05 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.40.2\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-srd9p,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:test-deployment,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-srd9p,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*1,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-00e2a3416f09a146a,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:35:54 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:35:56 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:35:56 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:35:54 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.41.186,PodIP:172.20.40.2,StartTime:2023-01-06 06:35:54 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:test-deployment,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-06 06:35:55 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22,ContainerID:containerd://833cb1b0aaaa17fbe1b6b95b909a49b13e865e02d1f2faeaef43c140f0df9c4a,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.40.2,},},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 6 06:40:54.440: INFO: Pod "test-deployment-7b7876f9d6-r2r9k" is not available: &Pod{ObjectMeta:{test-deployment-7b7876f9d6-r2r9k test-deployment-7b7876f9d6- deployment-7210 d9f8a942-bca5-416f-8e63-732d9d124bf4 20663 0 2023-01-06 06:36:05 +0000 UTC <nil> <nil> map[pod-template-hash:7b7876f9d6 test-deployment-static:true] map[] [{apps/v1 ReplicaSet test-deployment-7b7876f9d6 6e2a43ba-af42-49ca-aa9f-10032babcfd5 0xc0044242e7 0xc0044242e8}] [] [{kube-controller-manager Update v1 2023-01-06 06:36:05 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"6e2a43ba-af42-49ca-aa9f-10032babcfd5\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-06 06:36:15 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-2dclf,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:test-deployment,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-2dclf,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*1,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-03c3347a40904af85,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:36:05 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:36:05 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [test-deployment],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:36:05 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [test-deployment],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:36:05 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.54.54,PodIP:,StartTime:2023-01-06 06:36:05 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:test-deployment,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/httpd:2.4.38-4,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},} Jan 6 06:40:54.440: INFO: Pod "test-deployment-7df74c55ff-q4xlh" is available: &Pod{ObjectMeta:{test-deployment-7df74c55ff-q4xlh test-deployment-7df74c55ff- deployment-7210 738947bc-b134-4d4b-9e4e-4361df44e7d5 20215 0 2023-01-06 06:35:48 +0000 UTC <nil> <nil> map[pod-template-hash:7df74c55ff test-deployment-static:true] map[] [{apps/v1 ReplicaSet test-deployment-7df74c55ff ed0cbf0a-2485-42ca-840b-f737989d5da5 0xc0044244a7 0xc0044244a8}] [] [{kube-controller-manager Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:pod-template-hash":{},"f:test-deployment-static":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"ed0cbf0a-2485-42ca-840b-f737989d5da5\"}":{}}},"f:spec":{"f:containers":{"k:{\"name\":\"test-deployment\"}":{".":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-06 06:35:54 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.53.87\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-sxbzf,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:test-deployment,Image:registry.k8s.io/pause:3.9,Command:[],Args:[],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-sxbzf,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*1,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-038260c95b7cbf8dd,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:35:48 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:35:50 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:35:50 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-06 06:35:48 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.61.153,PodIP:172.20.53.87,StartTime:2023-01-06 06:35:48 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:test-deployment,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-06 06:35:50 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:registry.k8s.io/pause:3.9,ImageID:registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097,ContainerID:containerd://126f18d6035a9e3b76110a25270ecbfff6b490bae2266791ce1aa5252003f280,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.53.87,},},EphemeralContainerStatuses:[]ContainerStatus{},},} [AfterEach] [sig-apps] Deployment test/e2e/framework/node/init/init.go:32 Jan 6 06:40:54.440: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] Deployment test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-apps] Deployment dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/06/23 06:40:54.472�[0m �[1mSTEP:�[0m Collecting events from namespace "deployment-7210". �[38;5;243m01/06/23 06:40:54.472�[0m �[1mSTEP:�[0m Found 48 events. �[38;5;243m01/06/23 06:40:54.505�[0m Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:39 +0000 UTC - event for test-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-deployment-f4dbc4647 to 2 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:39 +0000 UTC - event for test-deployment-f4dbc4647: {replicaset-controller } SuccessfulCreate: Created pod: test-deployment-f4dbc4647-5zppp Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:39 +0000 UTC - event for test-deployment-f4dbc4647: {replicaset-controller } SuccessfulCreate: Created pod: test-deployment-f4dbc4647-shlr8 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:39 +0000 UTC - event for test-deployment-f4dbc4647-5zppp: {default-scheduler } Scheduled: Successfully assigned deployment-7210/test-deployment-f4dbc4647-5zppp to i-00e2a3416f09a146a Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:39 +0000 UTC - event for test-deployment-f4dbc4647-shlr8: {default-scheduler } Scheduled: Successfully assigned deployment-7210/test-deployment-f4dbc4647-shlr8 to i-03c3347a40904af85 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:40 +0000 UTC - event for test-deployment-f4dbc4647-5zppp: {kubelet i-00e2a3416f09a146a} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:40 +0000 UTC - event for test-deployment-f4dbc4647-5zppp: {kubelet i-00e2a3416f09a146a} Created: Created container test-deployment Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:40 +0000 UTC - event for test-deployment-f4dbc4647-5zppp: {kubelet i-00e2a3416f09a146a} Started: Started container test-deployment Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:40 +0000 UTC - event for test-deployment-f4dbc4647-shlr8: {kubelet i-03c3347a40904af85} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:40 +0000 UTC - event for test-deployment-f4dbc4647-shlr8: {kubelet i-03c3347a40904af85} Started: Started container test-deployment Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:40 +0000 UTC - event for test-deployment-f4dbc4647-shlr8: {kubelet i-03c3347a40904af85} Created: Created container test-deployment Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:48 +0000 UTC - event for test-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-deployment-7df74c55ff to 1 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:48 +0000 UTC - event for test-deployment: {deployment-controller } ScalingReplicaSet: Scaled down replica set test-deployment-f4dbc4647 to 1 from 2 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:48 +0000 UTC - event for test-deployment-7df74c55ff: {replicaset-controller } SuccessfulCreate: Created pod: test-deployment-7df74c55ff-q4xlh Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:48 +0000 UTC - event for test-deployment-7df74c55ff-q4xlh: {default-scheduler } Scheduled: Successfully assigned deployment-7210/test-deployment-7df74c55ff-q4xlh to i-038260c95b7cbf8dd Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:48 +0000 UTC - event for test-deployment-f4dbc4647: {replicaset-controller } SuccessfulDelete: Deleted pod: test-deployment-f4dbc4647-shlr8 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:48 +0000 UTC - event for test-deployment-f4dbc4647-shlr8: {kubelet i-03c3347a40904af85} Killing: Stopping container test-deployment Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:49 +0000 UTC - event for test-deployment-7df74c55ff-q4xlh: {kubelet i-038260c95b7cbf8dd} Pulled: Container image "registry.k8s.io/pause:3.9" already present on machine Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:49 +0000 UTC - event for test-deployment-7df74c55ff-q4xlh: {kubelet i-038260c95b7cbf8dd} Created: Created container test-deployment Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:50 +0000 UTC - event for test-deployment-7df74c55ff-q4xlh: {kubelet i-038260c95b7cbf8dd} Started: Started container test-deployment Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:54 +0000 UTC - event for test-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-deployment-7df74c55ff to 2 from 1 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:54 +0000 UTC - event for test-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-deployment-7b7876f9d6 to 1 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:54 +0000 UTC - event for test-deployment: {deployment-controller } ScalingReplicaSet: Scaled down replica set test-deployment-f4dbc4647 to 0 from 1 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:54 +0000 UTC - event for test-deployment-7b7876f9d6: {replicaset-controller } SuccessfulCreate: Created pod: test-deployment-7b7876f9d6-6rvwb Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:54 +0000 UTC - event for test-deployment-7b7876f9d6-6rvwb: {default-scheduler } Scheduled: Successfully assigned deployment-7210/test-deployment-7b7876f9d6-6rvwb to i-00e2a3416f09a146a Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:54 +0000 UTC - event for test-deployment-7df74c55ff: {replicaset-controller } SuccessfulCreate: Created pod: test-deployment-7df74c55ff-kz8fj Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:54 +0000 UTC - event for test-deployment-7df74c55ff-kz8fj: {default-scheduler } Scheduled: Successfully assigned deployment-7210/test-deployment-7df74c55ff-kz8fj to i-00e2a3416f09a146a Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:54 +0000 UTC - event for test-deployment-f4dbc4647: {replicaset-controller } SuccessfulDelete: Deleted pod: test-deployment-f4dbc4647-5zppp Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:54 +0000 UTC - event for test-deployment-f4dbc4647-5zppp: {kubelet i-00e2a3416f09a146a} Killing: Stopping container test-deployment Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:55 +0000 UTC - event for test-deployment-7b7876f9d6-6rvwb: {kubelet i-00e2a3416f09a146a} Created: Created container test-deployment Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:55 +0000 UTC - event for test-deployment-7b7876f9d6-6rvwb: {kubelet i-00e2a3416f09a146a} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:55 +0000 UTC - event for test-deployment-7b7876f9d6-6rvwb: {kubelet i-00e2a3416f09a146a} Started: Started container test-deployment Jan 6 06:40:54.505: INFO: At 2023-01-06 06:35:55 +0000 UTC - event for test-deployment-7df74c55ff-kz8fj: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0472fd4c39ad4f87c661141993ae40ab21624afbea33c3e4b78ffc0ed28e4b40": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:40:54.505: INFO: At 2023-01-06 06:36:05 +0000 UTC - event for test-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-deployment-7b7876f9d6 to 2 from 1 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:36:05 +0000 UTC - event for test-deployment: {deployment-controller } ScalingReplicaSet: Scaled down replica set test-deployment-7df74c55ff to 1 from 2 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:36:05 +0000 UTC - event for test-deployment-7b7876f9d6: {replicaset-controller } SuccessfulCreate: Created pod: test-deployment-7b7876f9d6-r2r9k Jan 6 06:40:54.505: INFO: At 2023-01-06 06:36:05 +0000 UTC - event for test-deployment-7b7876f9d6-r2r9k: {default-scheduler } Scheduled: Successfully assigned deployment-7210/test-deployment-7b7876f9d6-r2r9k to i-03c3347a40904af85 Jan 6 06:40:54.505: INFO: At 2023-01-06 06:36:05 +0000 UTC - event for test-deployment-7df74c55ff: {replicaset-controller } SuccessfulDelete: Deleted pod: test-deployment-7df74c55ff-kz8fj Jan 6 06:40:54.505: INFO: At 2023-01-06 06:36:06 +0000 UTC - event for test-deployment-7b7876f9d6-r2r9k: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "886f907c30536c4b65f511515ac13d41027dca33e1f7e0936e0faba03d8b3808": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:40:54.505: INFO: At 2023-01-06 06:36:21 +0000 UTC - event for test-deployment-7b7876f9d6-r2r9k: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ec1d1b81bfbf902151b2f35885bc8756e3c3165938e09f098128928a8c35b62a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:40:54.505: INFO: At 2023-01-06 06:36:33 +0000 UTC - event for test-deployment-7b7876f9d6-r2r9k: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f8bd34782512be7099db64565fb266a12881ebfa25ee4a986d9d7fdb0823a177": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:40:54.505: INFO: At 2023-01-06 06:36:45 +0000 UTC - event for test-deployment-7b7876f9d6-r2r9k: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "540f0721979cb480a4b4d6fd3d1d2e89748314cd1ced879940c806339047fc27": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:40:54.505: INFO: At 2023-01-06 06:36:56 +0000 UTC - event for test-deployment-7b7876f9d6-r2r9k: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "148d87f7928672374eaaac2b46e26b4c3cca22a0e68f23c61563cd04befe98ac": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:40:54.505: INFO: At 2023-01-06 06:37:08 +0000 UTC - event for test-deployment-7b7876f9d6-r2r9k: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "03db32c7827a5a830b48aec444ad4bc0e7bfe649f3b528b466facb29aab93b54": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:40:54.505: INFO: At 2023-01-06 06:37:23 +0000 UTC - event for test-deployment-7b7876f9d6-r2r9k: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "55e73553622560afda34390dbcc224ead360e7b7f47bf721c882d452d1530573": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:40:54.505: INFO: At 2023-01-06 06:37:35 +0000 UTC - event for test-deployment-7b7876f9d6-r2r9k: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f3e25c07f0719bfb6ee8b1bd9deeedc3df80a06b1176631af9abaaed62869196": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:40:54.505: INFO: At 2023-01-06 06:37:50 +0000 UTC - event for test-deployment-7b7876f9d6-r2r9k: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2a5d1633240e96e741b507cb53b3e591e04c33cb493c668da8ee69c2a7b48919": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:40:54.505: INFO: At 2023-01-06 06:38:05 +0000 UTC - event for test-deployment-7b7876f9d6-r2r9k: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9dceab66e8c23e278e60a28da11117b45144a63538ea474e4918400febf303f0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:40:54.536: INFO: POD NODE PHASE GRACE CONDITIONS Jan 6 06:40:54.537: INFO: test-deployment-7b7876f9d6-6rvwb i-00e2a3416f09a146a Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:54 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:56 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:56 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:54 +0000 UTC }] Jan 6 06:40:54.537: INFO: test-deployment-7b7876f9d6-r2r9k i-03c3347a40904af85 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:05 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:05 +0000 UTC ContainersNotReady containers with unready status: [test-deployment]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:05 +0000 UTC ContainersNotReady containers with unready status: [test-deployment]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:05 +0000 UTC }] Jan 6 06:40:54.537: INFO: test-deployment-7df74c55ff-q4xlh i-038260c95b7cbf8dd Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:48 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:50 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:50 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:48 +0000 UTC }] Jan 6 06:40:54.537: INFO: Jan 6 06:40:54.610: INFO: Unable to fetch deployment-7210/test-deployment-7b7876f9d6-r2r9k/test-deployment logs: the server rejected our request for an unknown reason (get pods test-deployment-7b7876f9d6-r2r9k) Jan 6 06:40:54.679: INFO: Logging node info for node i-00e2a3416f09a146a Jan 6 06:40:54.710: INFO: Node Info: &Node{ObjectMeta:{i-00e2a3416f09a146a 8b86fb5a-68fd-4aec-8591-934be54479d5 21411 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00e2a3416f09a146a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-00e2a3416f09a146a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.186 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00e2a3416f09a146a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-06 06:36:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-06 06:36:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00e2a3416f09a146a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:36:42 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:36:42 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:36:42 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:36:42 +0000 UTC,LastTransitionTime:2023-01-06 06:25:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.186,},NodeAddress{Type:ExternalIP,Address:3.97.12.121,},NodeAddress{Type:InternalDNS,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-97-12-121.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2895effafa575efe2674497633226d,SystemUUID:ec2895ef-fafa-575e-fe26-74497633226d,BootID:79823d62-e8bb-4de7-91b6-78fb8137f2da,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99,DevicePath:,},},Config:nil,},} Jan 6 06:40:54.711: INFO: Logging kubelet events for node i-00e2a3416f09a146a Jan 6 06:40:54.753: INFO: Logging pods the kubelet thinks is on node i-00e2a3416f09a146a Jan 6 06:40:54.823: INFO: rs-q6qrb started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container donothing ready: false, restart count 0 Jan 6 06:40:54.823: INFO: hostexec-i-00e2a3416f09a146a-prs8x started at 2023-01-06 06:35:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:40:54.823: INFO: cilium-4tnhd started at 2023-01-06 06:25:38 +0000 UTC (1+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:40:54.823: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:40:54.823: INFO: dns-test-809ded8f-de8a-4c44-9545-585f12522763 started at 2023-01-06 06:36:36 +0000 UTC (0+3 container statuses recorded) Jan 6 06:40:54.823: INFO: Container jessie-querier ready: false, restart count 0 Jan 6 06:40:54.823: INFO: Container querier ready: false, restart count 0 Jan 6 06:40:54.823: INFO: Container webserver ready: false, restart count 0 Jan 6 06:40:54.823: INFO: termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3 started at 2023-01-06 06:37:45 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container termination-message-container ready: false, restart count 0 Jan 6 06:40:54.823: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g7ftv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:54.823: INFO: rs-mpx98 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container donothing ready: true, restart count 0 Jan 6 06:40:54.823: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-727r8 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:54.823: INFO: externalname-service-9lqkc started at 2023-01-06 06:37:46 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container externalname-service ready: false, restart count 0 Jan 6 06:40:54.823: INFO: ebs-csi-node-w4gks started at 2023-01-06 06:25:38 +0000 UTC (0+3 container statuses recorded) Jan 6 06:40:54.823: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:40:54.823: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:40:54.823: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:40:54.823: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-9jl5j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:54.823: INFO: pod-a782d690-ad63-4815-a2c4-dad0d0dd28de started at 2023-01-06 06:36:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:40:54.823: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv started at 2023-01-06 06:37:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container sample-crd-conversion-webhook ready: false, restart count 0 Jan 6 06:40:54.823: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-wvnkl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:54.823: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bqlxl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:54.823: INFO: pod-3c46e05e-4424-46fe-8df2-043a3de48bd8 started at 2023-01-06 06:35:59 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container test-container ready: false, restart count 0 Jan 6 06:40:54.823: INFO: affinity-clusterip-transition-9mbw6 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:40:54.823: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nljmx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:54.823: INFO: test-deployment-7b7876f9d6-6rvwb started at 2023-01-06 06:35:54 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container test-deployment ready: true, restart count 0 Jan 6 06:40:54.823: INFO: pod-subpath-test-preprovisionedpv-tm2z started at 2023-01-06 06:35:55 +0000 UTC (0+2 container statuses recorded) Jan 6 06:40:54.823: INFO: Container test-container-subpath-preprovisionedpv-tm2z ready: false, restart count 0 Jan 6 06:40:54.823: INFO: Container test-container-volume-preprovisionedpv-tm2z ready: false, restart count 0 Jan 6 06:40:54.823: INFO: pod-subpath-test-projected-7vlp started at 2023-01-06 06:38:17 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container test-container-subpath-projected-7vlp ready: false, restart count 0 Jan 6 06:40:54.823: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n4gvl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:54.823: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-z6bp5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:54.823: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-rd5kq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:54.823: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-5v5xp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:40:54.823: INFO: rs-xjfv2 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container donothing ready: false, restart count 0 Jan 6 06:40:54.823: INFO: affinity-clusterip-timeout-94b4c started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:40:54.823: INFO: pod-3e08c759-655f-40a7-9a02-b3d5823ccebc started at 2023-01-06 06:39:29 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:54.823: INFO: Container test-container ready: false, restart count 0 Jan 6 06:40:55.008: INFO: Latency metrics for node i-00e2a3416f09a146a Jan 6 06:40:55.008: INFO: Logging node info for node i-038260c95b7cbf8dd Jan 6 06:40:55.039: INFO: Node Info: &Node{ObjectMeta:{i-038260c95b7cbf8dd ba495758-87ae-4472-b9d2-10e6fd017588 21836 0 2023-01-06 06:25:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-038260c95b7cbf8dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-038260c95b7cbf8dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.153 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-188":"i-038260c95b7cbf8dd","ebs.csi.aws.com":"i-038260c95b7cbf8dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:37:23 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-038260c95b7cbf8dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:32 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:32 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:32 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:37:32 +0000 UTC,LastTransitionTime:2023-01-06 06:26:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.153,},NodeAddress{Type:ExternalIP,Address:35.183.20.213,},NodeAddress{Type:InternalDNS,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-183-20-213.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dcb30d66cfec0075096c81f360304,SystemUUID:ec2dcb30-d66c-fec0-0750-96c81f360304,BootID:d74ef702-20db-4c1a-ac66-e72d9b82565b,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252,DevicePath:,},},Config:nil,},} Jan 6 06:40:55.040: INFO: Logging kubelet events for node i-038260c95b7cbf8dd Jan 6 06:40:55.073: INFO: Logging pods the kubelet thinks is on node i-038260c95b7cbf8dd Jan 6 06:40:55.113: INFO: affinity-clusterip-transition-nlpm8 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:40:55.113: INFO: pod-subpath-test-dynamicpv-482k started at 2023-01-06 06:37:22 +0000 UTC (2+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Init container init-volume-dynamicpv-482k ready: false, restart count 0 Jan 6 06:40:55.113: INFO: Init container test-init-subpath-dynamicpv-482k ready: false, restart count 0 Jan 6 06:40:55.113: INFO: Container test-container-subpath-dynamicpv-482k ready: false, restart count 0 Jan 6 06:40:55.113: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pkzq2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.113: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4cf9x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.113: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-p252s started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.113: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4x2wx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.113: INFO: coredns-559769c974-tj9mr started at 2023-01-06 06:26:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container coredns ready: true, restart count 0 Jan 6 06:40:55.113: INFO: rs-z75vx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container donothing ready: false, restart count 0 Jan 6 06:40:55.113: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-lh5x9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:40:55.113: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-vrx5z started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.113: INFO: cilium-9n89s started at 2023-01-06 06:25:58 +0000 UTC (1+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:40:55.113: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:40:55.113: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:53 +0000 UTC (0+7 container statuses recorded) Jan 6 06:40:55.113: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:40:55.113: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:40:55.113: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:40:55.113: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 6 06:40:55.113: INFO: Container hostpath ready: true, restart count 0 Jan 6 06:40:55.113: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:40:55.113: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:40:55.113: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-6bp9g started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.113: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jnnxp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:40:55.113: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-ddpcp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.113: INFO: rs-zmb4t started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container donothing ready: true, restart count 0 Jan 6 06:40:55.113: INFO: hostexec-i-038260c95b7cbf8dd-ldm4j started at 2023-01-06 06:38:03 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:40:55.113: INFO: ebs-csi-node-bds8q started at 2023-01-06 06:25:58 +0000 UTC (0+3 container statuses recorded) Jan 6 06:40:55.113: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:40:55.113: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:40:55.113: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:40:55.113: INFO: test-deployment-7df74c55ff-q4xlh started at 2023-01-06 06:35:48 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container test-deployment ready: true, restart count 0 Jan 6 06:40:55.113: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kssp4 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.113: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:36 +0000 UTC (0+7 container statuses recorded) Jan 6 06:40:55.113: INFO: Container csi-attacher ready: false, restart count 0 Jan 6 06:40:55.113: INFO: Container csi-provisioner ready: false, restart count 0 Jan 6 06:40:55.113: INFO: Container csi-resizer ready: false, restart count 0 Jan 6 06:40:55.113: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 6 06:40:55.113: INFO: Container hostpath ready: false, restart count 0 Jan 6 06:40:55.113: INFO: Container liveness-probe ready: false, restart count 0 Jan 6 06:40:55.113: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 6 06:40:55.113: INFO: pod-a47b83f9-cc6f-4f6a-9143-1f820cb0f680 started at 2023-01-06 06:38:08 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.113: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:40:55.330: INFO: Latency metrics for node i-038260c95b7cbf8dd Jan 6 06:40:55.330: INFO: Logging node info for node i-03c3347a40904af85 Jan 6 06:40:55.362: INFO: Node Info: &Node{ObjectMeta:{i-03c3347a40904af85 acf58f94-6029-4390-a68e-e4dc4881fbb2 21641 0 2023-01-06 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03c3347a40904af85 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-03c3347a40904af85 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03c3347a40904af85"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:37:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:37:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-03c3347a40904af85,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:00 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:00 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:00 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:37:00 +0000 UTC,LastTransitionTime:2023-01-06 06:26:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.54,},NodeAddress{Type:ExternalIP,Address:15.223.65.129,},NodeAddress{Type:InternalDNS,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-223-65-129.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be680388baaf810ad9be3463c2150,SystemUUID:ec2be680-388b-aaf8-10ad-9be3463c2150,BootID:e07e85b2-353d-46e6-bf6b-941e6e0ae86a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4,DevicePath:,},},Config:nil,},} Jan 6 06:40:55.363: INFO: Logging kubelet events for node i-03c3347a40904af85 Jan 6 06:40:55.396: INFO: Logging pods the kubelet thinks is on node i-03c3347a40904af85 Jan 6 06:40:55.446: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pq9p9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.446: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-s7f2j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.446: INFO: test-ss-0 started at 2023-01-06 06:35:50 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container webserver ready: false, restart count 0 Jan 6 06:40:55.446: INFO: affinity-clusterip-timeout-56jbj started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 Jan 6 06:40:55.446: INFO: pod-38de4cf4-5bef-42b1-ba2b-4fbdb207d2f7 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:40:55.446: INFO: externalname-service-5xrsz started at 2023-01-06 06:37:46 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container externalname-service ready: false, restart count 0 Jan 6 06:40:55.446: INFO: affinity-clusterip-transition-j2cw9 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:40:55.446: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-q8g6m started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.446: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4ch6k started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.446: INFO: test-deployment-7b7876f9d6-r2r9k started at 2023-01-06 06:36:05 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container test-deployment ready: false, restart count 0 Jan 6 06:40:55.446: INFO: rs-kb44r started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container donothing ready: false, restart count 0 Jan 6 06:40:55.446: INFO: csi-mockplugin-attacher-0 started at 2023-01-06 06:36:17 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container csi-attacher ready: false, restart count 0 Jan 6 06:40:55.446: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-tkmjc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:40:55.446: INFO: podecd1684a-4613-4907-b951-ddd2cbe92f5f started at 2023-01-06 06:38:00 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container nginx ready: false, restart count 0 Jan 6 06:40:55.446: INFO: hostexec-i-03c3347a40904af85-7t2fv started at 2023-01-06 06:36:12 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:40:55.446: INFO: rs-q66kq started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container donothing ready: true, restart count 0 Jan 6 06:40:55.446: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jtjnf started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.446: INFO: csi-mockplugin-0 started at 2023-01-06 06:36:17 +0000 UTC (0+3 container statuses recorded) Jan 6 06:40:55.446: INFO: Container csi-provisioner ready: false, restart count 0 Jan 6 06:40:55.446: INFO: Container driver-registrar ready: false, restart count 0 Jan 6 06:40:55.446: INFO: Container mock ready: false, restart count 0 Jan 6 06:40:55.446: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-62rpq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.446: INFO: pod-2 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container donothing ready: true, restart count 0 Jan 6 06:40:55.446: INFO: rs-zvxqx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container donothing ready: true, restart count 0 Jan 6 06:40:55.446: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-xskq7 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.446: INFO: ebs-csi-node-lvpjv started at 2023-01-06 06:26:09 +0000 UTC (0+3 container statuses recorded) Jan 6 06:40:55.446: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:40:55.446: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:40:55.446: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:40:55.446: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:30 +0000 UTC (0+7 container statuses recorded) Jan 6 06:40:55.446: INFO: Container csi-attacher ready: false, restart count 0 Jan 6 06:40:55.446: INFO: Container csi-provisioner ready: false, restart count 0 Jan 6 06:40:55.446: INFO: Container csi-resizer ready: false, restart count 0 Jan 6 06:40:55.446: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 6 06:40:55.446: INFO: Container hostpath ready: false, restart count 0 Jan 6 06:40:55.446: INFO: Container liveness-probe ready: false, restart count 0 Jan 6 06:40:55.446: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 6 06:40:55.446: INFO: cilium-ww8tr started at 2023-01-06 06:26:09 +0000 UTC (1+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:40:55.446: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:40:55.446: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pxg45 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.446: INFO: inline-volume-tester-n28z7 started at 2023-01-06 06:35:53 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 6 06:40:55.446: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g8tzv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.446: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.667: INFO: Latency metrics for node i-03c3347a40904af85 Jan 6 06:40:55.667: INFO: Logging node info for node i-04cab7fc0ec1601e6 Jan 6 06:40:55.698: INFO: Node Info: &Node{ObjectMeta:{i-04cab7fc0ec1601e6 2d853506-d4dc-4e6a-ad93-16f5ebcea997 22694 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04cab7fc0ec1601e6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04cab7fc0ec1601e6 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-04cab7fc0ec1601e6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-06 06:40:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04cab7fc0ec1601e6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.215,},NodeAddress{Type:ExternalIP,Address:15.222.251.140,},NodeAddress{Type:InternalDNS,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-251-140.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2b15a5f89be6a782a1e3e9076afdcb,SystemUUID:ec2b15a5-f89b-e6a7-82a1-e3e9076afdcb,BootID:c698d6b6-6a59-41c3-8d65-390a1e2ed279,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:40:55.699: INFO: Logging kubelet events for node i-04cab7fc0ec1601e6 Jan 6 06:40:55.737: INFO: Logging pods the kubelet thinks is on node i-04cab7fc0ec1601e6 Jan 6 06:40:55.776: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4wmx5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.776: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-dz4q9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.776: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-svh2x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:40:55.776: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n99wc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.776: INFO: cilium-n8ld4 started at 2023-01-06 06:25:37 +0000 UTC (1+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:40:55.776: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:40:55.776: INFO: coredns-559769c974-qmgjs started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container coredns ready: true, restart count 0 Jan 6 06:40:55.776: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nfchl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.776: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kdmj6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.776: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-sj6xh started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.776: INFO: pod-0 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container donothing ready: false, restart count 0 Jan 6 06:40:55.776: INFO: hostexec-i-04cab7fc0ec1601e6-cx28h started at 2023-01-06 06:36:30 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:40:55.776: INFO: ebs-csi-node-db2rw started at 2023-01-06 06:25:37 +0000 UTC (0+3 container statuses recorded) Jan 6 06:40:55.776: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:40:55.776: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:40:55.776: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:40:55.776: INFO: affinity-clusterip-timeout-qvtbc started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:40:55.776: INFO: pod-1 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container donothing ready: false, restart count 0 Jan 6 06:40:55.776: INFO: rs-4ks6z started at 2023-01-06 06:36:23 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container donothing ready: false, restart count 0 Jan 6 06:40:55.776: INFO: rs-6vhk6 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container donothing ready: false, restart count 0 Jan 6 06:40:55.776: INFO: coredns-autoscaler-7cb5c5b969-6txvw started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container autoscaler ready: true, restart count 0 Jan 6 06:40:55.776: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kvds2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.776: INFO: pod-b92f36fb-932c-4004-b819-e6f8eb689811 started at 2023-01-06 06:36:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:40:55.776: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4fsc6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.776: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bzw88 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:55.776: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:40:55.977: INFO: Latency metrics for node i-04cab7fc0ec1601e6 Jan 6 06:40:55.977: INFO: Logging node info for node i-0dfd4e56c03b27188 Jan 6 06:40:56.008: INFO: Node Info: &Node{ObjectMeta:{i-0dfd4e56c03b27188 2628d33e-cb25-41db-a644-b167c0d84591 21701 0 2023-01-06 06:23:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0dfd4e56c03b27188 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.87 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0dfd4e56c03b27188"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-06 06:23:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-06 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-06 06:37:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0dfd4e56c03b27188,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:09 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:09 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:09 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:37:09 +0000 UTC,LastTransitionTime:2023-01-06 06:24:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.87,},NodeAddress{Type:ExternalIP,Address:15.222.64.3,},NodeAddress{Type:InternalDNS,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-64-3.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23482dbb2dc570b65c2c6afcd72a4c,SystemUUID:ec23482d-bb2d-c570-b65c-2c6afcd72a4c,BootID:e04f4923-c80f-4e9b-852a-b2b114eb6541,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43434708,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805585,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967331,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:40:56.009: INFO: Logging kubelet events for node i-0dfd4e56c03b27188 Jan 6 06:40:56.043: INFO: Logging pods the kubelet thinks is on node i-0dfd4e56c03b27188 Jan 6 06:40:56.083: INFO: etcd-manager-main-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:56.083: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:40:56.083: INFO: kube-apiserver-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+2 container statuses recorded) Jan 6 06:40:56.083: INFO: Container healthcheck ready: true, restart count 0 Jan 6 06:40:56.083: INFO: Container kube-apiserver ready: true, restart count 1 Jan 6 06:40:56.083: INFO: kube-scheduler-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:56.083: INFO: Container kube-scheduler ready: true, restart count 0 Jan 6 06:40:56.083: INFO: kops-controller-27r6m started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:56.083: INFO: Container kops-controller ready: true, restart count 0 Jan 6 06:40:56.083: INFO: etcd-manager-events-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:56.083: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:40:56.083: INFO: ebs-csi-node-x7dz5 started at 2023-01-06 06:24:25 +0000 UTC (0+3 container statuses recorded) Jan 6 06:40:56.083: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:40:56.083: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:40:56.083: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:40:56.083: INFO: aws-cloud-controller-manager-snk2c started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:56.083: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 6 06:40:56.083: INFO: cilium-j2vh5 started at 2023-01-06 06:24:25 +0000 UTC (1+1 container statuses recorded) Jan 6 06:40:56.083: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:40:56.083: INFO: Container cilium-agent ready: true, restart count 1 Jan 6 06:40:56.083: INFO: dns-controller-69987775c6-76fgw started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:56.083: INFO: Container dns-controller ready: true, restart count 0 Jan 6 06:40:56.083: INFO: cilium-operator-5dd44dc49f-wnkl6 started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:56.083: INFO: Container cilium-operator ready: true, restart count 1 Jan 6 06:40:56.083: INFO: ebs-csi-controller-89b649c94-slv9n started at 2023-01-06 06:24:25 +0000 UTC (0+5 container statuses recorded) Jan 6 06:40:56.083: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:40:56.083: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:40:56.083: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:40:56.083: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:40:56.083: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:40:56.083: INFO: kube-controller-manager-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:40:56.083: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 6 06:40:56.255: INFO: Latency metrics for node i-0dfd4e56c03b27188 [DeferCleanup (Each)] [sig-apps] Deployment tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "deployment-7210" for this suite. �[38;5;243m01/06/23 06:40:56.255�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\ssupport\sinline\sexecution\sand\sattach$'
test/e2e/framework/kubectl/builder.go:87 k8s.io/kubernetes/test/e2e/framework/kubectl.KubectlBuilder.ExecOrDie({0xc00094e2c0?, 0x0?}, {0xc0034c3f90, 0xc}) test/e2e/framework/kubectl/builder.go:87 +0x1b4 k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.8() test/e2e/kubectl/kubectl.go:626 +0x779from junit_01.xml
[BeforeEach] [sig-cli] Kubectl client set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/06/23 06:35:03.98�[0m Jan 6 06:35:03.980: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/06/23 06:35:03.981�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/06/23 06:35:04.112�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/06/23 06:35:04.176�[0m [BeforeEach] [sig-cli] Kubectl client test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-cli] Kubectl client test/e2e/kubectl/kubectl.go:274 [BeforeEach] Simple pod test/e2e/kubectl/kubectl.go:411 �[1mSTEP:�[0m creating the pod from �[38;5;243m01/06/23 06:35:04.239�[0m Jan 6 06:35:04.239: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/14f997c5-8d8a-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9856 create -f -' Jan 6 06:35:05.092: INFO: stderr: "" Jan 6 06:35:05.092: INFO: stdout: "pod/httpd created\n" Jan 6 06:35:05.092: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd] Jan 6 06:35:05.092: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-9856" to be "running and ready" Jan 6 06:35:05.123: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 31.196081ms Jan 6 06:35:05.123: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-03c3347a40904af85' to be 'Running' but was 'Pending' Jan 6 06:35:07.155: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 2.063361019s Jan 6 06:35:07.155: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-03c3347a40904af85' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC }] Jan 6 06:35:09.156: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 4.063711699s Jan 6 06:35:09.156: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-03c3347a40904af85' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC }] Jan 6 06:35:11.156: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 6.064091868s Jan 6 06:35:11.156: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-03c3347a40904af85' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC }] Jan 6 06:35:13.155: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 8.062927865s Jan 6 06:35:13.155: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-03c3347a40904af85' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC }] Jan 6 06:35:15.155: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 10.063228829s Jan 6 06:35:15.155: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-03c3347a40904af85' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC }] Jan 6 06:35:17.158: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 12.06546068s Jan 6 06:35:17.158: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-03c3347a40904af85' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC }] Jan 6 06:35:19.155: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 14.062524563s Jan 6 06:35:19.155: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-03c3347a40904af85' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC }] Jan 6 06:35:21.158: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 16.065457804s Jan 6 06:35:21.158: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-03c3347a40904af85' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:05 +0000 UTC }] Jan 6 06:35:23.156: INFO: Pod "httpd": Phase="Running", Reason="", readiness=true. Elapsed: 18.064338252s Jan 6 06:35:23.156: INFO: Pod "httpd" satisfied condition "running and ready" Jan 6 06:35:23.156: INFO: Wanted all 1 pods to be running and ready. Result: true. Pods: [httpd] [It] should support inline execution and attach test/e2e/kubectl/kubectl.go:593 �[1mSTEP:�[0m executing a command with run and attach with stdin �[38;5;243m01/06/23 06:35:23.157�[0m Jan 6 06:35:23.157: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/14f997c5-8d8a-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9856 run run-test --image=registry.k8s.io/e2e-test-images/busybox:1.29-4 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --stdin -- sh -c echo -n read: && cat && echo 'stdin closed'' Jan 6 06:35:47.669: INFO: stderr: "If you don't see a command prompt, try pressing enter.\n" Jan 6 06:35:47.669: INFO: stdout: "value\nabcd1234stdin closed\n" Jan 6 06:35:57.669: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/14f997c5-8d8a-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9856 logs run-test' Jan 6 06:35:57.887: INFO: stderr: "" Jan 6 06:35:57.887: INFO: stdout: "read:value\nabcd1234stdin closed\n" �[1mSTEP:�[0m executing a command with run and attach without stdin �[38;5;243m01/06/23 06:35:57.926�[0m Jan 6 06:35:57.926: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/14f997c5-8d8a-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9856 run run-test-2 --image=registry.k8s.io/e2e-test-images/busybox:1.29-4 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --leave-stdin-open=true -- sh -c cat && echo 'stdin closed'' Jan 6 06:37:58.127: INFO: rc: 1 Jan 6 06:37:58.127: INFO: Unexpected error: <exec.CodeExitError>: { Err: <*errors.errorString | 0xc001052050>{ s: "error running /home/prow/go/src/k8s.io/kops/_rundir/14f997c5-8d8a-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9856 run run-test-2 --image=registry.k8s.io/e2e-test-images/busybox:1.29-4 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --leave-stdin-open=true -- sh -c cat && echo 'stdin closed':\nCommand stdout:\n\nstderr:\nerror: timed out waiting for the condition\n\nerror:\nexit status 1", }, Code: 1, } Jan 6 06:37:58.127: FAIL: error running /home/prow/go/src/k8s.io/kops/_rundir/14f997c5-8d8a-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9856 run run-test-2 --image=registry.k8s.io/e2e-test-images/busybox:1.29-4 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --leave-stdin-open=true -- sh -c cat && echo 'stdin closed': Command stdout: stderr: error: timed out waiting for the condition error: exit status 1 Full Stack Trace k8s.io/kubernetes/test/e2e/framework/kubectl.KubectlBuilder.ExecOrDie({0xc00094e2c0?, 0x0?}, {0xc0034c3f90, 0xc}) test/e2e/framework/kubectl/builder.go:87 +0x1b4 k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.8() test/e2e/kubectl/kubectl.go:626 +0x779 [AfterEach] Simple pod test/e2e/kubectl/kubectl.go:417 �[1mSTEP:�[0m using delete to clean up resources �[38;5;243m01/06/23 06:37:58.128�[0m Jan 6 06:37:58.128: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/14f997c5-8d8a-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9856 delete --grace-period=0 --force -f -' Jan 6 06:37:58.368: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Jan 6 06:37:58.369: INFO: stdout: "pod \"httpd\" force deleted\n" Jan 6 06:37:58.369: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/14f997c5-8d8a-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9856 get rc,svc -l name=httpd --no-headers' Jan 6 06:37:58.610: INFO: stderr: "No resources found in kubectl-9856 namespace.\n" Jan 6 06:37:58.610: INFO: stdout: "" Jan 6 06:37:58.610: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/14f997c5-8d8a-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9856 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Jan 6 06:37:58.814: INFO: stderr: "" Jan 6 06:37:58.814: INFO: stdout: "" [AfterEach] [sig-cli] Kubectl client test/e2e/framework/node/init/init.go:32 Jan 6 06:37:58.815: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-cli] Kubectl client test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-cli] Kubectl client dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/06/23 06:37:58.847�[0m �[1mSTEP:�[0m Collecting events from namespace "kubectl-9856". �[38;5;243m01/06/23 06:37:58.847�[0m �[1mSTEP:�[0m Found 20 events. �[38;5;243m01/06/23 06:37:58.881�[0m Jan 6 06:37:58.882: INFO: At 2023-01-06 06:35:05 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-9856/httpd to i-03c3347a40904af85 Jan 6 06:37:58.882: INFO: At 2023-01-06 06:35:05 +0000 UTC - event for httpd: {kubelet i-03c3347a40904af85} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine Jan 6 06:37:58.882: INFO: At 2023-01-06 06:35:05 +0000 UTC - event for httpd: {kubelet i-03c3347a40904af85} Created: Created container httpd Jan 6 06:37:58.882: INFO: At 2023-01-06 06:35:06 +0000 UTC - event for httpd: {kubelet i-03c3347a40904af85} Started: Started container httpd Jan 6 06:37:58.882: INFO: At 2023-01-06 06:35:23 +0000 UTC - event for run-test: {default-scheduler } Scheduled: Successfully assigned kubectl-9856/run-test to i-03c3347a40904af85 Jan 6 06:37:58.882: INFO: At 2023-01-06 06:35:24 +0000 UTC - event for run-test: {kubelet i-03c3347a40904af85} Started: Started container run-test Jan 6 06:37:58.882: INFO: At 2023-01-06 06:35:24 +0000 UTC - event for run-test: {kubelet i-03c3347a40904af85} Pulled: Container image "registry.k8s.io/e2e-test-images/busybox:1.29-4" already present on machine Jan 6 06:37:58.882: INFO: At 2023-01-06 06:35:24 +0000 UTC - event for run-test: {kubelet i-03c3347a40904af85} Created: Created container run-test Jan 6 06:37:58.882: INFO: At 2023-01-06 06:35:58 +0000 UTC - event for run-test-2: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "688a5d9649962ca649e9a6158bd0e9caf0f46b66fc9928d27b2e1a011aeaddcc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:37:58.882: INFO: At 2023-01-06 06:35:58 +0000 UTC - event for run-test-2: {default-scheduler } Scheduled: Successfully assigned kubectl-9856/run-test-2 to i-03c3347a40904af85 Jan 6 06:37:58.882: INFO: At 2023-01-06 06:36:13 +0000 UTC - event for run-test-2: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "eaaab7c5b2d591557fc4f10c8d576ec42ed3c88652a0edd33296970cfb1e1207": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:37:58.882: INFO: At 2023-01-06 06:36:27 +0000 UTC - event for run-test-2: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0cd50a11fcd04e0cc47a249ec1eeb292c4d744228e59210626d9c1b1c59d1cd1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:37:58.882: INFO: At 2023-01-06 06:36:42 +0000 UTC - event for run-test-2: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0d94e524609bb5313ced2b133582bb116284893e2b97cf49b64c4816b32f2c32": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:37:58.882: INFO: At 2023-01-06 06:36:53 +0000 UTC - event for run-test-2: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4bdf8e504356891fa98622d85047d141e6fb96672b39da982f73c2f1721e43f2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:37:58.882: INFO: At 2023-01-06 06:37:08 +0000 UTC - event for run-test-2: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2ef584fd1d0940ad40e661833faf0ce23496299ba869bd656437e8be2714d066": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:37:58.882: INFO: At 2023-01-06 06:37:20 +0000 UTC - event for run-test-2: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8a3345a198ad64641bcc053c5fe1de3709e4d491cadf2ad92111bf6da4699e42": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:37:58.882: INFO: At 2023-01-06 06:37:32 +0000 UTC - event for run-test-2: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "00f8604cced3bf5afe5f4fb6622fd6777ae6b7b19b35ea606d894926f28d7fef": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:37:58.882: INFO: At 2023-01-06 06:37:46 +0000 UTC - event for run-test-2: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9a7e003ab73efe4b8f4b55c65b1c5e05f6b07d348b75c71b90eaea95303b8b39": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:37:58.882: INFO: At 2023-01-06 06:37:57 +0000 UTC - event for run-test-2: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e5138273dfdad4aaf12d1569f1c82ce2965a07d07e9e68ea04b57299310cd177": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:37:58.882: INFO: At 2023-01-06 06:37:58 +0000 UTC - event for httpd: {kubelet i-03c3347a40904af85} Killing: Stopping container httpd Jan 6 06:37:58.913: INFO: POD NODE PHASE GRACE CONDITIONS Jan 6 06:37:58.913: INFO: run-test-2 i-03c3347a40904af85 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:58 +0000 UTC ContainersNotReady containers with unready status: [run-test-2]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:58 +0000 UTC ContainersNotReady containers with unready status: [run-test-2]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:35:58 +0000 UTC }] Jan 6 06:37:58.913: INFO: Jan 6 06:37:58.946: INFO: Unable to fetch kubectl-9856/run-test-2/run-test-2 logs: the server rejected our request for an unknown reason (get pods run-test-2) Jan 6 06:37:58.978: INFO: Logging node info for node i-00e2a3416f09a146a Jan 6 06:37:59.010: INFO: Node Info: &Node{ObjectMeta:{i-00e2a3416f09a146a 8b86fb5a-68fd-4aec-8591-934be54479d5 21411 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00e2a3416f09a146a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-00e2a3416f09a146a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.186 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00e2a3416f09a146a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-06 06:36:42 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-06 06:36:44 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00e2a3416f09a146a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:36:42 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:36:42 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:36:42 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:36:42 +0000 UTC,LastTransitionTime:2023-01-06 06:25:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.186,},NodeAddress{Type:ExternalIP,Address:3.97.12.121,},NodeAddress{Type:InternalDNS,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-97-12-121.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2895effafa575efe2674497633226d,SystemUUID:ec2895ef-fafa-575e-fe26-74497633226d,BootID:79823d62-e8bb-4de7-91b6-78fb8137f2da,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99,DevicePath:,},},Config:nil,},} Jan 6 06:37:59.010: INFO: Logging kubelet events for node i-00e2a3416f09a146a Jan 6 06:37:59.043: INFO: Logging pods the kubelet thinks is on node i-00e2a3416f09a146a Jan 6 06:37:59.082: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g7ftv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.082: INFO: rs-mpx98 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container donothing ready: false, restart count 0 Jan 6 06:37:59.082: INFO: dns-test-809ded8f-de8a-4c44-9545-585f12522763 started at 2023-01-06 06:36:36 +0000 UTC (0+3 container statuses recorded) Jan 6 06:37:59.082: INFO: Container jessie-querier ready: false, restart count 0 Jan 6 06:37:59.082: INFO: Container querier ready: false, restart count 0 Jan 6 06:37:59.082: INFO: Container webserver ready: false, restart count 0 Jan 6 06:37:59.082: INFO: termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3 started at 2023-01-06 06:37:45 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container termination-message-container ready: false, restart count 0 Jan 6 06:37:59.082: INFO: ebs-csi-node-w4gks started at 2023-01-06 06:25:38 +0000 UTC (0+3 container statuses recorded) Jan 6 06:37:59.082: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:37:59.082: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:37:59.082: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:37:59.082: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-9jl5j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.082: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-727r8 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.082: INFO: externalname-service-9lqkc started at 2023-01-06 06:37:46 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container externalname-service ready: false, restart count 0 Jan 6 06:37:59.082: INFO: pod-a782d690-ad63-4815-a2c4-dad0d0dd28de started at 2023-01-06 06:36:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:37:59.082: INFO: pod-3c46e05e-4424-46fe-8df2-043a3de48bd8 started at 2023-01-06 06:35:59 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container test-container ready: false, restart count 0 Jan 6 06:37:59.082: INFO: affinity-clusterip-transition-9mbw6 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:37:59.082: INFO: startup-77544c70-f8e6-4c39-9af9-9b778d7e63fd started at 2023-01-06 06:34:07 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container busybox ready: false, restart count 0 Jan 6 06:37:59.082: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv started at 2023-01-06 06:37:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container sample-crd-conversion-webhook ready: false, restart count 0 Jan 6 06:37:59.082: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-wvnkl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.082: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bqlxl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.082: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n4gvl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.082: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nljmx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.082: INFO: test-deployment-7b7876f9d6-6rvwb started at 2023-01-06 06:35:54 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container test-deployment ready: true, restart count 0 Jan 6 06:37:59.082: INFO: pod-subpath-test-preprovisionedpv-tm2z started at 2023-01-06 06:35:55 +0000 UTC (0+2 container statuses recorded) Jan 6 06:37:59.082: INFO: Container test-container-subpath-preprovisionedpv-tm2z ready: false, restart count 0 Jan 6 06:37:59.082: INFO: Container test-container-volume-preprovisionedpv-tm2z ready: false, restart count 0 Jan 6 06:37:59.082: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-5v5xp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:37:59.082: INFO: rs-xjfv2 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container donothing ready: false, restart count 0 Jan 6 06:37:59.082: INFO: affinity-clusterip-timeout-94b4c started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:37:59.082: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-z6bp5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.082: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-rd5kq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.082: INFO: hostexec-i-00e2a3416f09a146a-prs8x started at 2023-01-06 06:35:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:37:59.082: INFO: rs-q6qrb started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Container donothing ready: false, restart count 0 Jan 6 06:37:59.082: INFO: cilium-4tnhd started at 2023-01-06 06:25:38 +0000 UTC (1+1 container statuses recorded) Jan 6 06:37:59.082: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:37:59.082: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:37:59.254: INFO: Latency metrics for node i-00e2a3416f09a146a Jan 6 06:37:59.254: INFO: Logging node info for node i-038260c95b7cbf8dd Jan 6 06:37:59.285: INFO: Node Info: &Node{ObjectMeta:{i-038260c95b7cbf8dd ba495758-87ae-4472-b9d2-10e6fd017588 21836 0 2023-01-06 06:25:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-038260c95b7cbf8dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-038260c95b7cbf8dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.153 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-188":"i-038260c95b7cbf8dd","ebs.csi.aws.com":"i-038260c95b7cbf8dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:37:23 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:37:32 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-038260c95b7cbf8dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:32 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:32 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:32 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:37:32 +0000 UTC,LastTransitionTime:2023-01-06 06:26:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.153,},NodeAddress{Type:ExternalIP,Address:35.183.20.213,},NodeAddress{Type:InternalDNS,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-183-20-213.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dcb30d66cfec0075096c81f360304,SystemUUID:ec2dcb30-d66c-fec0-0750-96c81f360304,BootID:d74ef702-20db-4c1a-ac66-e72d9b82565b,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252,DevicePath:,},},Config:nil,},} Jan 6 06:37:59.286: INFO: Logging kubelet events for node i-038260c95b7cbf8dd Jan 6 06:37:59.319: INFO: Logging pods the kubelet thinks is on node i-038260c95b7cbf8dd Jan 6 06:37:59.358: INFO: rs-zmb4t started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container donothing ready: true, restart count 0 Jan 6 06:37:59.358: INFO: cilium-9n89s started at 2023-01-06 06:25:58 +0000 UTC (1+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:37:59.358: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:37:59.358: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:53 +0000 UTC (0+7 container statuses recorded) Jan 6 06:37:59.358: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:37:59.358: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:37:59.358: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:37:59.358: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 6 06:37:59.358: INFO: Container hostpath ready: true, restart count 0 Jan 6 06:37:59.358: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:37:59.358: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:37:59.358: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-6bp9g started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.358: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jnnxp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:37:59.358: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-ddpcp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.358: INFO: ebs-csi-node-bds8q started at 2023-01-06 06:25:58 +0000 UTC (0+3 container statuses recorded) Jan 6 06:37:59.358: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:37:59.358: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:37:59.358: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:37:59.358: INFO: test-deployment-7df74c55ff-q4xlh started at 2023-01-06 06:35:48 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container test-deployment ready: true, restart count 0 Jan 6 06:37:59.358: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kssp4 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.358: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:36 +0000 UTC (0+7 container statuses recorded) Jan 6 06:37:59.358: INFO: Container csi-attacher ready: false, restart count 0 Jan 6 06:37:59.358: INFO: Container csi-provisioner ready: false, restart count 0 Jan 6 06:37:59.358: INFO: Container csi-resizer ready: false, restart count 0 Jan 6 06:37:59.358: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 6 06:37:59.358: INFO: Container hostpath ready: false, restart count 0 Jan 6 06:37:59.358: INFO: Container liveness-probe ready: false, restart count 0 Jan 6 06:37:59.358: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 6 06:37:59.358: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4cf9x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.358: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-p252s started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.358: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4x2wx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.358: INFO: affinity-clusterip-transition-nlpm8 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:37:59.358: INFO: pod-subpath-test-dynamicpv-482k started at 2023-01-06 06:37:22 +0000 UTC (2+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Init container init-volume-dynamicpv-482k ready: false, restart count 0 Jan 6 06:37:59.358: INFO: Init container test-init-subpath-dynamicpv-482k ready: false, restart count 0 Jan 6 06:37:59.358: INFO: Container test-container-subpath-dynamicpv-482k ready: false, restart count 0 Jan 6 06:37:59.358: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pkzq2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.358: INFO: coredns-559769c974-tj9mr started at 2023-01-06 06:26:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container coredns ready: true, restart count 0 Jan 6 06:37:59.358: INFO: rs-z75vx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container donothing ready: false, restart count 0 Jan 6 06:37:59.358: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-lh5x9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:37:59.358: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-vrx5z started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.358: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.588: INFO: Latency metrics for node i-038260c95b7cbf8dd Jan 6 06:37:59.588: INFO: Logging node info for node i-03c3347a40904af85 Jan 6 06:37:59.619: INFO: Node Info: &Node{ObjectMeta:{i-03c3347a40904af85 acf58f94-6029-4390-a68e-e4dc4881fbb2 21641 0 2023-01-06 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03c3347a40904af85 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-03c3347a40904af85 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03c3347a40904af85"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:37:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:37:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-03c3347a40904af85,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:00 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:00 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:00 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:37:00 +0000 UTC,LastTransitionTime:2023-01-06 06:26:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.54,},NodeAddress{Type:ExternalIP,Address:15.223.65.129,},NodeAddress{Type:InternalDNS,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-223-65-129.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be680388baaf810ad9be3463c2150,SystemUUID:ec2be680-388b-aaf8-10ad-9be3463c2150,BootID:e07e85b2-353d-46e6-bf6b-941e6e0ae86a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4,DevicePath:,},},Config:nil,},} Jan 6 06:37:59.620: INFO: Logging kubelet events for node i-03c3347a40904af85 Jan 6 06:37:59.654: INFO: Logging pods the kubelet thinks is on node i-03c3347a40904af85 Jan 6 06:37:59.700: INFO: csi-mockplugin-attacher-0 started at 2023-01-06 06:36:17 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container csi-attacher ready: false, restart count 0 Jan 6 06:37:59.700: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-tkmjc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:37:59.700: INFO: hostexec-i-03c3347a40904af85-7t2fv started at 2023-01-06 06:36:12 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:37:59.700: INFO: rs-q66kq started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container donothing ready: true, restart count 0 Jan 6 06:37:59.700: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jtjnf started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.700: INFO: csi-mockplugin-0 started at 2023-01-06 06:36:17 +0000 UTC (0+3 container statuses recorded) Jan 6 06:37:59.700: INFO: Container csi-provisioner ready: false, restart count 0 Jan 6 06:37:59.700: INFO: Container driver-registrar ready: false, restart count 0 Jan 6 06:37:59.700: INFO: Container mock ready: false, restart count 0 Jan 6 06:37:59.700: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-62rpq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.700: INFO: pod-2 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container donothing ready: true, restart count 0 Jan 6 06:37:59.700: INFO: rs-zvxqx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container donothing ready: true, restart count 0 Jan 6 06:37:59.700: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-xskq7 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.700: INFO: ebs-csi-node-lvpjv started at 2023-01-06 06:26:09 +0000 UTC (0+3 container statuses recorded) Jan 6 06:37:59.700: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:37:59.700: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:37:59.700: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:37:59.700: INFO: concurrent-27883116-cnvfr started at 2023-01-06 06:36:00 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container c ready: false, restart count 0 Jan 6 06:37:59.700: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:30 +0000 UTC (0+7 container statuses recorded) Jan 6 06:37:59.700: INFO: Container csi-attacher ready: false, restart count 0 Jan 6 06:37:59.700: INFO: Container csi-provisioner ready: false, restart count 0 Jan 6 06:37:59.700: INFO: Container csi-resizer ready: false, restart count 0 Jan 6 06:37:59.700: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 6 06:37:59.700: INFO: Container hostpath ready: false, restart count 0 Jan 6 06:37:59.700: INFO: Container liveness-probe ready: false, restart count 0 Jan 6 06:37:59.700: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 6 06:37:59.700: INFO: cilium-ww8tr started at 2023-01-06 06:26:09 +0000 UTC (1+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:37:59.700: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:37:59.700: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pxg45 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.700: INFO: inline-volume-tester-n28z7 started at 2023-01-06 06:35:53 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 6 06:37:59.700: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g8tzv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.700: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pq9p9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:37:59.700: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-s7f2j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.700: INFO: test-ss-0 started at 2023-01-06 06:35:50 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container webserver ready: false, restart count 0 Jan 6 06:37:59.700: INFO: affinity-clusterip-timeout-56jbj started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 Jan 6 06:37:59.700: INFO: pod-38de4cf4-5bef-42b1-ba2b-4fbdb207d2f7 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:37:59.700: INFO: externalname-service-5xrsz started at 2023-01-06 06:37:46 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container externalname-service ready: false, restart count 0 Jan 6 06:37:59.700: INFO: affinity-clusterip-transition-j2cw9 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.700: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:37:59.701: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-q8g6m started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.701: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.701: INFO: run-test-2 started at 2023-01-06 06:35:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.701: INFO: Container run-test-2 ready: false, restart count 0 Jan 6 06:37:59.701: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4ch6k started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.701: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:37:59.701: INFO: test-deployment-7b7876f9d6-r2r9k started at 2023-01-06 06:36:05 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.701: INFO: Container test-deployment ready: false, restart count 0 Jan 6 06:37:59.701: INFO: rs-kb44r started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:37:59.701: INFO: Container donothing ready: false, restart count 0 Jan 6 06:37:59.932: INFO: Latency metrics for node i-03c3347a40904af85 Jan 6 06:37:59.932: INFO: Logging node info for node i-04cab7fc0ec1601e6 Jan 6 06:37:59.963: INFO: Node Info: &Node{ObjectMeta:{i-04cab7fc0ec1601e6 2d853506-d4dc-4e6a-ad93-16f5ebcea997 20328 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04cab7fc0ec1601e6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04cab7fc0ec1601e6 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-04cab7fc0ec1601e6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-06 06:35:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04cab7fc0ec1601e6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:35:39 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:35:39 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:35:39 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:35:39 +0000 UTC,LastTransitionTime:2023-01-06 06:25:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.215,},NodeAddress{Type:ExternalIP,Address:15.222.251.140,},NodeAddress{Type:InternalDNS,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-251-140.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2b15a5f89be6a782a1e3e9076afdcb,SystemUUID:ec2b15a5-f89b-e6a7-82a1-e3e9076afdcb,BootID:c698d6b6-6a59-41c3-8d65-390a1e2ed279,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:37:59.964: INFO: Logging kubelet events for node i-04cab7fc0ec1601e6 Jan 6 06:37:59.997: INFO: Logging pods the kubelet thinks is on node i-04cab7fc0ec1601e6 Jan 6 06:38:00.036: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-sj6xh started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:38:00.036: INFO: pod-0 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container donothing ready: false, restart count 0 Jan 6 06:38:00.036: INFO: hostexec-i-04cab7fc0ec1601e6-cx28h started at 2023-01-06 06:36:30 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:38:00.036: INFO: ebs-csi-node-db2rw started at 2023-01-06 06:25:37 +0000 UTC (0+3 container statuses recorded) Jan 6 06:38:00.036: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:38:00.036: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:38:00.036: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:38:00.036: INFO: cilium-n8ld4 started at 2023-01-06 06:25:37 +0000 UTC (1+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:38:00.036: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:38:00.036: INFO: coredns-559769c974-qmgjs started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container coredns ready: true, restart count 0 Jan 6 06:38:00.036: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nfchl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:38:00.036: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kdmj6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:38:00.036: INFO: coredns-autoscaler-7cb5c5b969-6txvw started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container autoscaler ready: true, restart count 0 Jan 6 06:38:00.036: INFO: affinity-clusterip-timeout-qvtbc started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:38:00.036: INFO: pod-1 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container donothing ready: false, restart count 0 Jan 6 06:38:00.036: INFO: rs-4ks6z started at 2023-01-06 06:36:23 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container donothing ready: false, restart count 0 Jan 6 06:38:00.036: INFO: rs-6vhk6 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container donothing ready: false, restart count 0 Jan 6 06:38:00.036: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bzw88 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:38:00.036: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kvds2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:38:00.036: INFO: pod-b92f36fb-932c-4004-b819-e6f8eb689811 started at 2023-01-06 06:36:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:38:00.036: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4fsc6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:38:00.036: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4wmx5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:38:00.036: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-dz4q9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:38:00.036: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-svh2x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:38:00.036: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n99wc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.036: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:38:00.337: INFO: Latency metrics for node i-04cab7fc0ec1601e6 Jan 6 06:38:00.337: INFO: Logging node info for node i-0dfd4e56c03b27188 Jan 6 06:38:00.368: INFO: Node Info: &Node{ObjectMeta:{i-0dfd4e56c03b27188 2628d33e-cb25-41db-a644-b167c0d84591 21701 0 2023-01-06 06:23:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0dfd4e56c03b27188 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.87 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0dfd4e56c03b27188"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-06 06:23:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-06 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-06 06:37:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0dfd4e56c03b27188,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:09 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:09 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:37:09 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:37:09 +0000 UTC,LastTransitionTime:2023-01-06 06:24:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.87,},NodeAddress{Type:ExternalIP,Address:15.222.64.3,},NodeAddress{Type:InternalDNS,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-64-3.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23482dbb2dc570b65c2c6afcd72a4c,SystemUUID:ec23482d-bb2d-c570-b65c-2c6afcd72a4c,BootID:e04f4923-c80f-4e9b-852a-b2b114eb6541,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43434708,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805585,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967331,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:38:00.368: INFO: Logging kubelet events for node i-0dfd4e56c03b27188 Jan 6 06:38:00.402: INFO: Logging pods the kubelet thinks is on node i-0dfd4e56c03b27188 Jan 6 06:38:00.439: INFO: cilium-operator-5dd44dc49f-wnkl6 started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.439: INFO: Container cilium-operator ready: true, restart count 1 Jan 6 06:38:00.439: INFO: ebs-csi-controller-89b649c94-slv9n started at 2023-01-06 06:24:25 +0000 UTC (0+5 container statuses recorded) Jan 6 06:38:00.439: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:38:00.439: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:38:00.439: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:38:00.439: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:38:00.439: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:38:00.439: INFO: kube-controller-manager-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.439: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 6 06:38:00.439: INFO: ebs-csi-node-x7dz5 started at 2023-01-06 06:24:25 +0000 UTC (0+3 container statuses recorded) Jan 6 06:38:00.439: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:38:00.439: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:38:00.439: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:38:00.439: INFO: aws-cloud-controller-manager-snk2c started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.439: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 6 06:38:00.439: INFO: cilium-j2vh5 started at 2023-01-06 06:24:25 +0000 UTC (1+1 container statuses recorded) Jan 6 06:38:00.439: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:38:00.439: INFO: Container cilium-agent ready: true, restart count 1 Jan 6 06:38:00.439: INFO: dns-controller-69987775c6-76fgw started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.439: INFO: Container dns-controller ready: true, restart count 0 Jan 6 06:38:00.439: INFO: etcd-manager-events-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.439: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:38:00.439: INFO: etcd-manager-main-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.439: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:38:00.439: INFO: kube-apiserver-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+2 container statuses recorded) Jan 6 06:38:00.439: INFO: Container healthcheck ready: true, restart count 0 Jan 6 06:38:00.439: INFO: Container kube-apiserver ready: true, restart count 1 Jan 6 06:38:00.439: INFO: kube-scheduler-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.439: INFO: Container kube-scheduler ready: true, restart count 0 Jan 6 06:38:00.439: INFO: kops-controller-27r6m started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:38:00.439: INFO: Container kops-controller ready: true, restart count 0 Jan 6 06:38:00.619: INFO: Latency metrics for node i-0dfd4e56c03b27188 [DeferCleanup (Each)] [sig-cli] Kubectl client tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "kubectl-9856" for this suite. �[38;5;243m01/06/23 06:38:00.619�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sServices\sshould\sbe\sable\sto\schange\sthe\stype\sfrom\sExternalName\sto\sClusterIP\s\[Conformance\]$'
test/e2e/network/service.go:1463 k8s.io/kubernetes/test/e2e/network.glob..func26.15() test/e2e/network/service.go:1463 +0x1bdfrom junit_01.xml
[BeforeEach] [sig-network] Services set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/06/23 06:37:46.568�[0m Jan 6 06:37:46.568: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename services �[38;5;243m01/06/23 06:37:46.569�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/06/23 06:37:46.664�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/06/23 06:37:46.725�[0m [BeforeEach] [sig-network] Services test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-network] Services test/e2e/network/service.go:766 [It] should be able to change the type from ExternalName to ClusterIP [Conformance] test/e2e/network/service.go:1438 �[1mSTEP:�[0m creating a service externalname-service with the type=ExternalName in namespace services-2702 �[38;5;243m01/06/23 06:37:46.786�[0m �[1mSTEP:�[0m changing the ExternalName service to type=ClusterIP �[38;5;243m01/06/23 06:37:46.82�[0m �[1mSTEP:�[0m creating replication controller externalname-service in namespace services-2702 �[38;5;243m01/06/23 06:37:46.888�[0m I0106 06:37:46.921795 6639 runners.go:193] Created replication controller with name: externalname-service, namespace: services-2702, replica count: 2 I0106 06:37:49.973528 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:52.973757 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:55.974592 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:58.975757 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:01.976732 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:04.977106 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:07.977628 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:10.978608 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:13.978855 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:16.979827 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:19.980077 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:22.980820 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:25.981038 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:28.981825 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:31.982817 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:34.983182 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:37.983804 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:40.984625 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:43.985712 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:46.986667 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:49.987660 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:52.988477 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:55.988831 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:58.989148 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:01.990222 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:04.991327 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:07.992366 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:10.993409 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:13.994119 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:16.995213 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:19.995336 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:22.996444 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:25.997346 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:28.997697 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:31.998435 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:34.999485 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:38.000538 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:41.001192 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:44.001359 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:47.002190 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:50.002770 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:53.003527 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:56.004508 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:59.005289 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:02.005701 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:05.006143 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:08.006726 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:11.007213 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:14.007545 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:17.007789 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:20.008126 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:23.008441 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:26.009259 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:29.009779 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:32.010547 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:35.011699 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:38.012308 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:41.013414 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:44.014534 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:47.014786 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:50.015600 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:53.016574 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:56.016985 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:59.017947 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:02.018452 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:05.019048 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:08.019510 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:11.020581 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:14.021356 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:17.021739 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:20.022240 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:23.022481 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:26.023455 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:29.024234 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:32.025415 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:35.026393 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:38.027442 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:41.027647 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:44.028637 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:47.029173 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:50.030027 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:53.030443 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:56.031478 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:59.032368 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:02.032608 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:05.032948 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:08.033304 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:11.034233 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:14.035392 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:17.035930 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:20.036359 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:23.037507 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:26.038096 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:29.038497 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:32.039424 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:35.039972 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:38.040546 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:41.040657 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:44.041363 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:47.042332 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:50.043275 6639 runners.go:193] externalname-service Pods: 2 out of 2 created, 0 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:50.075184 6639 runners.go:193] Pod externalname-service-5xrsz i-03c3347a40904af85 Pending <nil> I0106 06:42:50.075235 6639 runners.go:193] Pod externalname-service-9lqkc i-00e2a3416f09a146a Pending <nil> Jan 6 06:42:50.075: INFO: Unexpected error: <*errors.errorString | 0xc0002631c0>: { s: "only 0 pods started out of 2", } Jan 6 06:42:50.075: FAIL: only 0 pods started out of 2 Full Stack Trace k8s.io/kubernetes/test/e2e/network.glob..func26.15() test/e2e/network/service.go:1463 +0x1bd Jan 6 06:42:50.075: INFO: Cleaning up the ExternalName to ClusterIP test service [AfterEach] [sig-network] Services test/e2e/framework/node/init/init.go:32 Jan 6 06:42:50.125: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-network] Services test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-network] Services dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/06/23 06:42:50.157�[0m �[1mSTEP:�[0m Collecting events from namespace "services-2702". �[38;5;243m01/06/23 06:42:50.157�[0m �[1mSTEP:�[0m Found 24 events. �[38;5;243m01/06/23 06:42:50.189�[0m Jan 6 06:42:50.189: INFO: At 2023-01-06 06:37:46 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-9lqkc Jan 6 06:42:50.189: INFO: At 2023-01-06 06:37:46 +0000 UTC - event for externalname-service: {replication-controller } SuccessfulCreate: Created pod: externalname-service-5xrsz Jan 6 06:42:50.189: INFO: At 2023-01-06 06:37:46 +0000 UTC - event for externalname-service-5xrsz: {default-scheduler } Scheduled: Successfully assigned services-2702/externalname-service-5xrsz to i-03c3347a40904af85 Jan 6 06:42:50.189: INFO: At 2023-01-06 06:37:46 +0000 UTC - event for externalname-service-9lqkc: {default-scheduler } Scheduled: Successfully assigned services-2702/externalname-service-9lqkc to i-00e2a3416f09a146a Jan 6 06:42:50.189: INFO: At 2023-01-06 06:37:47 +0000 UTC - event for externalname-service-5xrsz: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "60b3293a740a8930b43394188d8e9605f144c0fee015a60c61bc3ee51290972b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:37:47 +0000 UTC - event for externalname-service-9lqkc: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1e1a4206ad0402b9fbbf9bb80c5aa2ece1b6ac893a16ff8c932e8d255a395e91": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:37:58 +0000 UTC - event for externalname-service-9lqkc: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0c0b227c764afd7d56db3be8878bb3763c35f5073f3c3bbbcd769c6b90e21155": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:38:02 +0000 UTC - event for externalname-service-5xrsz: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "771128349ba6c95f569b6b769a25ca011560f5f110ac91a0e3736bd1d36c68eb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:38:11 +0000 UTC - event for externalname-service-9lqkc: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5a83521c0d3fbe9ea806d61705046e63a3f92c666c84f3b1363824cdc01edaf7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:38:15 +0000 UTC - event for externalname-service-5xrsz: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "97e917f9080987eca5facaa87f8587387ee163b2d398db4682e342afc739ebd4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:38:24 +0000 UTC - event for externalname-service-9lqkc: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c72ea4ab0d9612ad604cee956c9575a463f26133c5a1758ab2babea25775a5c1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:38:27 +0000 UTC - event for externalname-service-5xrsz: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6c2bf6173411afb278c4b7c18137a7728807e82c2f1ffdf58d347d0bd5a08c1e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:38:35 +0000 UTC - event for externalname-service-9lqkc: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3c9b440925a40244720daa4ac92b8de7fe925cb697967527bfd062aeecb942bf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:38:40 +0000 UTC - event for externalname-service-5xrsz: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "64151f20e01a2fd033b1edc401f660153e53a0358c375f752548a57cea4a4d06": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:38:50 +0000 UTC - event for externalname-service-9lqkc: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6b32e811387613363a5c8a944b04208eac4295b9abf2a918ff7587101ada1fa3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:38:54 +0000 UTC - event for externalname-service-5xrsz: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c653794d26f9099fda34a825eeafeeaf0864a075cd9eed8b3847d8436e5f8e03": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:39:03 +0000 UTC - event for externalname-service-9lqkc: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c5a1af41ee9154361c0302b74109c57dc134971d9370505f78c530dfa3a80d84": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:39:07 +0000 UTC - event for externalname-service-5xrsz: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "157db2b96fc9d2bf3646a668ad972186e199e1103636ce208d494c1ed0d5006d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:39:18 +0000 UTC - event for externalname-service-9lqkc: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ab7e8b1818a5d733e7fc93f3d8b4492666207c1556c04fab2ec49d183e06c3bf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:39:19 +0000 UTC - event for externalname-service-5xrsz: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "69712157cee09d93d7722fdeeed272ce338c7e11ba23f3909ac850ff01566811": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:39:30 +0000 UTC - event for externalname-service-5xrsz: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2c76bc1e3034fad9ac95b034c202bdda20f73ced83b11afb7d61754db3184d39": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:39:32 +0000 UTC - event for externalname-service-9lqkc: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3cb8d659227c6f1544e0aa1447f32d1e1f4a55feaf4747cffaaaee8c677843dd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:39:44 +0000 UTC - event for externalname-service-5xrsz: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a20d41ae5f6371045e8fd73a718456d9fca14d890ee3512dcbc942f41f9c03ca": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.189: INFO: At 2023-01-06 06:39:47 +0000 UTC - event for externalname-service-9lqkc: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5e4ffb001472a818dc09cbda88850f914db6f7820648a2c90051345e3f9d107c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:50.220: INFO: POD NODE PHASE GRACE CONDITIONS Jan 6 06:42:50.220: INFO: externalname-service-5xrsz i-03c3347a40904af85 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:37:46 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:37:46 +0000 UTC ContainersNotReady containers with unready status: [externalname-service]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:37:46 +0000 UTC ContainersNotReady containers with unready status: [externalname-service]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:37:46 +0000 UTC }] Jan 6 06:42:50.220: INFO: externalname-service-9lqkc i-00e2a3416f09a146a Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:37:46 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:37:46 +0000 UTC ContainersNotReady containers with unready status: [externalname-service]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:37:46 +0000 UTC ContainersNotReady containers with unready status: [externalname-service]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:37:46 +0000 UTC }] Jan 6 06:42:50.220: INFO: Jan 6 06:42:50.252: INFO: Unable to fetch services-2702/externalname-service-5xrsz/externalname-service logs: the server rejected our request for an unknown reason (get pods externalname-service-5xrsz) Jan 6 06:42:50.284: INFO: Unable to fetch services-2702/externalname-service-9lqkc/externalname-service logs: the server rejected our request for an unknown reason (get pods externalname-service-9lqkc) Jan 6 06:42:50.316: INFO: Logging node info for node i-00e2a3416f09a146a Jan 6 06:42:50.347: INFO: Node Info: &Node{ObjectMeta:{i-00e2a3416f09a146a 8b86fb5a-68fd-4aec-8591-934be54479d5 23360 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00e2a3416f09a146a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-00e2a3416f09a146a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.186 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00e2a3416f09a146a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:41:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:41:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00e2a3416f09a146a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.186,},NodeAddress{Type:ExternalIP,Address:3.97.12.121,},NodeAddress{Type:InternalDNS,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-97-12-121.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2895effafa575efe2674497633226d,SystemUUID:ec2895ef-fafa-575e-fe26-74497633226d,BootID:79823d62-e8bb-4de7-91b6-78fb8137f2da,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99 kubernetes.io/csi/ebs.csi.aws.com^vol-0dfd8d85db9fb3624],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0dfd8d85db9fb3624,DevicePath:,},},Config:nil,},} Jan 6 06:42:50.348: INFO: Logging kubelet events for node i-00e2a3416f09a146a Jan 6 06:42:50.381: INFO: Logging pods the kubelet thinks is on node i-00e2a3416f09a146a Jan 6 06:42:50.450: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g7ftv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.450: INFO: rs-mpx98 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:50.450: INFO: dns-test-809ded8f-de8a-4c44-9545-585f12522763 started at 2023-01-06 06:36:36 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:50.450: INFO: Container jessie-querier ready: false, restart count 0 Jan 6 06:42:50.450: INFO: Container querier ready: false, restart count 0 Jan 6 06:42:50.450: INFO: Container webserver ready: false, restart count 0 Jan 6 06:42:50.450: INFO: externalname-service-9lqkc started at 2023-01-06 06:37:46 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container externalname-service ready: false, restart count 0 Jan 6 06:42:50.450: INFO: sample-webhook-deployment-865554f4d9-xx66r started at 2023-01-06 06:41:15 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container sample-webhook ready: false, restart count 0 Jan 6 06:42:50.450: INFO: ebs-csi-node-w4gks started at 2023-01-06 06:25:38 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:50.450: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:50.450: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:50.450: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:50.450: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-9jl5j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.450: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-727r8 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.450: INFO: pod-a782d690-ad63-4815-a2c4-dad0d0dd28de started at 2023-01-06 06:36:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:42:50.450: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-wvnkl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.450: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bqlxl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.450: INFO: affinity-clusterip-transition-9mbw6 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container affinity-clusterip-transition ready: true, restart count 0 Jan 6 06:42:50.450: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv started at 2023-01-06 06:37:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container sample-crd-conversion-webhook ready: false, restart count 0 Jan 6 06:42:50.450: INFO: pod-subpath-test-projected-7vlp started at 2023-01-06 06:38:17 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container test-container-subpath-projected-7vlp ready: false, restart count 0 Jan 6 06:42:50.450: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n4gvl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.450: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nljmx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.450: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-z6bp5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.450: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-rd5kq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.450: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-5v5xp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:50.450: INFO: rs-xjfv2 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:50.450: INFO: affinity-clusterip-timeout-94b4c started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:42:50.450: INFO: pod-3e08c759-655f-40a7-9a02-b3d5823ccebc started at 2023-01-06 06:39:29 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container test-container ready: false, restart count 0 Jan 6 06:42:50.450: INFO: rs-q6qrb started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:50.450: INFO: external-injector started at 2023-01-06 06:41:52 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Container external-injector ready: false, restart count 0 Jan 6 06:42:50.450: INFO: cilium-4tnhd started at 2023-01-06 06:25:38 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:50.450: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:50.450: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:42:50.670: INFO: Latency metrics for node i-00e2a3416f09a146a Jan 6 06:42:50.670: INFO: Logging node info for node i-038260c95b7cbf8dd Jan 6 06:42:50.702: INFO: Node Info: &Node{ObjectMeta:{i-038260c95b7cbf8dd ba495758-87ae-4472-b9d2-10e6fd017588 23083 0 2023-01-06 06:25:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-038260c95b7cbf8dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-038260c95b7cbf8dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.153 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-188":"i-038260c95b7cbf8dd","csi-hostpath-provisioning-4332":"i-038260c95b7cbf8dd","ebs.csi.aws.com":"i-038260c95b7cbf8dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:41:18 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:41:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-038260c95b7cbf8dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:26:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.153,},NodeAddress{Type:ExternalIP,Address:35.183.20.213,},NodeAddress{Type:InternalDNS,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-183-20-213.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dcb30d66cfec0075096c81f360304,SystemUUID:ec2dcb30-d66c-fec0-0750-96c81f360304,BootID:d74ef702-20db-4c1a-ac66-e72d9b82565b,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252 kubernetes.io/csi/csi-hostpath-provisioning-4332^1e8f61b4-8d8d-11ed-93d1-620a615b4ed2],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-4332^1e8f61b4-8d8d-11ed-93d1-620a615b4ed2,DevicePath:,},},Config:nil,},} Jan 6 06:42:50.702: INFO: Logging kubelet events for node i-038260c95b7cbf8dd Jan 6 06:42:50.736: INFO: Logging pods the kubelet thinks is on node i-038260c95b7cbf8dd Jan 6 06:42:50.775: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:36 +0000 UTC (0+7 container statuses recorded) Jan 6 06:42:50.775: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container hostpath ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:50.775: INFO: pod-a47b83f9-cc6f-4f6a-9143-1f820cb0f680 started at 2023-01-06 06:38:08 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:42:50.775: INFO: ebs-csi-node-bds8q started at 2023-01-06 06:25:58 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:50.775: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:50.775: INFO: pod-subpath-test-dynamicpv-482k started at 2023-01-06 06:41:16 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container test-container-subpath-dynamicpv-482k ready: false, restart count 0 Jan 6 06:42:50.775: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kssp4 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.775: INFO: pod-subpath-test-preprovisionedpv-6m4h started at 2023-01-06 06:41:10 +0000 UTC (1+2 container statuses recorded) Jan 6 06:42:50.775: INFO: Init container test-init-subpath-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:42:50.775: INFO: Container test-container-subpath-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:42:50.775: INFO: Container test-container-volume-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:42:50.775: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pkzq2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.775: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4cf9x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.775: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-p252s started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.775: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4x2wx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.775: INFO: affinity-clusterip-transition-nlpm8 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:42:50.775: INFO: hostexec-i-038260c95b7cbf8dd-mzglw started at 2023-01-06 06:40:56 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:50.775: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-vrx5z started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.775: INFO: coredns-559769c974-tj9mr started at 2023-01-06 06:26:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container coredns ready: true, restart count 0 Jan 6 06:42:50.775: INFO: rs-z75vx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:50.775: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-lh5x9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:50.775: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jnnxp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:50.775: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-ddpcp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:50.775: INFO: rs-zmb4t started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:50.775: INFO: hostexec-i-038260c95b7cbf8dd-ldm4j started at 2023-01-06 06:38:03 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:50.775: INFO: pod-subpath-test-dynamicpv-sntd started at 2023-01-06 06:41:17 +0000 UTC (1+2 container statuses recorded) Jan 6 06:42:50.775: INFO: Init container test-init-subpath-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:42:50.775: INFO: Container test-container-subpath-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:42:50.775: INFO: Container test-container-volume-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:42:50.775: INFO: cilium-9n89s started at 2023-01-06 06:25:58 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:42:50.775: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:53 +0000 UTC (0+7 container statuses recorded) Jan 6 06:42:50.775: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container hostpath ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:50.775: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:50.775: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-6bp9g started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:50.775: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.137: INFO: Latency metrics for node i-038260c95b7cbf8dd Jan 6 06:42:51.137: INFO: Logging node info for node i-03c3347a40904af85 Jan 6 06:42:51.168: INFO: Node Info: &Node{ObjectMeta:{i-03c3347a40904af85 acf58f94-6029-4390-a68e-e4dc4881fbb2 23391 0 2023-01-06 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03c3347a40904af85 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-03c3347a40904af85 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03c3347a40904af85"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:37:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:42:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-03c3347a40904af85,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.54,},NodeAddress{Type:ExternalIP,Address:15.223.65.129,},NodeAddress{Type:InternalDNS,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-223-65-129.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be680388baaf810ad9be3463c2150,SystemUUID:ec2be680-388b-aaf8-10ad-9be3463c2150,BootID:e07e85b2-353d-46e6-bf6b-941e6e0ae86a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4,DevicePath:,},},Config:nil,},} Jan 6 06:42:51.169: INFO: Logging kubelet events for node i-03c3347a40904af85 Jan 6 06:42:51.202: INFO: Logging pods the kubelet thinks is on node i-03c3347a40904af85 Jan 6 06:42:51.244: INFO: affinity-clusterip-transition-j2cw9 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:42:51.244: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-q8g6m started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.244: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4ch6k started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.244: INFO: rs-kb44r started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:51.244: INFO: podecd1684a-4613-4907-b951-ddd2cbe92f5f started at 2023-01-06 06:38:00 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container nginx ready: false, restart count 0 Jan 6 06:42:51.244: INFO: hostexec-i-03c3347a40904af85-8ntd8 started at 2023-01-06 06:42:16 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:51.244: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-tkmjc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:51.244: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jtjnf started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.244: INFO: rs-q66kq started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:51.244: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-62rpq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.244: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:41:47 +0000 UTC (0+7 container statuses recorded) Jan 6 06:42:51.244: INFO: Container csi-attacher ready: false, restart count 0 Jan 6 06:42:51.244: INFO: Container csi-provisioner ready: false, restart count 0 Jan 6 06:42:51.244: INFO: Container csi-resizer ready: false, restart count 0 Jan 6 06:42:51.244: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 6 06:42:51.244: INFO: Container hostpath ready: false, restart count 0 Jan 6 06:42:51.244: INFO: Container liveness-probe ready: false, restart count 0 Jan 6 06:42:51.244: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 6 06:42:51.244: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-xskq7 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.244: INFO: pod-6faed302-3756-4d38-8d98-81f254795610 started at 2023-01-06 06:42:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:42:51.244: INFO: pod-2 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:51.244: INFO: rs-zvxqx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:51.244: INFO: cilium-ww8tr started at 2023-01-06 06:26:09 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:51.244: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:42:51.244: INFO: ebs-csi-node-lvpjv started at 2023-01-06 06:26:09 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:51.244: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:51.244: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:51.244: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:51.244: INFO: pod-configmaps-b6eb366a-a1a5-44ab-ac82-5dd5e2aed984 started at 2023-01-06 06:41:23 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container agnhost-container ready: false, restart count 0 Jan 6 06:42:51.244: INFO: downwardapi-volume-52e6a5ae-b501-4ba1-be31-d95abea8b4c8 started at 2023-01-06 06:42:47 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container client-container ready: false, restart count 0 Jan 6 06:42:51.244: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g8tzv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.244: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pxg45 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.244: INFO: inline-volume-tester-n28z7 started at 2023-01-06 06:35:53 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 6 06:42:51.244: INFO: externalname-service-5xrsz started at 2023-01-06 06:37:46 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container externalname-service ready: false, restart count 0 Jan 6 06:42:51.244: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pq9p9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.244: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-s7f2j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.244: INFO: test-ss-0 started at 2023-01-06 06:35:50 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container webserver ready: false, restart count 0 Jan 6 06:42:51.244: INFO: affinity-clusterip-timeout-56jbj started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.244: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 Jan 6 06:42:51.471: INFO: Latency metrics for node i-03c3347a40904af85 Jan 6 06:42:51.471: INFO: Logging node info for node i-04cab7fc0ec1601e6 Jan 6 06:42:51.502: INFO: Node Info: &Node{ObjectMeta:{i-04cab7fc0ec1601e6 2d853506-d4dc-4e6a-ad93-16f5ebcea997 22694 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04cab7fc0ec1601e6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04cab7fc0ec1601e6 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-04cab7fc0ec1601e6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-06 06:40:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04cab7fc0ec1601e6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.215,},NodeAddress{Type:ExternalIP,Address:15.222.251.140,},NodeAddress{Type:InternalDNS,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-251-140.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2b15a5f89be6a782a1e3e9076afdcb,SystemUUID:ec2b15a5-f89b-e6a7-82a1-e3e9076afdcb,BootID:c698d6b6-6a59-41c3-8d65-390a1e2ed279,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:42:51.503: INFO: Logging kubelet events for node i-04cab7fc0ec1601e6 Jan 6 06:42:51.536: INFO: Logging pods the kubelet thinks is on node i-04cab7fc0ec1601e6 Jan 6 06:42:51.573: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-dz4q9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.573: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-svh2x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:51.573: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n99wc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.573: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4wmx5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.573: INFO: coredns-559769c974-qmgjs started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container coredns ready: true, restart count 0 Jan 6 06:42:51.573: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nfchl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.573: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kdmj6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.573: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-sj6xh started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.573: INFO: pod-0 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:51.573: INFO: ebs-csi-node-db2rw started at 2023-01-06 06:25:37 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:51.573: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:51.573: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:51.573: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:51.573: INFO: cilium-n8ld4 started at 2023-01-06 06:25:37 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:51.573: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:42:51.573: INFO: pod-1 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:51.573: INFO: rs-4ks6z started at 2023-01-06 06:36:23 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:51.573: INFO: rs-6vhk6 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:51.573: INFO: coredns-autoscaler-7cb5c5b969-6txvw started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container autoscaler ready: true, restart count 0 Jan 6 06:42:51.573: INFO: affinity-clusterip-timeout-qvtbc started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:42:51.573: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4fsc6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.573: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bzw88 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.573: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kvds2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.573: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:51.811: INFO: Latency metrics for node i-04cab7fc0ec1601e6 Jan 6 06:42:51.811: INFO: Logging node info for node i-0dfd4e56c03b27188 Jan 6 06:42:51.843: INFO: Node Info: &Node{ObjectMeta:{i-0dfd4e56c03b27188 2628d33e-cb25-41db-a644-b167c0d84591 23472 0 2023-01-06 06:23:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0dfd4e56c03b27188 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.87 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0dfd4e56c03b27188"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-06 06:23:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-06 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-06 06:42:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0dfd4e56c03b27188,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:24:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.87,},NodeAddress{Type:ExternalIP,Address:15.222.64.3,},NodeAddress{Type:InternalDNS,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-64-3.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23482dbb2dc570b65c2c6afcd72a4c,SystemUUID:ec23482d-bb2d-c570-b65c-2c6afcd72a4c,BootID:e04f4923-c80f-4e9b-852a-b2b114eb6541,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43434708,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805585,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967331,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:42:51.843: INFO: Logging kubelet events for node i-0dfd4e56c03b27188 Jan 6 06:42:51.876: INFO: Logging pods the kubelet thinks is on node i-0dfd4e56c03b27188 Jan 6 06:42:51.915: INFO: kube-apiserver-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+2 container statuses recorded) Jan 6 06:42:51.915: INFO: Container healthcheck ready: true, restart count 0 Jan 6 06:42:51.915: INFO: Container kube-apiserver ready: true, restart count 1 Jan 6 06:42:51.915: INFO: kube-scheduler-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.915: INFO: Container kube-scheduler ready: true, restart count 0 Jan 6 06:42:51.915: INFO: kops-controller-27r6m started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.915: INFO: Container kops-controller ready: true, restart count 0 Jan 6 06:42:51.915: INFO: etcd-manager-events-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.915: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:42:51.915: INFO: etcd-manager-main-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.915: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:42:51.915: INFO: aws-cloud-controller-manager-snk2c started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.915: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 6 06:42:51.915: INFO: cilium-j2vh5 started at 2023-01-06 06:24:25 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:51.915: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:51.915: INFO: Container cilium-agent ready: true, restart count 1 Jan 6 06:42:51.915: INFO: dns-controller-69987775c6-76fgw started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.915: INFO: Container dns-controller ready: true, restart count 0 Jan 6 06:42:51.915: INFO: cilium-operator-5dd44dc49f-wnkl6 started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.915: INFO: Container cilium-operator ready: true, restart count 1 Jan 6 06:42:51.915: INFO: ebs-csi-controller-89b649c94-slv9n started at 2023-01-06 06:24:25 +0000 UTC (0+5 container statuses recorded) Jan 6 06:42:51.915: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:42:51.915: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:42:51.915: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:42:51.915: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:51.915: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:51.915: INFO: kube-controller-manager-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:51.915: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 6 06:42:51.915: INFO: ebs-csi-node-x7dz5 started at 2023-01-06 06:24:25 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:51.915: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:51.915: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:51.915: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:52.081: INFO: Latency metrics for node i-0dfd4e56c03b27188 [DeferCleanup (Each)] [sig-network] Services tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "services-2702" for this suite. �[38;5;243m01/06/23 06:42:52.081�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sServices\sshould\shave\ssession\saffinity\stimeout\swork\sfor\sservice\swith\stype\sclusterIP\s\[LinuxOnly\]$'
test/e2e/network/service.go:3829 k8s.io/kubernetes/test/e2e/network.execAffinityTestForSessionAffinityTimeout(0xc000ef10e0, {0x801e128, 0xc0034e89c0}, 0xc003b12780) test/e2e/network/service.go:3829 +0x316 k8s.io/kubernetes/test/e2e/network.glob..func26.26() test/e2e/network/service.go:2200 +0x8bfrom junit_01.xml
[BeforeEach] [sig-network] Services set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/06/23 06:36:16.745�[0m Jan 6 06:36:16.745: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename services �[38;5;243m01/06/23 06:36:16.746�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/06/23 06:36:16.84�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/06/23 06:36:16.901�[0m [BeforeEach] [sig-network] Services test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-network] Services test/e2e/network/service.go:766 [It] should have session affinity timeout work for service with type clusterIP [LinuxOnly] test/e2e/network/service.go:2197 �[1mSTEP:�[0m creating service in namespace services-9432 �[38;5;243m01/06/23 06:36:16.962�[0m Jan 6 06:36:16.998: INFO: Waiting up to 5m0s for pod "kube-proxy-mode-detector" in namespace "services-9432" to be "running and ready" Jan 6 06:36:17.029: INFO: Pod "kube-proxy-mode-detector": Phase="Pending", Reason="", readiness=false. Elapsed: 31.13591ms Jan 6 06:36:17.029: INFO: The phase of Pod kube-proxy-mode-detector is Pending, waiting for it to be Running (with Ready = true) Jan 6 06:36:19.061: INFO: Pod "kube-proxy-mode-detector": Phase="Running", Reason="", readiness=true. Elapsed: 2.063371906s Jan 6 06:36:19.061: INFO: The phase of Pod kube-proxy-mode-detector is Running (Ready = true) Jan 6 06:36:19.061: INFO: Pod "kube-proxy-mode-detector" satisfied condition "running and ready" Jan 6 06:36:19.092: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/14f997c5-8d8a-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=services-9432 exec kube-proxy-mode-detector -- /bin/sh -x -c curl -q -s --connect-timeout 1 http://localhost:10249/proxyMode' Jan 6 06:36:19.581: INFO: rc: 7 Jan 6 06:36:19.626: INFO: Waiting for pod kube-proxy-mode-detector to disappear Jan 6 06:36:19.657: INFO: Pod kube-proxy-mode-detector no longer exists Jan 6 06:36:19.657: INFO: Couldn't detect KubeProxy mode - test failure may be expected: error running /home/prow/go/src/k8s.io/kops/_rundir/14f997c5-8d8a-11ed-b023-4ae401093a81/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=services-9432 exec kube-proxy-mode-detector -- /bin/sh -x -c curl -q -s --connect-timeout 1 http://localhost:10249/proxyMode: Command stdout: stderr: + curl -q -s --connect-timeout 1 http://localhost:10249/proxyMode command terminated with exit code 7 error: exit status 7 �[1mSTEP:�[0m creating service affinity-clusterip-timeout in namespace services-9432 �[38;5;243m01/06/23 06:36:19.657�[0m �[1mSTEP:�[0m creating replication controller affinity-clusterip-timeout in namespace services-9432 �[38;5;243m01/06/23 06:36:19.693�[0m I0106 06:36:19.727763 6781 runners.go:193] Created replication controller with name: affinity-clusterip-timeout, namespace: services-9432, replica count: 3 I0106 06:36:22.779357 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:25.779462 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:28.779727 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:31.780736 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:34.780823 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:37.781665 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:40.782723 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:43.783674 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:46.783790 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:49.784315 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:52.784535 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:55.784770 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:36:58.785804 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:01.786854 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:04.787997 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:07.788904 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:10.789898 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:13.790799 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:16.791905 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:19.792088 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:22.792770 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:25.793971 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:28.794881 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:31.795691 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:34.796031 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:37.796304 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:40.797425 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:43.797669 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:46.798833 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:49.799444 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:52.799912 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:55.800897 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 1 running, 2 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:37:58.801805 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:01.802853 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:04.803045 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:07.803788 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:10.803919 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:13.804840 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:16.805937 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:19.806335 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:22.806533 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:25.807420 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:28.807734 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:31.808740 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:34.809141 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:37.809377 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:40.810558 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:43.810732 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:46.811837 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:49.812395 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:52.812569 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:55.812829 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:38:58.812966 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:01.813812 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:04.813957 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:07.814195 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:10.815279 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:13.815573 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:16.815782 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:19.816778 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:22.817941 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:25.818870 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:28.818963 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:31.819826 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:34.820133 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:37.820429 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:40.820559 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:43.820725 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:46.820957 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:49.821240 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:52.821447 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:55.822377 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:39:58.822577 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:01.823629 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:04.824127 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:07.824602 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:10.825617 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:13.825997 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:16.826902 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:19.827265 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:22.827677 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:25.828454 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:28.828690 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:31.829424 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:34.830024 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:37.830873 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:40.831091 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:43.831750 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:46.832791 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:49.833484 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:52.833725 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:55.834743 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:40:58.835764 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:01.836155 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:04.837013 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:07.837807 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:10.838677 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:13.839468 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:16.839696 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:19.840370 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:22.840741 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:25.841403 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:28.841661 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:31.842733 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:34.843183 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:37.843520 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:40.843869 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:43.843993 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:46.844846 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:49.845265 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:52.845529 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:55.845810 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:41:58.845962 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:01.846609 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:04.847069 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:07.848065 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:10.848283 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:13.848863 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:16.849802 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:19.849922 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:22.850918 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:25.851717 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:28.851816 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:31.852797 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:34.853280 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:37.853536 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:40.854697 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:43.854810 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:46.855597 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:49.856189 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:52.856404 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:55.856880 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:58.857737 6781 runners.go:193] affinity-clusterip-timeout Pods: 3 out of 3 created, 2 running, 1 pending, 0 waiting, 0 inactive, 0 terminating, 0 unknown, 0 runningButNotReady I0106 06:42:58.889457 6781 runners.go:193] Pod affinity-clusterip-timeout-56jbj i-03c3347a40904af85 Pending <nil> I0106 06:42:58.889510 6781 runners.go:193] Pod affinity-clusterip-timeout-94b4c i-00e2a3416f09a146a Running <nil> I0106 06:42:58.889519 6781 runners.go:193] Pod affinity-clusterip-timeout-qvtbc i-04cab7fc0ec1601e6 Running <nil> Jan 6 06:42:58.889: INFO: Unexpected error: failed to create replication controller with service in the namespace: services-9432: <*errors.errorString | 0xc0032e4290>: { s: "only 2 pods started out of 3", } Jan 6 06:42:58.889: FAIL: failed to create replication controller with service in the namespace: services-9432: only 2 pods started out of 3 Full Stack Trace k8s.io/kubernetes/test/e2e/network.execAffinityTestForSessionAffinityTimeout(0xc000ef10e0, {0x801e128, 0xc0034e89c0}, 0xc003b12780) test/e2e/network/service.go:3829 +0x316 k8s.io/kubernetes/test/e2e/network.glob..func26.26() test/e2e/network/service.go:2200 +0x8b [AfterEach] [sig-network] Services test/e2e/framework/node/init/init.go:32 Jan 6 06:42:58.889: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-network] Services test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-network] Services dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/06/23 06:42:58.921�[0m �[1mSTEP:�[0m Collecting events from namespace "services-9432". �[38;5;243m01/06/23 06:42:58.922�[0m �[1mSTEP:�[0m Found 34 events. �[38;5;243m01/06/23 06:42:58.953�[0m Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:16 +0000 UTC - event for kube-proxy-mode-detector: {default-scheduler } Scheduled: Successfully assigned services-9432/kube-proxy-mode-detector to i-04cab7fc0ec1601e6 Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:17 +0000 UTC - event for kube-proxy-mode-detector: {kubelet i-04cab7fc0ec1601e6} Started: Started container agnhost-container Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:17 +0000 UTC - event for kube-proxy-mode-detector: {kubelet i-04cab7fc0ec1601e6} Created: Created container agnhost-container Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:17 +0000 UTC - event for kube-proxy-mode-detector: {kubelet i-04cab7fc0ec1601e6} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:19 +0000 UTC - event for affinity-clusterip-timeout: {replication-controller } SuccessfulCreate: Created pod: affinity-clusterip-timeout-94b4c Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:19 +0000 UTC - event for affinity-clusterip-timeout: {replication-controller } SuccessfulCreate: Created pod: affinity-clusterip-timeout-qvtbc Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:19 +0000 UTC - event for affinity-clusterip-timeout: {replication-controller } SuccessfulCreate: Created pod: affinity-clusterip-timeout-56jbj Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:19 +0000 UTC - event for affinity-clusterip-timeout-56jbj: {default-scheduler } Scheduled: Successfully assigned services-9432/affinity-clusterip-timeout-56jbj to i-03c3347a40904af85 Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:19 +0000 UTC - event for affinity-clusterip-timeout-94b4c: {default-scheduler } Scheduled: Successfully assigned services-9432/affinity-clusterip-timeout-94b4c to i-00e2a3416f09a146a Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:19 +0000 UTC - event for affinity-clusterip-timeout-qvtbc: {default-scheduler } Scheduled: Successfully assigned services-9432/affinity-clusterip-timeout-qvtbc to i-04cab7fc0ec1601e6 Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:19 +0000 UTC - event for kube-proxy-mode-detector: {kubelet i-04cab7fc0ec1601e6} Killing: Stopping container agnhost-container Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:20 +0000 UTC - event for affinity-clusterip-timeout-56jbj: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "49e5acc4af4c862343f0106f71aa8b6c627193390bc0ddde36a79c9055c81629": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:20 +0000 UTC - event for affinity-clusterip-timeout-94b4c: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "53fc96e5d1f0b7479fa39d344aff986e55228fb7c9a6af69c19122f4967d1f3d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:20 +0000 UTC - event for affinity-clusterip-timeout-qvtbc: {kubelet i-04cab7fc0ec1601e6} Started: Started container affinity-clusterip-timeout Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:20 +0000 UTC - event for affinity-clusterip-timeout-qvtbc: {kubelet i-04cab7fc0ec1601e6} Created: Created container affinity-clusterip-timeout Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:20 +0000 UTC - event for affinity-clusterip-timeout-qvtbc: {kubelet i-04cab7fc0ec1601e6} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:32 +0000 UTC - event for affinity-clusterip-timeout-94b4c: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b368acdcf44ec7841562d96afb48fdd580caa67fa7597d4c9dcfa67f456d0b87": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:34 +0000 UTC - event for affinity-clusterip-timeout-56jbj: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c483bdd123b64d091c37c9678a5acff666126907d9e4e3744c61069a67b21af2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:47 +0000 UTC - event for affinity-clusterip-timeout-94b4c: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "988c50b31df0db2a1713cb81a4e0408f3c24e6c36059e781fb401fbbeae709ea": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:49 +0000 UTC - event for affinity-clusterip-timeout-56jbj: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "906eb72f8798a6762b01a9e9dec578bd2f3626f4dad0e562ef4b0e5eae09a38a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:36:59 +0000 UTC - event for affinity-clusterip-timeout-94b4c: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9b8aa72bfcbd8833c4c8ab8a085b39cf45d48e5173ccf30f344c61f45ffa64a6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:37:00 +0000 UTC - event for affinity-clusterip-timeout-56jbj: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "156687ea3c333f8f24489d187241f2ec265c77fab18a7329081637fa5acdabb0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:37:12 +0000 UTC - event for affinity-clusterip-timeout-94b4c: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "159c052d955a791f5f3c0f08a62d7c82ad9e9652f58f406901f2dee7c987bd66": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:37:15 +0000 UTC - event for affinity-clusterip-timeout-56jbj: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "893d29efe8ea0d57b9b68ac153f08ebe92c8dc86f1557157b3e53f47e41072be": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:37:26 +0000 UTC - event for affinity-clusterip-timeout-94b4c: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9267c3533ee74667025e68fb3132f51c605991984f7c62b53fe2562ea8f2fd40": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:37:29 +0000 UTC - event for affinity-clusterip-timeout-56jbj: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "94c9400fe8e59527eca54e9983f066fb177bfc492a35e2bfeffb224bcfd1d3b5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:37:40 +0000 UTC - event for affinity-clusterip-timeout-94b4c: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6de5a1c27edc50bf9cb9932cf5837b5ea89b0c70a53cb4f0bffeed9bf788e24f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:37:44 +0000 UTC - event for affinity-clusterip-timeout-56jbj: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "94332a0aa4d31772c145ad8896c9c3e40436f1a516446a11c562e43f63582a1a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:37:56 +0000 UTC - event for affinity-clusterip-timeout-94b4c: {kubelet i-00e2a3416f09a146a} Started: Started container affinity-clusterip-timeout Jan 6 06:42:58.953: INFO: At 2023-01-06 06:37:56 +0000 UTC - event for affinity-clusterip-timeout-94b4c: {kubelet i-00e2a3416f09a146a} Created: Created container affinity-clusterip-timeout Jan 6 06:42:58.953: INFO: At 2023-01-06 06:37:56 +0000 UTC - event for affinity-clusterip-timeout-94b4c: {kubelet i-00e2a3416f09a146a} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine Jan 6 06:42:58.953: INFO: At 2023-01-06 06:37:57 +0000 UTC - event for affinity-clusterip-timeout-56jbj: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1442981bc1b5b97fd8a232b5697aaa17deb5d81fc6585e1cfb976566aa505033": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:38:09 +0000 UTC - event for affinity-clusterip-timeout-56jbj: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "db7c9bf2cde4dcdcd2159c1a321c2e2d959584d89f2208da051796a2e03e58df": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.953: INFO: At 2023-01-06 06:38:22 +0000 UTC - event for affinity-clusterip-timeout-56jbj: {kubelet i-03c3347a40904af85} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "081fa26c34864a55e3ce032f98a1bda22e2a93c4fcc8207f769e2daae7e837b9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:58.985: INFO: POD NODE PHASE GRACE CONDITIONS Jan 6 06:42:58.985: INFO: affinity-clusterip-timeout-56jbj i-03c3347a40904af85 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:19 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:19 +0000 UTC ContainersNotReady containers with unready status: [affinity-clusterip-timeout]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:19 +0000 UTC ContainersNotReady containers with unready status: [affinity-clusterip-timeout]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:19 +0000 UTC }] Jan 6 06:42:58.985: INFO: affinity-clusterip-timeout-94b4c i-00e2a3416f09a146a Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:19 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:37:56 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:37:56 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:19 +0000 UTC }] Jan 6 06:42:58.985: INFO: affinity-clusterip-timeout-qvtbc i-04cab7fc0ec1601e6 Running [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:19 +0000 UTC } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:21 +0000 UTC } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:21 +0000 UTC } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-06 06:36:19 +0000 UTC }] Jan 6 06:42:58.985: INFO: Jan 6 06:42:59.017: INFO: Unable to fetch services-9432/affinity-clusterip-timeout-56jbj/affinity-clusterip-timeout logs: the server rejected our request for an unknown reason (get pods affinity-clusterip-timeout-56jbj) Jan 6 06:42:59.122: INFO: Logging node info for node i-00e2a3416f09a146a Jan 6 06:42:59.154: INFO: Node Info: &Node{ObjectMeta:{i-00e2a3416f09a146a 8b86fb5a-68fd-4aec-8591-934be54479d5 23360 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00e2a3416f09a146a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-00e2a3416f09a146a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.186 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00e2a3416f09a146a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:41:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:41:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00e2a3416f09a146a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.186,},NodeAddress{Type:ExternalIP,Address:3.97.12.121,},NodeAddress{Type:InternalDNS,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-97-12-121.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2895effafa575efe2674497633226d,SystemUUID:ec2895ef-fafa-575e-fe26-74497633226d,BootID:79823d62-e8bb-4de7-91b6-78fb8137f2da,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99 kubernetes.io/csi/ebs.csi.aws.com^vol-0dfd8d85db9fb3624],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0dfd8d85db9fb3624,DevicePath:,},},Config:nil,},} Jan 6 06:42:59.154: INFO: Logging kubelet events for node i-00e2a3416f09a146a Jan 6 06:42:59.187: INFO: Logging pods the kubelet thinks is on node i-00e2a3416f09a146a Jan 6 06:42:59.257: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-wvnkl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.257: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bqlxl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.257: INFO: affinity-clusterip-transition-9mbw6 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container affinity-clusterip-transition ready: true, restart count 0 Jan 6 06:42:59.257: INFO: hostexec started at 2023-01-06 06:42:54 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:59.257: INFO: pod-subpath-test-projected-7vlp started at 2023-01-06 06:38:17 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container test-container-subpath-projected-7vlp ready: false, restart count 0 Jan 6 06:42:59.257: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n4gvl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.257: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nljmx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.257: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-z6bp5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.257: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-rd5kq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.257: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-5v5xp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:59.257: INFO: rs-xjfv2 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:59.257: INFO: affinity-clusterip-timeout-94b4c started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:42:59.257: INFO: pod-3e08c759-655f-40a7-9a02-b3d5823ccebc started at 2023-01-06 06:39:29 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container test-container ready: false, restart count 0 Jan 6 06:42:59.257: INFO: rs-q6qrb started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:59.257: INFO: external-injector started at 2023-01-06 06:41:52 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container external-injector ready: false, restart count 0 Jan 6 06:42:59.257: INFO: cilium-4tnhd started at 2023-01-06 06:25:38 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:59.257: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:42:59.257: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g7ftv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.257: INFO: rs-mpx98 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:59.257: INFO: dns-test-809ded8f-de8a-4c44-9545-585f12522763 started at 2023-01-06 06:36:36 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:59.257: INFO: Container jessie-querier ready: false, restart count 0 Jan 6 06:42:59.257: INFO: Container querier ready: false, restart count 0 Jan 6 06:42:59.257: INFO: Container webserver ready: false, restart count 0 Jan 6 06:42:59.257: INFO: sample-webhook-deployment-865554f4d9-xx66r started at 2023-01-06 06:41:15 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container sample-webhook ready: false, restart count 0 Jan 6 06:42:59.257: INFO: ebs-csi-node-w4gks started at 2023-01-06 06:25:38 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:59.257: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:59.257: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:59.257: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:59.257: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-9jl5j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.257: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-727r8 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.257: INFO: pod-a782d690-ad63-4815-a2c4-dad0d0dd28de started at 2023-01-06 06:36:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:42:59.257: INFO: hostpath-symlink-prep-provisioning-7481 started at 2023-01-06 06:42:57 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.257: INFO: Container init-volume-provisioning-7481 ready: false, restart count 0 Jan 6 06:42:59.447: INFO: Latency metrics for node i-00e2a3416f09a146a Jan 6 06:42:59.447: INFO: Logging node info for node i-038260c95b7cbf8dd Jan 6 06:42:59.481: INFO: Node Info: &Node{ObjectMeta:{i-038260c95b7cbf8dd ba495758-87ae-4472-b9d2-10e6fd017588 23083 0 2023-01-06 06:25:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-038260c95b7cbf8dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-038260c95b7cbf8dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.153 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-188":"i-038260c95b7cbf8dd","csi-hostpath-provisioning-4332":"i-038260c95b7cbf8dd","ebs.csi.aws.com":"i-038260c95b7cbf8dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:41:18 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:41:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-038260c95b7cbf8dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:26:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.153,},NodeAddress{Type:ExternalIP,Address:35.183.20.213,},NodeAddress{Type:InternalDNS,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-183-20-213.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dcb30d66cfec0075096c81f360304,SystemUUID:ec2dcb30-d66c-fec0-0750-96c81f360304,BootID:d74ef702-20db-4c1a-ac66-e72d9b82565b,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252 kubernetes.io/csi/csi-hostpath-provisioning-4332^1e8f61b4-8d8d-11ed-93d1-620a615b4ed2],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-4332^1e8f61b4-8d8d-11ed-93d1-620a615b4ed2,DevicePath:,},},Config:nil,},} Jan 6 06:42:59.482: INFO: Logging kubelet events for node i-038260c95b7cbf8dd Jan 6 06:42:59.515: INFO: Logging pods the kubelet thinks is on node i-038260c95b7cbf8dd Jan 6 06:42:59.555: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pkzq2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.555: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4cf9x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.555: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-p252s started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.555: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4x2wx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.555: INFO: affinity-clusterip-transition-nlpm8 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:42:59.555: INFO: hostexec-i-038260c95b7cbf8dd-mzglw started at 2023-01-06 06:40:56 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:59.555: INFO: pod-subpath-test-preprovisionedpv-6m4h started at 2023-01-06 06:41:10 +0000 UTC (1+2 container statuses recorded) Jan 6 06:42:59.555: INFO: Init container test-init-subpath-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:42:59.555: INFO: Container test-container-subpath-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:42:59.555: INFO: Container test-container-volume-preprovisionedpv-6m4h ready: false, restart count 0 Jan 6 06:42:59.555: INFO: coredns-559769c974-tj9mr started at 2023-01-06 06:26:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container coredns ready: true, restart count 0 Jan 6 06:42:59.555: INFO: rs-z75vx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:59.555: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-lh5x9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:59.555: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-vrx5z started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.555: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-ddpcp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.555: INFO: rs-zmb4t started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:59.555: INFO: hostexec-i-038260c95b7cbf8dd-ldm4j started at 2023-01-06 06:38:03 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:59.555: INFO: pod-subpath-test-dynamicpv-sntd started at 2023-01-06 06:41:17 +0000 UTC (1+2 container statuses recorded) Jan 6 06:42:59.555: INFO: Init container test-init-subpath-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:42:59.555: INFO: Container test-container-subpath-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:42:59.555: INFO: Container test-container-volume-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:42:59.555: INFO: cilium-9n89s started at 2023-01-06 06:25:58 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:42:59.555: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:53 +0000 UTC (0+7 container statuses recorded) Jan 6 06:42:59.555: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container hostpath ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:59.555: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-6bp9g started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.555: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jnnxp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:59.555: INFO: pod-a47b83f9-cc6f-4f6a-9143-1f820cb0f680 started at 2023-01-06 06:38:08 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:42:59.555: INFO: ebs-csi-node-bds8q started at 2023-01-06 06:25:58 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:59.555: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:59.555: INFO: pod-subpath-test-dynamicpv-482k started at 2023-01-06 06:41:16 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container test-container-subpath-dynamicpv-482k ready: false, restart count 0 Jan 6 06:42:59.555: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kssp4 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.555: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.555: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:36:36 +0000 UTC (0+7 container statuses recorded) Jan 6 06:42:59.555: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container hostpath ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:59.555: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:59.828: INFO: Latency metrics for node i-038260c95b7cbf8dd Jan 6 06:42:59.828: INFO: Logging node info for node i-03c3347a40904af85 Jan 6 06:42:59.859: INFO: Node Info: &Node{ObjectMeta:{i-03c3347a40904af85 acf58f94-6029-4390-a68e-e4dc4881fbb2 23391 0 2023-01-06 06:26:08 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-03c3347a40904af85 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-03c3347a40904af85 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.54 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-03c3347a40904af85"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:26:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:19 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:37:00 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:42:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-03c3347a40904af85,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:08 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:42:06 +0000 UTC,LastTransitionTime:2023-01-06 06:26:19 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.54,},NodeAddress{Type:ExternalIP,Address:15.223.65.129,},NodeAddress{Type:InternalDNS,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-03c3347a40904af85.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-223-65-129.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2be680388baaf810ad9be3463c2150,SystemUUID:ec2be680-388b-aaf8-10ad-9be3463c2150,BootID:e07e85b2-353d-46e6-bf6b-941e6e0ae86a,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-06168f41609fc4bc4,DevicePath:,},},Config:nil,},} Jan 6 06:42:59.860: INFO: Logging kubelet events for node i-03c3347a40904af85 Jan 6 06:42:59.893: INFO: Logging pods the kubelet thinks is on node i-03c3347a40904af85 Jan 6 06:42:59.933: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-xskq7 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.933: INFO: pod-6faed302-3756-4d38-8d98-81f254795610 started at 2023-01-06 06:42:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:42:59.933: INFO: pod-2 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:59.933: INFO: rs-zvxqx started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:59.933: INFO: cilium-ww8tr started at 2023-01-06 06:26:09 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:59.933: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:42:59.933: INFO: ebs-csi-node-lvpjv started at 2023-01-06 06:26:09 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:59.933: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:59.933: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:59.933: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:59.933: INFO: pod-configmaps-b6eb366a-a1a5-44ab-ac82-5dd5e2aed984 started at 2023-01-06 06:41:23 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container agnhost-container ready: false, restart count 0 Jan 6 06:42:59.933: INFO: downwardapi-volume-52e6a5ae-b501-4ba1-be31-d95abea8b4c8 started at 2023-01-06 06:42:47 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container client-container ready: false, restart count 0 Jan 6 06:42:59.933: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g8tzv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.933: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pxg45 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.933: INFO: inline-volume-tester-n28z7 started at 2023-01-06 06:35:53 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 6 06:42:59.933: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-pq9p9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.933: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-s7f2j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.933: INFO: test-ss-0 started at 2023-01-06 06:35:50 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container webserver ready: false, restart count 0 Jan 6 06:42:59.933: INFO: affinity-clusterip-timeout-56jbj started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container affinity-clusterip-timeout ready: false, restart count 0 Jan 6 06:42:59.933: INFO: affinity-clusterip-transition-j2cw9 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container affinity-clusterip-transition ready: false, restart count 0 Jan 6 06:42:59.933: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-q8g6m started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.933: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4ch6k started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.933: INFO: rs-kb44r started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:59.933: INFO: podecd1684a-4613-4907-b951-ddd2cbe92f5f started at 2023-01-06 06:38:00 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container nginx ready: false, restart count 0 Jan 6 06:42:59.933: INFO: hostexec-i-03c3347a40904af85-8ntd8 started at 2023-01-06 06:42:16 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:59.933: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-tkmjc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:59.933: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-jtjnf started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.933: INFO: rs-q66kq started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:59.933: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-62rpq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:59.933: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:59.933: INFO: csi-hostpathplugin-0 started at 2023-01-06 06:41:47 +0000 UTC (0+7 container statuses recorded) Jan 6 06:42:59.933: INFO: Container csi-attacher ready: false, restart count 0 Jan 6 06:42:59.933: INFO: Container csi-provisioner ready: false, restart count 0 Jan 6 06:42:59.933: INFO: Container csi-resizer ready: false, restart count 0 Jan 6 06:42:59.933: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 6 06:42:59.933: INFO: Container hostpath ready: false, restart count 0 Jan 6 06:42:59.933: INFO: Container liveness-probe ready: false, restart count 0 Jan 6 06:42:59.933: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 6 06:43:00.137: INFO: Latency metrics for node i-03c3347a40904af85 Jan 6 06:43:00.137: INFO: Logging node info for node i-04cab7fc0ec1601e6 Jan 6 06:43:00.168: INFO: Node Info: &Node{ObjectMeta:{i-04cab7fc0ec1601e6 2d853506-d4dc-4e6a-ad93-16f5ebcea997 22694 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-04cab7fc0ec1601e6 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-04cab7fc0ec1601e6 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.60.215 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-04cab7fc0ec1601e6"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-06 06:40:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-04cab7fc0ec1601e6,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:40:44 +0000 UTC,LastTransitionTime:2023-01-06 06:25:51 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.60.215,},NodeAddress{Type:ExternalIP,Address:15.222.251.140,},NodeAddress{Type:InternalDNS,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-04cab7fc0ec1601e6.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-251-140.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2b15a5f89be6a782a1e3e9076afdcb,SystemUUID:ec2b15a5-f89b-e6a7-82a1-e3e9076afdcb,BootID:c698d6b6-6a59-41c3-8d65-390a1e2ed279,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:43:00.168: INFO: Logging kubelet events for node i-04cab7fc0ec1601e6 Jan 6 06:43:00.221: INFO: Logging pods the kubelet thinks is on node i-04cab7fc0ec1601e6 Jan 6 06:43:00.273: INFO: pod-0 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:00.273: INFO: ebs-csi-node-db2rw started at 2023-01-06 06:25:37 +0000 UTC (0+3 container statuses recorded) Jan 6 06:43:00.273: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:00.273: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:00.273: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:43:00.273: INFO: cilium-n8ld4 started at 2023-01-06 06:25:37 +0000 UTC (1+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:43:00.273: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:43:00.273: INFO: coredns-559769c974-qmgjs started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container coredns ready: true, restart count 0 Jan 6 06:43:00.273: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nfchl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.273: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kdmj6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.273: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-sj6xh started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.273: INFO: coredns-autoscaler-7cb5c5b969-6txvw started at 2023-01-06 06:25:51 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container autoscaler ready: true, restart count 0 Jan 6 06:43:00.273: INFO: affinity-clusterip-timeout-qvtbc started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:43:00.273: INFO: pod-1 started at 2023-01-06 06:36:20 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:00.273: INFO: rs-4ks6z started at 2023-01-06 06:36:23 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:00.273: INFO: rs-6vhk6 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container donothing ready: false, restart count 0 Jan 6 06:43:00.273: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bzw88 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.273: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-kvds2 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.273: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4fsc6 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.273: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-4wmx5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.273: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-dz4q9 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.273: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-svh2x started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:43:00.273: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n99wc started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.273: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:43:00.466: INFO: Latency metrics for node i-04cab7fc0ec1601e6 Jan 6 06:43:00.467: INFO: Logging node info for node i-0dfd4e56c03b27188 Jan 6 06:43:00.502: INFO: Node Info: &Node{ObjectMeta:{i-0dfd4e56c03b27188 2628d33e-cb25-41db-a644-b167c0d84591 23472 0 2023-01-06 06:23:52 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0dfd4e56c03b27188 kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.56.87 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0dfd4e56c03b27188"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-06 06:23:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-06 06:24:20 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:24:41 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-06 06:42:16 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0dfd4e56c03b27188,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3862941696 0} {<nil>} 3772404Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3758084096 0} {<nil>} 3670004Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:23:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:42:16 +0000 UTC,LastTransitionTime:2023-01-06 06:24:39 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.56.87,},NodeAddress{Type:ExternalIP,Address:15.222.64.3,},NodeAddress{Type:InternalDNS,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0dfd4e56c03b27188.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-64-3.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23482dbb2dc570b65c2c6afcd72a4c,SystemUUID:ec23482d-bb2d-c570-b65c-2c6afcd72a4c,BootID:e04f4923-c80f-4e9b-852a-b2b114eb6541,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43434708,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42805585,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967331,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 6 06:43:00.502: INFO: Logging kubelet events for node i-0dfd4e56c03b27188 Jan 6 06:43:00.538: INFO: Logging pods the kubelet thinks is on node i-0dfd4e56c03b27188 Jan 6 06:43:00.574: INFO: etcd-manager-events-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.574: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:43:00.574: INFO: etcd-manager-main-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.574: INFO: Container etcd-manager ready: true, restart count 0 Jan 6 06:43:00.574: INFO: kube-apiserver-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+2 container statuses recorded) Jan 6 06:43:00.574: INFO: Container healthcheck ready: true, restart count 0 Jan 6 06:43:00.574: INFO: Container kube-apiserver ready: true, restart count 1 Jan 6 06:43:00.574: INFO: kube-scheduler-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.574: INFO: Container kube-scheduler ready: true, restart count 0 Jan 6 06:43:00.574: INFO: kops-controller-27r6m started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.574: INFO: Container kops-controller ready: true, restart count 0 Jan 6 06:43:00.574: INFO: kube-controller-manager-i-0dfd4e56c03b27188 started at 2023-01-06 06:23:21 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.574: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 6 06:43:00.574: INFO: ebs-csi-node-x7dz5 started at 2023-01-06 06:24:25 +0000 UTC (0+3 container statuses recorded) Jan 6 06:43:00.574: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:00.574: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:00.574: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:43:00.574: INFO: aws-cloud-controller-manager-snk2c started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.574: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 6 06:43:00.574: INFO: cilium-j2vh5 started at 2023-01-06 06:24:25 +0000 UTC (1+1 container statuses recorded) Jan 6 06:43:00.574: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:43:00.574: INFO: Container cilium-agent ready: true, restart count 1 Jan 6 06:43:00.574: INFO: dns-controller-69987775c6-76fgw started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.574: INFO: Container dns-controller ready: true, restart count 0 Jan 6 06:43:00.574: INFO: cilium-operator-5dd44dc49f-wnkl6 started at 2023-01-06 06:24:25 +0000 UTC (0+1 container statuses recorded) Jan 6 06:43:00.574: INFO: Container cilium-operator ready: true, restart count 1 Jan 6 06:43:00.574: INFO: ebs-csi-controller-89b649c94-slv9n started at 2023-01-06 06:24:25 +0000 UTC (0+5 container statuses recorded) Jan 6 06:43:00.574: INFO: Container csi-attacher ready: true, restart count 0 Jan 6 06:43:00.574: INFO: Container csi-provisioner ready: true, restart count 0 Jan 6 06:43:00.574: INFO: Container csi-resizer ready: true, restart count 0 Jan 6 06:43:00.574: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:43:00.574: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:43:00.737: INFO: Latency metrics for node i-0dfd4e56c03b27188 [DeferCleanup (Each)] [sig-network] Services tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "services-9432" for this suite. �[38;5;243m01/06/23 06:43:00.737�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-node\]\sContainer\sRuntime\sblackbox\stest\son\sterminated\scontainer\sshould\sreport\stermination\smessage\sas\sempty\swhen\spod\ssucceeds\sand\sTerminationMessagePolicy\sFallbackToLogsOnError\sis\sset\s\[NodeConformance\]\s\[Conformance\]$'
test/e2e/common/node/runtime.go:157 k8s.io/kubernetes/test/e2e/common/node.glob..func18.1.2.1({{0x764326c, 0x1d}, {0xc0004278f0, 0x2e}, {0xc002e6aba0, 0x2, 0x2}, {0xc00147d580, 0x1, 0x1}, ...}, ...) test/e2e/common/node/runtime.go:157 +0x38c k8s.io/kubernetes/test/e2e/common/node.glob..func18.1.2.5() test/e2e/common/node/runtime.go:240 +0x16e
[BeforeEach] [sig-node] Container Runtime set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/06/23 06:37:44.793�[0m Jan 6 06:37:44.793: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename container-runtime �[38;5;243m01/06/23 06:37:44.794�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/06/23 06:37:44.889�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/06/23 06:37:44.95�[0m [BeforeEach] [sig-node] Container Runtime test/e2e/framework/metrics/init/init.go:31 [It] should report termination message as empty when pod succeeds and TerminationMessagePolicy FallbackToLogsOnError is set [NodeConformance] [Conformance] test/e2e/common/node/runtime.go:232 �[1mSTEP:�[0m create the container �[38;5;243m01/06/23 06:37:45.011�[0m �[1mSTEP:�[0m wait for the container to reach Succeeded �[38;5;243m01/06/23 06:37:45.045�[0m Jan 6 06:42:45.047: FAIL: Timed out after 300.001s. Expected <v1.PodPhase>: Pending to equal <v1.PodPhase>: Succeeded Full Stack Trace k8s.io/kubernetes/test/e2e/common/node.glob..func18.1.2.1({{0x764326c, 0x1d}, {0xc0004278f0, 0x2e}, {0xc002e6aba0, 0x2, 0x2}, {0xc00147d580, 0x1, 0x1}, ...}, ...) test/e2e/common/node/runtime.go:157 +0x38c k8s.io/kubernetes/test/e2e/common/node.glob..func18.1.2.5() test/e2e/common/node/runtime.go:240 +0x16e [AfterEach] [sig-node] Container Runtime test/e2e/framework/node/init/init.go:32 Jan 6 06:42:45.085: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-node] Container Runtime test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-node] Container Runtime dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/06/23 06:42:45.118�[0m �[1mSTEP:�[0m Collecting events from namespace "container-runtime-441". �[38;5;243m01/06/23 06:42:45.118�[0m �[1mSTEP:�[0m Found 11 events. �[38;5;243m01/06/23 06:42:45.149�[0m Jan 6 06:42:45.149: INFO: At 2023-01-06 06:37:45 +0000 UTC - event for termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3: {default-scheduler } Scheduled: Successfully assigned container-runtime-441/termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3 to i-00e2a3416f09a146a Jan 6 06:42:45.149: INFO: At 2023-01-06 06:37:45 +0000 UTC - event for termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "61060720f303e5716b8620a15ea1dc1d5d7e671c63674eb289711317c8f5f7d5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:45.149: INFO: At 2023-01-06 06:37:58 +0000 UTC - event for termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "bfecae4d1c10943e29e406ac083f72ad411e3f3f0b2f280d284e7619b83ac202": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:45.149: INFO: At 2023-01-06 06:38:10 +0000 UTC - event for termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9fd4b3eb79f47d280b74cbad4b53f78a67cc714b9919645705fe38663434d21c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:45.149: INFO: At 2023-01-06 06:38:23 +0000 UTC - event for termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6db573247b94ebde3a59cd439374d1d12e224c7b072692f06a912f9da61239e5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:45.149: INFO: At 2023-01-06 06:38:37 +0000 UTC - event for termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8258e449b2abadc2fab713fed7416cb27f04d8383d80888ef26f4b4a44c1bc0c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:45.149: INFO: At 2023-01-06 06:38:50 +0000 UTC - event for termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "66eda4825dc99c2885c6773239520ad6730035a45c64cbe49e2c81b715396ef4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:45.149: INFO: At 2023-01-06 06:39:02 +0000 UTC - event for termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "89196fa244e363471367e29218ab6d239ea85248bda5fea0b00569518abbfe01": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:45.149: INFO: At 2023-01-06 06:39:13 +0000 UTC - event for termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e5f221dcdf52632d92682e2aabe2b524fdd318c27201c3bfe4884a57983d3e4b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:45.149: INFO: At 2023-01-06 06:39:25 +0000 UTC - event for termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9dbe1a4346ba044f9a5f1af1aa7b02b6a1cc6111cb71b12ca555688fb6761683": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:45.149: INFO: At 2023-01-06 06:39:37 +0000 UTC - event for termination-message-containerc1a9d094-4f97-45b2-ad70-789d1f2087a3: {kubelet i-00e2a3416f09a146a} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "23aca7fd59d8ed1711014291e2471c7413380837b5afaaf384bd513fd9fdcb5c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 6 06:42:45.180: INFO: POD NODE PHASE GRACE CONDITIONS Jan 6 06:42:45.180: INFO: Jan 6 06:42:45.212: INFO: Logging node info for node i-00e2a3416f09a146a Jan 6 06:42:45.244: INFO: Node Info: &Node{ObjectMeta:{i-00e2a3416f09a146a 8b86fb5a-68fd-4aec-8591-934be54479d5 23360 0 2023-01-06 06:25:37 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00e2a3416f09a146a kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-00e2a3416f09a146a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.186 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00e2a3416f09a146a"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:25:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:41:54 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:41:59 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00e2a3416f09a146a,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:41:59 +0000 UTC,LastTransitionTime:2023-01-06 06:25:52 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.186,},NodeAddress{Type:ExternalIP,Address:3.97.12.121,},NodeAddress{Type:InternalDNS,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00e2a3416f09a146a.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-97-12-121.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2895effafa575efe2674497633226d,SystemUUID:ec2895ef-fafa-575e-fe26-74497633226d,BootID:79823d62-e8bb-4de7-91b6-78fb8137f2da,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99 kubernetes.io/csi/ebs.csi.aws.com^vol-0dfd8d85db9fb3624],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0164414c53aa9da99,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0dfd8d85db9fb3624,DevicePath:,},},Config:nil,},} Jan 6 06:42:45.244: INFO: Logging kubelet events for node i-00e2a3416f09a146a Jan 6 06:42:45.278: INFO: Logging pods the kubelet thinks is on node i-00e2a3416f09a146a Jan 6 06:42:45.345: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-z6bp5 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:45.345: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-rd5kq started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:45.345: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-5v5xp started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: false, restart count 0 Jan 6 06:42:45.345: INFO: rs-xjfv2 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:45.345: INFO: affinity-clusterip-timeout-94b4c started at 2023-01-06 06:36:19 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container affinity-clusterip-timeout ready: true, restart count 0 Jan 6 06:42:45.345: INFO: pod-3e08c759-655f-40a7-9a02-b3d5823ccebc started at 2023-01-06 06:39:29 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container test-container ready: false, restart count 0 Jan 6 06:42:45.345: INFO: rs-q6qrb started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container donothing ready: false, restart count 0 Jan 6 06:42:45.345: INFO: external-injector started at 2023-01-06 06:41:52 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container external-injector ready: false, restart count 0 Jan 6 06:42:45.345: INFO: cilium-4tnhd started at 2023-01-06 06:25:38 +0000 UTC (1+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 6 06:42:45.345: INFO: Container cilium-agent ready: true, restart count 0 Jan 6 06:42:45.345: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-g7ftv started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:45.345: INFO: rs-mpx98 started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:45.345: INFO: dns-test-809ded8f-de8a-4c44-9545-585f12522763 started at 2023-01-06 06:36:36 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:45.345: INFO: Container jessie-querier ready: false, restart count 0 Jan 6 06:42:45.345: INFO: Container querier ready: false, restart count 0 Jan 6 06:42:45.345: INFO: Container webserver ready: false, restart count 0 Jan 6 06:42:45.345: INFO: externalname-service-9lqkc started at 2023-01-06 06:37:46 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container externalname-service ready: false, restart count 0 Jan 6 06:42:45.345: INFO: sample-webhook-deployment-865554f4d9-xx66r started at 2023-01-06 06:41:15 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container sample-webhook ready: false, restart count 0 Jan 6 06:42:45.345: INFO: ebs-csi-node-w4gks started at 2023-01-06 06:25:38 +0000 UTC (0+3 container statuses recorded) Jan 6 06:42:45.345: INFO: Container ebs-plugin ready: true, restart count 0 Jan 6 06:42:45.345: INFO: Container liveness-probe ready: true, restart count 0 Jan 6 06:42:45.345: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 6 06:42:45.345: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-9jl5j started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:45.345: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-727r8 started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:45.345: INFO: pod-a782d690-ad63-4815-a2c4-dad0d0dd28de started at 2023-01-06 06:36:41 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container write-pod ready: false, restart count 0 Jan 6 06:42:45.345: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-wvnkl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:45.345: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-bqlxl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:45.345: INFO: affinity-clusterip-transition-9mbw6 started at 2023-01-06 06:36:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container affinity-clusterip-transition ready: true, restart count 0 Jan 6 06:42:45.345: INFO: sample-crd-conversion-webhook-deployment-74ff66dd47-tdzbv started at 2023-01-06 06:37:58 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container sample-crd-conversion-webhook ready: false, restart count 0 Jan 6 06:42:45.345: INFO: pod-subpath-test-projected-7vlp started at 2023-01-06 06:38:17 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container test-container-subpath-projected-7vlp ready: false, restart count 0 Jan 6 06:42:45.345: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-n4gvl started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:45.345: INFO: cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8-nljmx started at 2023-01-06 06:35:49 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.345: INFO: Container cleanup40-8bd9b945-f29c-400d-8864-b2fde8010ad8 ready: true, restart count 0 Jan 6 06:42:45.551: INFO: Latency metrics for node i-00e2a3416f09a146a Jan 6 06:42:45.551: INFO: Logging node info for node i-038260c95b7cbf8dd Jan 6 06:42:45.582: INFO: Node Info: &Node{ObjectMeta:{i-038260c95b7cbf8dd ba495758-87ae-4472-b9d2-10e6fd017588 23083 0 2023-01-06 06:25:57 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-038260c95b7cbf8dd kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-038260c95b7cbf8dd topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.61.153 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-188":"i-038260c95b7cbf8dd","csi-hostpath-provisioning-4332":"i-038260c95b7cbf8dd","ebs.csi.aws.com":"i-038260c95b7cbf8dd"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-06 06:25:57 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:26:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {e2e.test Update v1 2023-01-06 06:35:48 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-06 06:41:18 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-06 06:41:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-038260c95b7cbf8dd,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051689472 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946831872 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:25:57 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-06 06:41:26 +0000 UTC,LastTransitionTime:2023-01-06 06:26:12 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.61.153,},NodeAddress{Type:ExternalIP,Address:35.183.20.213,},NodeAddress{Type:InternalDNS,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-038260c95b7cbf8dd.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-183-20-213.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2dcb30d66cfec0075096c81f360304,SystemUUID:ec2dcb30-d66c-fec0-0750-96c81f360304,BootID:d74ef702-20db-4c1a-ac66-e72d9b82565b,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.14,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:10e231cf07c82dfab5141c1afe548dc734e5fc1f67665ec3982a325d1bd31a9a registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.0],SizeBytes:29725756,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252 kubernetes.io/csi/csi-hostpath-provisioning-4332^1e8f61b4-8d8d-11ed-93d1-620a615b4ed2],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-188^92bff983-8d8c-11ed-ad5f-3e4a7d878252,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-4332^1e8f61b4-8d8d-11ed-93d1-620a615b4ed2,DevicePath:,},},Config:nil,},} Jan 6 06:42:45.583: INFO: Logging kubelet events for node i-038260c95b7cbf8dd Jan 6 06:42:45.616: INFO: Logging pods the kubelet thinks is on node i-038260c95b7cbf8dd Jan 6 06:42:45.656: INFO: rs-zmb4t started at 2023-01-06 06:36:24 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.656: INFO: Container donothing ready: true, restart count 0 Jan 6 06:42:45.656: INFO: hostexec-i-038260c95b7cbf8dd-ldm4j started at 2023-01-06 06:38:03 +0000 UTC (0+1 container statuses recorded) Jan 6 06:42:45.656: INFO: Container agnhost-container ready: true, restart count 0 Jan 6 06:42:45.656: INFO: pod-subpath-test-dynamicpv-sntd started at 2023-01-06 06:41:17 +0000 UTC (1+2 container statuses recorded) Jan 6 06:42:45.656: INFO: Init container test-init-subpath-dynamicpv-sntd ready: false, restart count 0 Jan 6 06:42:45.656: INFO: Container test-container-subpath-dynamicpv-sntd re