e2e-kops-grid-cilium-eni-u2004-k26 #1613420444021428224 Results

Test Failures

Kubernetes e2e suite [It] External Storage [Driver: ebs.csi.aws.com] [Testpattern: Dynamic PV (block volmode)] volumes should store data 5m14s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(block\svolmode\)\]\svolumes\sshould\sstore\sdata$'

test/e2e/framework/volume/fixtures.go:571
k8s.io/kubernetes/test/e2e/framework/volume.InjectContent(0xc0018a65a0, {{0xc003b5c860, 0xa}, {0x75c30d7, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...)
	test/e2e/framework/volume/fixtures.go:571 +0x279
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/volumes.go:185 +0x457
				[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes
  test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/12/23 06:35:44.338�[0m
Jan 12 06:35:44.338: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename volume �[38;5;243m01/12/23 06:35:44.339�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/12/23 06:35:44.434�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/12/23 06:35:44.495�[0m
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] volumes
  test/e2e/framework/metrics/init/init.go:31
[It] should store data
  test/e2e/storage/testsuites/volumes.go:158
Jan 12 06:35:44.556: INFO: Creating resource for dynamic PV
Jan 12 06:35:44.556: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi} 
�[1mSTEP:�[0m creating a StorageClass volume-480-e2e-sczbtvp �[38;5;243m01/12/23 06:35:44.556�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/12/23 06:35:44.588�[0m
�[1mSTEP:�[0m starting external-injector �[38;5;243m01/12/23 06:35:44.653�[0m
Jan 12 06:35:44.686: INFO: Waiting up to 5m0s for pod "external-injector" in namespace "volume-480" to be "running"
Jan 12 06:35:44.717: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 30.758923ms
Jan 12 06:35:46.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062890462s
Jan 12 06:35:48.752: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4.06602486s
Jan 12 06:35:50.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 6.062903307s
Jan 12 06:35:52.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 8.06313774s
Jan 12 06:35:54.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 10.062901238s
Jan 12 06:35:56.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 12.062415816s
Jan 12 06:35:58.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 14.062913648s
Jan 12 06:36:00.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 16.062806661s
Jan 12 06:36:02.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 18.062960521s
Jan 12 06:36:04.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 20.063343193s
Jan 12 06:36:06.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 22.062393136s
Jan 12 06:36:08.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 24.062521655s
Jan 12 06:36:10.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 26.062916759s
Jan 12 06:36:12.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 28.063066174s
Jan 12 06:36:14.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 30.06285654s
Jan 12 06:36:16.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 32.062867248s
Jan 12 06:36:18.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 34.063104577s
Jan 12 06:36:20.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 36.063228338s
Jan 12 06:36:22.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 38.062375226s
Jan 12 06:36:24.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 40.062885655s
Jan 12 06:36:26.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 42.062417706s
Jan 12 06:36:28.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 44.062949186s
Jan 12 06:36:30.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 46.062074615s
Jan 12 06:36:32.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 48.063189757s
Jan 12 06:36:34.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 50.062938169s
Jan 12 06:36:36.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 52.062338532s
Jan 12 06:36:38.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 54.063069504s
Jan 12 06:36:40.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 56.062199478s
Jan 12 06:36:42.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 58.062114845s
Jan 12 06:36:44.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.06244648s
Jan 12 06:36:46.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.062396224s
Jan 12 06:36:48.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.063065766s
Jan 12 06:36:50.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.062828218s
Jan 12 06:36:52.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.063059929s
Jan 12 06:36:54.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.062204426s
Jan 12 06:36:56.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.062161857s
Jan 12 06:36:58.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.063017647s
Jan 12 06:37:00.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.062790058s
Jan 12 06:37:02.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.063085377s
Jan 12 06:37:04.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.062540136s
Jan 12 06:37:06.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.062862432s
Jan 12 06:37:08.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.063096762s
Jan 12 06:37:10.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.063077577s
Jan 12 06:37:12.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.062595567s
Jan 12 06:37:14.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.06316484s
Jan 12 06:37:16.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.06225104s
Jan 12 06:37:18.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.062770227s
Jan 12 06:37:20.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.062933544s
Jan 12 06:37:22.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.062456059s
Jan 12 06:37:24.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.062884424s
Jan 12 06:37:26.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.06220961s
Jan 12 06:37:28.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.063080699s
Jan 12 06:37:30.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.062154685s
Jan 12 06:37:32.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.061961364s
Jan 12 06:37:34.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.063484773s
Jan 12 06:37:36.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.062071033s
Jan 12 06:37:38.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.063116058s
Jan 12 06:37:40.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.063224665s
Jan 12 06:37:42.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.063372952s
Jan 12 06:37:44.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.062600145s
Jan 12 06:37:46.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.062551672s
Jan 12 06:37:48.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.062852878s
Jan 12 06:37:50.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.063028857s
Jan 12 06:37:52.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.062317311s
Jan 12 06:37:54.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.062148191s
Jan 12 06:37:56.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.062071639s
Jan 12 06:37:58.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.063093844s
Jan 12 06:38:00.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.062297282s
Jan 12 06:38:02.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.062365917s
Jan 12 06:38:04.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.062124049s
Jan 12 06:38:06.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.06244165s
Jan 12 06:38:08.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.062851033s
Jan 12 06:38:10.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.063271697s
Jan 12 06:38:12.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.06243686s
Jan 12 06:38:14.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.063129615s
Jan 12 06:38:16.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.061946119s
Jan 12 06:38:18.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.063253189s
Jan 12 06:38:20.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.062117201s
Jan 12 06:38:22.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.063268076s
Jan 12 06:38:24.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.063160933s
Jan 12 06:38:26.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.062742898s
Jan 12 06:38:28.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.062394546s
Jan 12 06:38:30.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.062038531s
Jan 12 06:38:32.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.063104556s
Jan 12 06:38:34.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.063183171s
Jan 12 06:38:36.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.062309753s
Jan 12 06:38:38.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.062809487s
Jan 12 06:38:40.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.062575994s
Jan 12 06:38:42.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.062622189s
Jan 12 06:38:44.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.062618181s
Jan 12 06:38:46.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.062268962s
Jan 12 06:38:48.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.062531619s
Jan 12 06:38:50.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.063005557s
Jan 12 06:38:52.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.0625078s
Jan 12 06:38:54.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.062761741s
Jan 12 06:38:56.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.061973186s
Jan 12 06:38:58.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.062244058s
Jan 12 06:39:00.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.063149935s
Jan 12 06:39:02.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.063139965s
Jan 12 06:39:04.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.062410075s
Jan 12 06:39:06.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.063097025s
Jan 12 06:39:08.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.063056502s
Jan 12 06:39:10.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.063234968s
Jan 12 06:39:12.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.063207261s
Jan 12 06:39:14.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.062293665s
Jan 12 06:39:16.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.062391153s
Jan 12 06:39:18.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.063179826s
Jan 12 06:39:20.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.062148788s
Jan 12 06:39:22.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.062129653s
Jan 12 06:39:24.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.063493207s
Jan 12 06:39:26.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.062540901s
Jan 12 06:39:28.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.062764624s
Jan 12 06:39:30.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.062624674s
Jan 12 06:39:32.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.063289823s
Jan 12 06:39:34.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.062983808s
Jan 12 06:39:36.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.062593622s
Jan 12 06:39:38.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.063320413s
Jan 12 06:39:40.807: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.121449417s
Jan 12 06:39:42.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.063103778s
Jan 12 06:39:44.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.062301435s
Jan 12 06:39:46.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.062843352s
Jan 12 06:39:48.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.062122038s
Jan 12 06:39:50.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.062345489s
Jan 12 06:39:52.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.0622359s
Jan 12 06:39:54.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.062363182s
Jan 12 06:39:56.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.062372258s
Jan 12 06:39:58.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.062852276s
Jan 12 06:40:00.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.062149027s
Jan 12 06:40:02.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.063198854s
Jan 12 06:40:04.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.063119411s
Jan 12 06:40:06.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.062484234s
Jan 12 06:40:08.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.06321051s
Jan 12 06:40:10.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.061999859s
Jan 12 06:40:12.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.062327689s
Jan 12 06:40:14.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.062208131s
Jan 12 06:40:16.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.063063692s
Jan 12 06:40:18.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.063149618s
Jan 12 06:40:20.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.063010259s
Jan 12 06:40:22.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.062119646s
Jan 12 06:40:24.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.061966018s
Jan 12 06:40:26.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.061916791s
Jan 12 06:40:28.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.06182057s
Jan 12 06:40:30.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.062910254s
Jan 12 06:40:32.751: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.065441816s
Jan 12 06:40:34.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.063019019s
Jan 12 06:40:36.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.063025729s
Jan 12 06:40:38.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.063189474s
Jan 12 06:40:40.749: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.063332055s
Jan 12 06:40:42.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.062437323s
Jan 12 06:40:44.748: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.062388213s
Jan 12 06:40:44.780: INFO: Pod "external-injector": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.094478402s
�[1mSTEP:�[0m Deleting pod external-injector in namespace volume-480 �[38;5;243m01/12/23 06:40:44.78�[0m
Jan 12 06:40:44.814: INFO: Waiting for pod external-injector to disappear
Jan 12 06:40:44.845: INFO: Pod external-injector still exists
Jan 12 06:40:46.846: INFO: Waiting for pod external-injector to disappear
Jan 12 06:40:46.878: INFO: Pod external-injector no longer exists
Jan 12 06:40:46.878: FAIL: Failed to create injector pod: timed out while waiting for pod volume-480/external-injector to be running

Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/volume.InjectContent(0xc0018a65a0, {{0xc003b5c860, 0xa}, {0x75c30d7, 0x8}, {0x0, 0x0}, {0x0, 0x0, 0x0}, ...}, ...)
	test/e2e/framework/volume/fixtures.go:571 +0x279
k8s.io/kubernetes/test/e2e/storage/testsuites.(*volumesTestSuite).DefineTests.func3()
	test/e2e/storage/testsuites/volumes.go:185 +0x457
�[1mSTEP:�[0m cleaning the environment after external �[38;5;243m01/12/23 06:40:46.878�[0m
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/12/23 06:40:46.878�[0m
Jan 12 06:40:46.940: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comqxf4c"
Jan 12 06:40:46.974: INFO: Waiting up to 5m0s for PersistentVolume pvc-d95a8071-e278-4eff-ac92-fb700548c5dd to get deleted
Jan 12 06:40:47.005: INFO: PersistentVolume pvc-d95a8071-e278-4eff-ac92-fb700548c5dd found and phase=Released (30.849113ms)
Jan 12 06:40:52.037: INFO: PersistentVolume pvc-d95a8071-e278-4eff-ac92-fb700548c5dd found and phase=Released (5.06271849s)
Jan 12 06:40:57.082: INFO: PersistentVolume pvc-d95a8071-e278-4eff-ac92-fb700548c5dd was removed
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/12/23 06:40:57.082�[0m
[AfterEach] [Testpattern: Dynamic PV (block volmode)] volumes
  test/e2e/framework/node/init/init.go:32
Jan 12 06:40:57.128: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (block volmode)] volumes
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (block volmode)] volumes
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/12/23 06:40:57.167�[0m
�[1mSTEP:�[0m Collecting events from namespace "volume-480". �[38;5;243m01/12/23 06:40:57.167�[0m
�[1mSTEP:�[0m Found 18 events. �[38;5;243m01/12/23 06:40:57.198�[0m
Jan 12 06:40:57.198: INFO: At 2023-01-12 06:35:44 +0000 UTC - event for ebs.csi.aws.comqxf4c: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan 12 06:40:57.198: INFO: At 2023-01-12 06:35:44 +0000 UTC - event for ebs.csi.aws.comqxf4c: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan 12 06:40:57.198: INFO: At 2023-01-12 06:35:44 +0000 UTC - event for ebs.csi.aws.comqxf4c: {ebs.csi.aws.com_i-00a1700b2a4dc039f_20840ab0-96a9-4e18-962d-3db9341f7b95 } Provisioning: External provisioner is provisioning volume for claim "volume-480/ebs.csi.aws.comqxf4c"
Jan 12 06:40:57.198: INFO: At 2023-01-12 06:35:47 +0000 UTC - event for ebs.csi.aws.comqxf4c: {ebs.csi.aws.com_i-00a1700b2a4dc039f_20840ab0-96a9-4e18-962d-3db9341f7b95 } ProvisioningSucceeded: Successfully provisioned volume pvc-d95a8071-e278-4eff-ac92-fb700548c5dd
Jan 12 06:40:57.198: INFO: At 2023-01-12 06:35:48 +0000 UTC - event for external-injector: {default-scheduler } Scheduled: Successfully assigned volume-480/external-injector to i-01ebb116de9e964dc
Jan 12 06:40:57.198: INFO: At 2023-01-12 06:35:50 +0000 UTC - event for external-injector: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-d95a8071-e278-4eff-ac92-fb700548c5dd" 
Jan 12 06:40:57.198: INFO: At 2023-01-12 06:36:00 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-d95a8071-e278-4eff-ac92-fb700548c5dd" globalMapPath "/var/lib/kubelet/plugins/kubernetes.io/csi/volumeDevices/pvc-d95a8071-e278-4eff-ac92-fb700548c5dd/dev"
Jan 12 06:40:57.198: INFO: At 2023-01-12 06:36:00 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} SuccessfulMountVolume: MapVolume.MapPodDevice succeeded for volume "pvc-d95a8071-e278-4eff-ac92-fb700548c5dd" volumeMapPath "/var/lib/kubelet/pods/95f8a871-e121-4914-8550-14d6cf8ab5ce/volumeDevices/kubernetes.io~csi"
Jan 12 06:40:57.198: INFO: At 2023-01-12 06:36:00 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "642298b44b982cd21fb81d1076a93bcefa74516ba1dc05e50c071261137b6121": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:57.198: INFO: At 2023-01-12 06:36:13 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8397b993c42b3f375bb8f1b8782e353fcaf1a81933b4253fc9c8ff1b5c14fe90": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:57.199: INFO: At 2023-01-12 06:36:25 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "168d31d755629c5dc7fecaeaa173b10de50df3ed66a294439c137787fb397765": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:57.199: INFO: At 2023-01-12 06:36:39 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f94e4ad9313e208fd2dd750dcf9e0b8b688f84600d06f97f1d705f2dbf65f99b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:57.199: INFO: At 2023-01-12 06:36:50 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ff2f03ce0ecbebce2c05080437fb1531f1c6ba5cf5aef2d4e24e303acc93ede9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:57.199: INFO: At 2023-01-12 06:37:04 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ffd95a1bf0d1fcce4fd1b1fd15eec0d4a42d60cf7d236d81fc729d1e58e43cae": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:57.199: INFO: At 2023-01-12 06:37:19 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "461f9b1abd48affab80405d53e271b4acc5decbcf1aea497fd4e13325add25af": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:57.199: INFO: At 2023-01-12 06:37:34 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e712934f03adcfff42353fabc7de6c572531aeec51b6062db13efcdb594a1699": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:57.199: INFO: At 2023-01-12 06:37:50 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f6613c5bfe25bf0c592675ac69d46e6713dec83e6fba5f68b50f2b380c2f5a79": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:57.199: INFO: At 2023-01-12 06:38:05 +0000 UTC - event for external-injector: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6a26f31f6f45405666fa34a8350c35d2a76442c0e6a64227c242b1057e42894d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:57.229: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 12 06:40:57.229: INFO: 
Jan 12 06:40:57.261: INFO: 
Logging node info for node i-0029a94fa7f902ab5
Jan 12 06:40:57.293: INFO: Node Info: &Node{ObjectMeta:{i-0029a94fa7f902ab5    086bb9cc-b77b-48db-a8ae-537b7cbf6e36 18187 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0029a94fa7f902ab5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0029a94fa7f902ab5 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.235 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0029a94fa7f902ab5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:40:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0029a94fa7f902ab5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.235,},NodeAddress{Type:ExternalIP,Address:15.222.254.31,},NodeAddress{Type:InternalDNS,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-254-31.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2680cab44fba5db711d741fbe294e7,SystemUUID:ec2680ca-b44f-ba5d-b711-d741fbe294e7,BootID:01f1463d-4c68-4aa0-8900-0499980b4f60,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:40:57.293: INFO: 
Logging kubelet events for node i-0029a94fa7f902ab5
Jan 12 06:40:57.326: INFO: 
Logging pods the kubelet thinks is on node i-0029a94fa7f902ab5
Jan 12 06:40:57.400: INFO: cilium-v2fq9 started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:40:57.400: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:40:57.400: INFO: up-down-1-lvmbh started at 2023-01-12 06:35:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container up-down-1 ready: true, restart count 0
Jan 12 06:40:57.400: INFO: up-down-2-lw8c9 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container up-down-2 ready: true, restart count 0
Jan 12 06:40:57.400: INFO: ebs-csi-node-wfgs2 started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:40:57.400: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:40:57.400: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:40:57.400: INFO: test-rolling-update-with-lb-56d9b65d4c-cgjx2 started at 2023-01-12 06:35:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:40:57.400: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ds9hr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:57.400: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-798lx started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:57.400: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-jrdnf started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:57.400: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-tm86v started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:57.400: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-krdq2 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:57.400: INFO: coredns-559769c974-p2fts started at 2023-01-12 06:27:03 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:40:57.400: INFO: hostexec-i-0029a94fa7f902ab5-bvfqt started at 2023-01-12 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:40:57.400: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4c699 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:57.400: INFO: netserver-0 started at 2023-01-12 06:35:50 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container webserver ready: false, restart count 0
Jan 12 06:40:57.400: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k5j26 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:57.400: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ccxfb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:57.400: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-w5hzb started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:57.400: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-qdh5s started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.400: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:57.785: INFO: 
Latency metrics for node i-0029a94fa7f902ab5
Jan 12 06:40:57.785: INFO: 
Logging node info for node i-00a1700b2a4dc039f
Jan 12 06:40:57.818: INFO: Node Info: &Node{ObjectMeta:{i-00a1700b2a4dc039f    31b14f9e-702c-4bf4-8b4f-160f1e8d2e78 17128 0 2023-01-12 06:24:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00a1700b2a4dc039f kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.107 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00a1700b2a4dc039f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-12 06:24:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-12 06:25:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:25:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-12 06:36:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00a1700b2a4dc039f,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:25:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.107,},NodeAddress{Type:ExternalIP,Address:99.79.69.225,},NodeAddress{Type:InternalDNS,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-69-225.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2aefdb0e1836236784b773a0de1726,SystemUUID:ec2aefdb-0e18-3623-6784-b773a0de1726,BootID:efa2d6a5-f933-4174-9d1e-f2c2ada73f29,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451206,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42803449,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967343,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:40:57.818: INFO: 
Logging kubelet events for node i-00a1700b2a4dc039f
Jan 12 06:40:57.852: INFO: 
Logging pods the kubelet thinks is on node i-00a1700b2a4dc039f
Jan 12 06:40:57.889: INFO: kube-controller-manager-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 12 06:40:57.889: INFO: ebs-csi-node-vtl8h started at 2023-01-12 06:25:04 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:40:57.889: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:40:57.889: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:40:57.889: INFO: ebs-csi-controller-5bd98b456f-s56qb started at 2023-01-12 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:40:57.889: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:40:57.889: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 12 06:40:57.889: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:40:57.889: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:40:57.889: INFO: kops-controller-h6cd7 started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Container kops-controller ready: true, restart count 0
Jan 12 06:40:57.889: INFO: aws-cloud-controller-manager-vj4cr started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 12 06:40:57.889: INFO: etcd-manager-events-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:40:57.889: INFO: etcd-manager-main-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:40:57.889: INFO: kube-apiserver-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Container healthcheck ready: true, restart count 0
Jan 12 06:40:57.889: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 12 06:40:57.889: INFO: kube-scheduler-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 12 06:40:57.889: INFO: cilium-f68z5 started at 2023-01-12 06:25:04 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:40:57.889: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:40:57.889: INFO: dns-controller-69987775c6-n2lqn started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Container dns-controller ready: true, restart count 0
Jan 12 06:40:57.889: INFO: cilium-operator-5dd44dc49f-zvdwf started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:57.889: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 12 06:40:58.058: INFO: 
Latency metrics for node i-00a1700b2a4dc039f
Jan 12 06:40:58.058: INFO: 
Logging node info for node i-01ebb116de9e964dc
Jan 12 06:40:58.090: INFO: Node Info: &Node{ObjectMeta:{i-01ebb116de9e964dc    9bba0dc4-469e-4f38-b41b-aa672131ad87 18325 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01ebb116de9e964dc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01ebb116de9e964dc topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.44 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01ebb116de9e964dc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:40:46 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-12 06:40:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01ebb116de9e964dc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:46 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:46 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:46 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:40:46 +0000 UTC,LastTransitionTime:2023-01-12 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.44,},NodeAddress{Type:ExternalIP,Address:3.99.142.186,},NodeAddress{Type:InternalDNS,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-142-186.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec264bf9915ff9f6f2894d5911a8df83,SystemUUID:ec264bf9-915f-f9f6-f289-4d5911a8df83,BootID:00d4d8a1-d87c-4c57-bee6-69bb72398b91,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0a8f30cd8b848c7b2],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0a8f30cd8b848c7b2,DevicePath:,},},Config:nil,},}
Jan 12 06:40:58.090: INFO: 
Logging kubelet events for node i-01ebb116de9e964dc
Jan 12 06:40:58.123: INFO: 
Logging pods the kubelet thinks is on node i-01ebb116de9e964dc
Jan 12 06:40:58.167: INFO: rand-non-local-gzghw started at 2023-01-12 06:35:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container c ready: false, restart count 0
Jan 12 06:40:58.167: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bvnhn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.167: INFO: verify-service-up-exec-pod-rlmgx started at 2023-01-12 06:37:07 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 12 06:40:58.167: INFO: sysctl-768ebc0f-0f71-430e-9df7-6aaeed1048d0 started at 2023-01-12 06:36:26 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container test-container ready: false, restart count 0
Jan 12 06:40:58.167: INFO: up-down-2-766bd started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container up-down-2 ready: true, restart count 0
Jan 12 06:40:58.167: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kfdmq started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.167: INFO: externalname-service-nclch started at 2023-01-12 06:35:49 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container externalname-service ready: true, restart count 0
Jan 12 06:40:58.167: INFO: ebs-csi-node-bvknd started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:40:58.167: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:40:58.167: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:40:58.167: INFO: netserver-1 started at 2023-01-12 06:35:50 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container webserver ready: false, restart count 0
Jan 12 06:40:58.167: INFO: rand-non-local-flpwd started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container c ready: false, restart count 0
Jan 12 06:40:58.167: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-97p2z started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:58.167: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-mfrbf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.167: INFO: up-down-1-w9s7j started at 2023-01-12 06:35:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container up-down-1 ready: true, restart count 0
Jan 12 06:40:58.167: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-z8qq5 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:58.167: INFO: cilium-b5cfc started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:40:58.167: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:40:58.167: INFO: downward-api-8a5f93e4-4779-4ea5-af67-a3cbe3ffed2d started at 2023-01-12 06:40:33 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container dapi-container ready: false, restart count 0
Jan 12 06:40:58.167: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-nwxqm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.167: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-5pqpn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.167: INFO: test-rolling-update-with-lb-56d9b65d4c-fppl4 started at 2023-01-12 06:35:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:40:58.167: INFO: pod-0 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:40:58.167: INFO: pod-91f7acff-e88b-46ac-b71d-8d86ccb55d48 started at 2023-01-12 06:37:17 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container write-pod ready: false, restart count 0
Jan 12 06:40:58.167: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-js9bn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.167: INFO: httpd started at 2023-01-12 06:37:19 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container httpd ready: false, restart count 0
Jan 12 06:40:58.167: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-q9c9s started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.167: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-9j6sw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.167: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.394: INFO: 
Latency metrics for node i-01ebb116de9e964dc
Jan 12 06:40:58.394: INFO: 
Logging node info for node i-0b95e3cb438ca1933
Jan 12 06:40:58.426: INFO: Node Info: &Node{ObjectMeta:{i-0b95e3cb438ca1933    410c9a77-76a5-49fd-81d8-dcf127193ecf 18469 0 2023-01-12 06:26:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b95e3cb438ca1933 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0b95e3cb438ca1933 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.177 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0b95e3cb438ca1933"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:40:51 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-12 06:40:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0b95e3cb438ca1933,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:52 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:52 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:52 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:40:52 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.177,},NodeAddress{Type:ExternalIP,Address:99.79.51.51,},NodeAddress{Type:InternalDNS,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-51-51.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23cc76a58199e94cb916e26a0dbdd4,SystemUUID:ec23cc76-a581-99e9-4cb9-16e26a0dbdd4,BootID:769bca70-45b1-4d4c-82b2-ff7e3a4f99ff,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ac51d4255eea1878],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ac51d4255eea1878,DevicePath:,},},Config:nil,},}
Jan 12 06:40:58.426: INFO: 
Logging kubelet events for node i-0b95e3cb438ca1933
Jan 12 06:40:58.461: INFO: 
Logging pods the kubelet thinks is on node i-0b95e3cb438ca1933
Jan 12 06:40:58.507: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-7xqlb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.507: INFO: pod-1 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:40:58.507: INFO: inline-volume-tester-nhjm6 started at 2023-01-12 06:40:49 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 12 06:40:58.507: INFO: csi-mockplugin-attacher-0 started at 2023-01-12 06:38:21 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:40:58.507: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-2j6p9 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.507: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b6bbr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.507: INFO: pod-host-path-test started at 2023-01-12 06:40:45 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container test-container-1 ready: false, restart count 0
Jan 12 06:40:58.507: INFO: 	Container test-container-2 ready: false, restart count 0
Jan 12 06:40:58.507: INFO: up-down-2-265s2 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container up-down-2 ready: true, restart count 0
Jan 12 06:40:58.507: INFO: test-rolling-update-with-lb-56d9b65d4c-866wj started at 2023-01-12 06:35:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:40:58.507: INFO: fail-once-non-local-w64vm started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container c ready: false, restart count 0
Jan 12 06:40:58.507: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dqrr9 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.507: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-gtbjw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.507: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4sqlp started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:58.507: INFO: fail-once-non-local-l62nm started at 2023-01-12 06:35:21 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container c ready: false, restart count 0
Jan 12 06:40:58.507: INFO: externalname-service-pbv8g started at 2023-01-12 06:35:49 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container externalname-service ready: false, restart count 0
Jan 12 06:40:58.507: INFO: pod-configmaps-085510c8-09ee-4f9d-a395-d462020dcfcf started at 2023-01-12 06:35:43 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 12 06:40:58.507: INFO: 	Container configmap-volume-binary-test ready: false, restart count 0
Jan 12 06:40:58.507: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-wnxfm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:58.507: INFO: csi-mockplugin-0 started at 2023-01-12 06:38:21 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:40:58.507: INFO: 	Container driver-registrar ready: false, restart count 0
Jan 12 06:40:58.507: INFO: 	Container mock ready: false, restart count 0
Jan 12 06:40:58.507: INFO: up-down-1-n4tsw started at 2023-01-12 06:35:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container up-down-1 ready: true, restart count 0
Jan 12 06:40:58.507: INFO: ebs-csi-node-x6qtj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:40:58.507: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:40:58.507: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:40:58.507: INFO: test-rolling-update-with-lb-85b8b59c8c-rdnwt started at 2023-01-12 06:38:11 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container agnhost ready: false, restart count 0
Jan 12 06:40:58.507: INFO: fail-once-non-local-vcv58 started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container c ready: false, restart count 0
Jan 12 06:40:58.507: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vp5q6 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.507: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k9rkg started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:58.507: INFO: cilium-l6rqm started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:40:58.507: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:40:58.507: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-27f6c started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.507: INFO: fail-once-non-local-p94zd started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container c ready: false, restart count 0
Jan 12 06:40:58.507: INFO: fail-once-non-local-h8qrp started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container c ready: false, restart count 0
Jan 12 06:40:58.507: INFO: my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j started at 2023-01-12 06:35:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a ready: false, restart count 0
Jan 12 06:40:58.507: INFO: verify-service-up-host-exec-pod started at 2023-01-12 06:37:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.507: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:40:58.683: INFO: 
Latency metrics for node i-0b95e3cb438ca1933
Jan 12 06:40:58.683: INFO: 
Logging node info for node i-0bcea138229cdd410
Jan 12 06:40:58.715: INFO: Node Info: &Node{ObjectMeta:{i-0bcea138229cdd410    95f2bbd5-be1b-44e9-a59a-66f87015f9d2 18244 0 2023-01-12 06:26:24 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bcea138229cdd410 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0bcea138229cdd410 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.32.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bcea138229cdd410"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:40:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0bcea138229cdd410,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.32.113,},NodeAddress{Type:ExternalIP,Address:35.182.71.1,},NodeAddress{Type:InternalDNS,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-71-1.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21ffd1efd1b61b9def5afc88b88dba,SystemUUID:ec21ffd1-efd1-b61b-9def-5afc88b88dba,BootID:65b83838-2717-4c2d-8957-6fdcb4152c24,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:40:58.716: INFO: 
Logging kubelet events for node i-0bcea138229cdd410
Jan 12 06:40:58.750: INFO: 
Logging pods the kubelet thinks is on node i-0bcea138229cdd410
Jan 12 06:40:58.786: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-h6kb8 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.786: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-8zhgf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.786: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:37:34 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 12 06:40:58.786: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:40:58.786: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 12 06:40:58.786: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 12 06:40:58.786: INFO: 	Container hostpath ready: false, restart count 0
Jan 12 06:40:58.786: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 12 06:40:58.786: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 12 06:40:58.786: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kd57q started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.786: INFO: hostexec-i-0bcea138229cdd410-j7qft started at 2023-01-12 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:40:58.786: INFO: ebs-csi-node-g2mwj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:40:58.786: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:40:58.786: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:40:58.786: INFO: hostexec-i-0bcea138229cdd410-hx972 started at 2023-01-12 06:40:53 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:40:58.786: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6blc8 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.786: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vxhrc started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.786: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6ngxj started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.786: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dxzmh started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.786: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6p5qk started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.786: INFO: cilium-q5hq4 started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:40:58.786: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:40:58.786: INFO: coredns-autoscaler-7cb5c5b969-lzjqb started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container autoscaler ready: true, restart count 0
Jan 12 06:40:58.786: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b9cmz started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:58.786: INFO: coredns-559769c974-z5pf2 started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:40:58.786: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bg28w started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:58.786: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:58.949: INFO: 
Latency metrics for node i-0bcea138229cdd410
[DeferCleanup (Each)] [Testpattern: Dynamic PV (block volmode)] volumes
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "volume-480" for this suite. �[38;5;243m01/12/23 06:40:58.949�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-apps] CronJob should delete failed finished jobs with limit of one job 5m2s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sCronJob\sshould\sdelete\sfailed\sfinished\sjobs\swith\slimit\sof\sone\sjob$'

test/e2e/apps/cronjob.go:488
k8s.io/kubernetes/test/e2e/apps.ensureHistoryLimits({0x801e128, 0xc0049101a0}, {0xc0022d9a00, 0xc}, 0x75cbe8b?)
	test/e2e/apps/cronjob.go:488 +0x1dd
k8s.io/kubernetes/test/e2e/apps.glob..func2.9()
	test/e2e/apps/cronjob.go:298 +0xf6
				[BeforeEach] [sig-apps] CronJob
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/12/23 06:42:22.09�[0m
Jan 12 06:42:22.091: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename cronjob �[38;5;243m01/12/23 06:42:22.092�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/12/23 06:42:22.186�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/12/23 06:42:22.246�[0m
[BeforeEach] [sig-apps] CronJob
  test/e2e/framework/metrics/init/init.go:31
[It] should delete failed finished jobs with limit of one job
  test/e2e/apps/cronjob.go:291
�[1mSTEP:�[0m Creating an AllowConcurrent cronjob with custom history limit �[38;5;243m01/12/23 06:42:22.307�[0m
�[1mSTEP:�[0m Ensuring a finished job exists �[38;5;243m01/12/23 06:42:22.34�[0m
Jan 12 06:47:22.409: INFO: Unexpected error: Failed to ensure a finished cronjob exists in namespace cronjob-3444: 
    <*errors.errorString | 0xc0001cd940>: {
        s: "timed out waiting for the condition",
    }
Jan 12 06:47:22.409: FAIL: Failed to ensure a finished cronjob exists in namespace cronjob-3444: timed out waiting for the condition

Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.ensureHistoryLimits({0x801e128, 0xc0049101a0}, {0xc0022d9a00, 0xc}, 0x75cbe8b?)
	test/e2e/apps/cronjob.go:488 +0x1dd
k8s.io/kubernetes/test/e2e/apps.glob..func2.9()
	test/e2e/apps/cronjob.go:298 +0xf6
[AfterEach] [sig-apps] CronJob
  test/e2e/framework/node/init/init.go:32
Jan 12 06:47:22.410: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] CronJob
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] CronJob
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/12/23 06:47:22.442�[0m
�[1mSTEP:�[0m Collecting events from namespace "cronjob-3444". �[38;5;243m01/12/23 06:47:22.442�[0m
�[1mSTEP:�[0m Found 54 events. �[38;5;243m01/12/23 06:47:22.475�[0m
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:43:00 +0000 UTC - event for failed-jobs-history-limit: {cronjob-controller } SuccessfulCreate: Created job failed-jobs-history-limit-27891763
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:43:00 +0000 UTC - event for failed-jobs-history-limit-27891763: {job-controller } SuccessfulCreate: Created pod: failed-jobs-history-limit-27891763-zn5tf
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:43:00 +0000 UTC - event for failed-jobs-history-limit-27891763-zn5tf: {default-scheduler } Scheduled: Successfully assigned cronjob-3444/failed-jobs-history-limit-27891763-zn5tf to i-0b95e3cb438ca1933
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:43:00 +0000 UTC - event for failed-jobs-history-limit-27891763-zn5tf: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4f1d77d506361bc213a3814aa78b5bc3e30d69b9037970af229bd07543d104d6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:43:13 +0000 UTC - event for failed-jobs-history-limit-27891763-zn5tf: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6e69abdb26f5a9a76e202ae1753af2a262edf533502f4101f5edf678ae2a273f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:43:24 +0000 UTC - event for failed-jobs-history-limit-27891763-zn5tf: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "76ee9b9d012d0754b778ba977463c3fa802dcae1acd38c0812a5f4c89b9d6dba": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:43:38 +0000 UTC - event for failed-jobs-history-limit-27891763-zn5tf: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8d63e52a58e536d4cc9883a81ffaa61af31be51a38bb509e540d8f55d64859a6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:43:54 +0000 UTC - event for failed-jobs-history-limit-27891763-zn5tf: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8a6616d73294d25144700ad7f1c67f428e792edfd9cd785dad2330a1fcd74567": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:44:00 +0000 UTC - event for failed-jobs-history-limit: {cronjob-controller } SuccessfulCreate: Created job failed-jobs-history-limit-27891764
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:44:00 +0000 UTC - event for failed-jobs-history-limit-27891764: {job-controller } SuccessfulCreate: Created pod: failed-jobs-history-limit-27891764-4xh2d
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:44:00 +0000 UTC - event for failed-jobs-history-limit-27891764-4xh2d: {default-scheduler } Scheduled: Successfully assigned cronjob-3444/failed-jobs-history-limit-27891764-4xh2d to i-01ebb116de9e964dc
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:44:00 +0000 UTC - event for failed-jobs-history-limit-27891764-4xh2d: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "57f967728fbedefb026657abad36c5697d41712a8989a9da64e995a90f4993ba": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:44:05 +0000 UTC - event for failed-jobs-history-limit-27891763-zn5tf: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a76b49d1764ac30e1046bc57a36460b7b818e9ceb6bbeaaf0940b46b3bd92825": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.475: INFO: At 2023-01-12 06:44:14 +0000 UTC - event for failed-jobs-history-limit-27891764-4xh2d: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7e9a7e50bbd3934a37be8c6f86e66e4d80f98716b5f94c4ad666e9e7d674b817": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:44:20 +0000 UTC - event for failed-jobs-history-limit-27891763-zn5tf: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "dcb324f90d5e636d249b7271fa5971a1341a6f997c67d6d358b71471d4574b5e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:44:29 +0000 UTC - event for failed-jobs-history-limit-27891764-4xh2d: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d473078562761d396198d754e00e504f9cd36ae7005e1f7891c471b92595a276": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:44:34 +0000 UTC - event for failed-jobs-history-limit-27891763-zn5tf: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8d0afc1cf4c1ca248940d320bc16d7309b2a2f2b398719ab2dbfa49d392f222c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:44:43 +0000 UTC - event for failed-jobs-history-limit-27891764-4xh2d: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "181802a5cdcf4a0390a19834068f053f748ef07f84a4e0ec7f1498c5273e3d3e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:44:48 +0000 UTC - event for failed-jobs-history-limit-27891763-zn5tf: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d98fbbc751a14c45f07d2b59315b450fdc0716e2838b5dc0ab6df40e6b620425": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:44:57 +0000 UTC - event for failed-jobs-history-limit-27891764-4xh2d: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "69e642673a2d960c50929203a2eaa55f12c1502963083706ebca0be45d6bd74c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:00 +0000 UTC - event for failed-jobs-history-limit: {cronjob-controller } SuccessfulCreate: Created job failed-jobs-history-limit-27891765
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:00 +0000 UTC - event for failed-jobs-history-limit-27891763-zn5tf: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f0388e141a21323207dd8c8a9eacfd2b0196eecb606ba3da42da9c5b7328ccb6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:00 +0000 UTC - event for failed-jobs-history-limit-27891765: {job-controller } SuccessfulCreate: Created pod: failed-jobs-history-limit-27891765-xx2rh
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:00 +0000 UTC - event for failed-jobs-history-limit-27891765-xx2rh: {default-scheduler } Scheduled: Successfully assigned cronjob-3444/failed-jobs-history-limit-27891765-xx2rh to i-01ebb116de9e964dc
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:00 +0000 UTC - event for failed-jobs-history-limit-27891765-xx2rh: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "557b48196c14a7274ccab3e847755f0946db0206a2dd70902998a35e1c132166": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:11 +0000 UTC - event for failed-jobs-history-limit-27891764-4xh2d: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "87308f45e070cd91d54201c0a0a650208bf61c37a751dd9713686752eff56f5a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:13 +0000 UTC - event for failed-jobs-history-limit-27891765-xx2rh: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "949d81368908894f7eb2649456f7f01e136b0f39bf26efa23621fac9b1d5274f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:22 +0000 UTC - event for failed-jobs-history-limit-27891764-4xh2d: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "56489d5605f904e7ff00653c0816514e27cea792f859cc84a31e7b141ad94058": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:27 +0000 UTC - event for failed-jobs-history-limit-27891765-xx2rh: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "839ba44c9e83db7e4b50c69d1b8d8e4087dac5944f6fd03dc2ae2abb66a0fead": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:36 +0000 UTC - event for failed-jobs-history-limit-27891764-4xh2d: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "794df9e67b2c3210ead430a88f5a698f2d55074961be5dac20c95bf41fb1deeb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:39 +0000 UTC - event for failed-jobs-history-limit-27891765-xx2rh: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "92a4fefd8dd35e16e97682eb86bebccac303ea4c170553de6c0b6f5f246b5f3e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:48 +0000 UTC - event for failed-jobs-history-limit-27891764-4xh2d: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cea362fd0db51d31da4789a2706d5a059806198fefc945936090800f24f39b69": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:45:51 +0000 UTC - event for failed-jobs-history-limit-27891765-xx2rh: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4938874ebc39fbdf1762a294d1e50e2f062c3eebd272828a8fdc3551a16604a8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:00 +0000 UTC - event for failed-jobs-history-limit: {cronjob-controller } SuccessfulCreate: Created job failed-jobs-history-limit-27891766
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:00 +0000 UTC - event for failed-jobs-history-limit-27891766: {job-controller } SuccessfulCreate: Created pod: failed-jobs-history-limit-27891766-gcf9c
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:00 +0000 UTC - event for failed-jobs-history-limit-27891766-gcf9c: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b5d603ce4dab979e2c572e0d4d940f547f63b7f36360d48730d308e15c278efa": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:00 +0000 UTC - event for failed-jobs-history-limit-27891766-gcf9c: {default-scheduler } Scheduled: Successfully assigned cronjob-3444/failed-jobs-history-limit-27891766-gcf9c to i-01ebb116de9e964dc
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:04 +0000 UTC - event for failed-jobs-history-limit-27891764-4xh2d: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "97582c5d8b35f1f725e56be70c720c0291662b62ae46d24123e1f9603a882a5e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:06 +0000 UTC - event for failed-jobs-history-limit-27891765-xx2rh: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f4652c31d344dba05aa858a4e9c936797cf72a10fb3e47be979702bcb0647018": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:14 +0000 UTC - event for failed-jobs-history-limit-27891766-gcf9c: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "92b26edb527036d64227223d42d7c3760fc5b28ba6b8b986a09d9494714e2ea2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:20 +0000 UTC - event for failed-jobs-history-limit-27891765-xx2rh: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9f60aa4d0871f00ed8a587a3a3d3c9c6ab6e717f3d683fe173d655f79dad8f53": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:26 +0000 UTC - event for failed-jobs-history-limit-27891766-gcf9c: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e7cc18eb132673a5e73a02de603d30a99c4d0d3bf37c81f572ca6128454f3901": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:33 +0000 UTC - event for failed-jobs-history-limit-27891765-xx2rh: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a90f002915ca8640c58312c79bedc088f014cf25c001963de79217414607e0dd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:41 +0000 UTC - event for failed-jobs-history-limit-27891766-gcf9c: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5329dd49e6fef68a1601e271f704ac969dd883d70c4e559b3e67531e160bfc03": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:44 +0000 UTC - event for failed-jobs-history-limit-27891765-xx2rh: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8277c1066ebec703ed4f88140579e1ba9a19424a11bac8095c1892d5c9b7637b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:56 +0000 UTC - event for failed-jobs-history-limit-27891766-gcf9c: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7799cea5090a1820f526005026a443f9aaaea569442c14958fe6aeca7c056007": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:46:57 +0000 UTC - event for failed-jobs-history-limit-27891765-xx2rh: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b5f4d64533a281d3ecf60447c82e6a695b1808a1f397a59527613c2a6f06a560": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:47:00 +0000 UTC - event for failed-jobs-history-limit: {cronjob-controller } SuccessfulCreate: Created job failed-jobs-history-limit-27891767
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:47:00 +0000 UTC - event for failed-jobs-history-limit-27891767: {job-controller } SuccessfulCreate: Created pod: failed-jobs-history-limit-27891767-gr299
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:47:00 +0000 UTC - event for failed-jobs-history-limit-27891767-gr299: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "93f00e818c56ab2ff37405141d4f8d31c028493a10a0244961df30aac5fac2c3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:47:00 +0000 UTC - event for failed-jobs-history-limit-27891767-gr299: {default-scheduler } Scheduled: Successfully assigned cronjob-3444/failed-jobs-history-limit-27891767-gr299 to i-01ebb116de9e964dc
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:47:07 +0000 UTC - event for failed-jobs-history-limit-27891766-gcf9c: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f8cbb739d43f40c903ee38704467ad3c0b1031cb77f6e082d00684d5612bc0ef": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:47:14 +0000 UTC - event for failed-jobs-history-limit-27891767-gr299: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2c1f94a37ca5b2cee43a3ed5e98f51385911efbef7dfe4404704375f98f2f498": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.476: INFO: At 2023-01-12 06:47:21 +0000 UTC - event for failed-jobs-history-limit-27891766-gcf9c: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0f3d2ecffda8ba50a46f6d28cd2aafa8ee24a8ec0e09f1107291262c50b6f145": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:47:22.507: INFO: POD                                       NODE                 PHASE    GRACE  CONDITIONS
Jan 12 06:47:22.508: INFO: failed-jobs-history-limit-27891763-zn5tf  i-0b95e3cb438ca1933  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:43:00 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:43:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:43:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:43:00 +0000 UTC  }]
Jan 12 06:47:22.508: INFO: failed-jobs-history-limit-27891764-4xh2d  i-01ebb116de9e964dc  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:44:00 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:44:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:44:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:44:00 +0000 UTC  }]
Jan 12 06:47:22.508: INFO: failed-jobs-history-limit-27891765-xx2rh  i-01ebb116de9e964dc  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:45:00 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:45:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:45:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:45:00 +0000 UTC  }]
Jan 12 06:47:22.508: INFO: failed-jobs-history-limit-27891766-gcf9c  i-01ebb116de9e964dc  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:46:00 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:46:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:46:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:46:00 +0000 UTC  }]
Jan 12 06:47:22.508: INFO: failed-jobs-history-limit-27891767-gr299  i-01ebb116de9e964dc  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:47:00 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:47:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:47:00 +0000 UTC ContainersNotReady containers with unready status: [c]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:47:00 +0000 UTC  }]
Jan 12 06:47:22.508: INFO: 
Jan 12 06:47:22.542: INFO: Unable to fetch cronjob-3444/failed-jobs-history-limit-27891763-zn5tf/c logs: the server rejected our request for an unknown reason (get pods failed-jobs-history-limit-27891763-zn5tf)
Jan 12 06:47:22.577: INFO: Unable to fetch cronjob-3444/failed-jobs-history-limit-27891764-4xh2d/c logs: the server rejected our request for an unknown reason (get pods failed-jobs-history-limit-27891764-4xh2d)
Jan 12 06:47:22.609: INFO: Unable to fetch cronjob-3444/failed-jobs-history-limit-27891765-xx2rh/c logs: the server rejected our request for an unknown reason (get pods failed-jobs-history-limit-27891765-xx2rh)
Jan 12 06:47:22.641: INFO: Unable to fetch cronjob-3444/failed-jobs-history-limit-27891766-gcf9c/c logs: the server rejected our request for an unknown reason (get pods failed-jobs-history-limit-27891766-gcf9c)
Jan 12 06:47:22.674: INFO: Unable to fetch cronjob-3444/failed-jobs-history-limit-27891767-gr299/c logs: the server rejected our request for an unknown reason (get pods failed-jobs-history-limit-27891767-gr299)
Jan 12 06:47:22.707: INFO: 
Logging node info for node i-0029a94fa7f902ab5
Jan 12 06:47:22.739: INFO: Node Info: &Node{ObjectMeta:{i-0029a94fa7f902ab5    086bb9cc-b77b-48db-a8ae-537b7cbf6e36 20026 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0029a94fa7f902ab5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0029a94fa7f902ab5 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.235 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0029a94fa7f902ab5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:43:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0029a94fa7f902ab5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:43:00 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:43:00 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:43:00 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:43:00 +0000 UTC,LastTransitionTime:2023-01-12 06:26:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.235,},NodeAddress{Type:ExternalIP,Address:15.222.254.31,},NodeAddress{Type:InternalDNS,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-254-31.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2680cab44fba5db711d741fbe294e7,SystemUUID:ec2680ca-b44f-ba5d-b711-d741fbe294e7,BootID:01f1463d-4c68-4aa0-8900-0499980b4f60,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:47:22.740: INFO: 
Logging kubelet events for node i-0029a94fa7f902ab5
Jan 12 06:47:22.776: INFO: 
Logging pods the kubelet thinks is on node i-0029a94fa7f902ab5
Jan 12 06:47:22.819: INFO: webserver-7f5969cbc7-9xwfr started at 2023-01-12 06:46:15 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container httpd ready: false, restart count 0
Jan 12 06:47:22.819: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ds9hr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:22.819: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-798lx started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:22.819: INFO: ebs-csi-node-wfgs2 started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:47:22.819: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:47:22.819: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:47:22.819: INFO: pod-subpath-test-preprovisionedpv-kgb2 started at 2023-01-12 06:43:09 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container test-container-subpath-preprovisionedpv-kgb2 ready: false, restart count 0
Jan 12 06:47:22.819: INFO: rs-bxvdw started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container donothing ready: true, restart count 0
Jan 12 06:47:22.819: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4c699 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:22.819: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-jrdnf started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:22.819: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-tm86v started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:22.819: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-krdq2 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:22.819: INFO: coredns-559769c974-p2fts started at 2023-01-12 06:27:03 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:47:22.819: INFO: hostexec-i-0029a94fa7f902ab5-tsxwm started at 2023-01-12 06:45:49 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:47:22.819: INFO: exec-volume-test-preprovisionedpv-x45t started at 2023-01-12 06:46:05 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container exec-container-preprovisionedpv-x45t ready: false, restart count 0
Jan 12 06:47:22.819: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-w5hzb started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:22.819: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-qdh5s started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:22.819: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k5j26 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:22.819: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ccxfb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:22.819: INFO: rs-82mlf started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:47:22.819: INFO: hostexec-i-0029a94fa7f902ab5-bwdb7 started at 2023-01-12 06:42:26 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:47:22.819: INFO: cilium-v2fq9 started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:47:22.819: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:47:22.819: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:47:23.090: INFO: 
Latency metrics for node i-0029a94fa7f902ab5
Jan 12 06:47:23.090: INFO: 
Logging node info for node i-00a1700b2a4dc039f
Jan 12 06:47:23.123: INFO: Node Info: &Node{ObjectMeta:{i-00a1700b2a4dc039f    31b14f9e-702c-4bf4-8b4f-160f1e8d2e78 21874 0 2023-01-12 06:24:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00a1700b2a4dc039f kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.107 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00a1700b2a4dc039f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-12 06:24:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-12 06:25:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:25:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-12 06:47:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00a1700b2a4dc039f,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:06 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:06 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:06 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:47:06 +0000 UTC,LastTransitionTime:2023-01-12 06:25:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.107,},NodeAddress{Type:ExternalIP,Address:99.79.69.225,},NodeAddress{Type:InternalDNS,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-69-225.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2aefdb0e1836236784b773a0de1726,SystemUUID:ec2aefdb-0e18-3623-6784-b773a0de1726,BootID:efa2d6a5-f933-4174-9d1e-f2c2ada73f29,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451206,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42803449,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967343,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:47:23.124: INFO: 
Logging kubelet events for node i-00a1700b2a4dc039f
Jan 12 06:47:23.157: INFO: 
Logging pods the kubelet thinks is on node i-00a1700b2a4dc039f
Jan 12 06:47:23.195: INFO: kops-controller-h6cd7 started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Container kops-controller ready: true, restart count 0
Jan 12 06:47:23.196: INFO: kube-controller-manager-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 12 06:47:23.196: INFO: ebs-csi-node-vtl8h started at 2023-01-12 06:25:04 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:47:23.196: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:47:23.196: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:47:23.196: INFO: ebs-csi-controller-5bd98b456f-s56qb started at 2023-01-12 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:47:23.196: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:47:23.196: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 12 06:47:23.196: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:47:23.196: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:47:23.196: INFO: kube-scheduler-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 12 06:47:23.196: INFO: cilium-f68z5 started at 2023-01-12 06:25:04 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:47:23.196: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:47:23.196: INFO: dns-controller-69987775c6-n2lqn started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Container dns-controller ready: true, restart count 0
Jan 12 06:47:23.196: INFO: cilium-operator-5dd44dc49f-zvdwf started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 12 06:47:23.196: INFO: aws-cloud-controller-manager-vj4cr started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 12 06:47:23.196: INFO: etcd-manager-events-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:47:23.196: INFO: etcd-manager-main-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:47:23.196: INFO: kube-apiserver-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:47:23.196: INFO: 	Container healthcheck ready: true, restart count 0
Jan 12 06:47:23.196: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 12 06:47:23.358: INFO: 
Latency metrics for node i-00a1700b2a4dc039f
Jan 12 06:47:23.358: INFO: 
Logging node info for node i-01ebb116de9e964dc
Jan 12 06:47:23.390: INFO: Node Info: &Node{ObjectMeta:{i-01ebb116de9e964dc    9bba0dc4-469e-4f38-b41b-aa672131ad87 21645 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01ebb116de9e964dc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01ebb116de9e964dc topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.44 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01ebb116de9e964dc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:46:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01ebb116de9e964dc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:46:33 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:46:33 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:46:33 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:46:33 +0000 UTC,LastTransitionTime:2023-01-12 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.44,},NodeAddress{Type:ExternalIP,Address:3.99.142.186,},NodeAddress{Type:InternalDNS,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-142-186.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec264bf9915ff9f6f2894d5911a8df83,SystemUUID:ec264bf9-915f-f9f6-f289-4d5911a8df83,BootID:00d4d8a1-d87c-4c57-bee6-69bb72398b91,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:47:23.390: INFO: 
Logging kubelet events for node i-01ebb116de9e964dc
Jan 12 06:47:23.424: INFO: 
Logging pods the kubelet thinks is on node i-01ebb116de9e964dc
Jan 12 06:47:23.474: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-5pqpn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.474: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-nwxqm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.474: INFO: rs-7sf6x started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:47:23.474: INFO: busybox1 started at 2023-01-12 06:43:07 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container busybox ready: false, restart count 0
Jan 12 06:47:23.474: INFO: fail-once-local-mv5qs started at 2023-01-12 06:46:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.474: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-js9bn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.474: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-q9c9s started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.474: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-9j6sw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.474: INFO: failed-jobs-history-limit-27891765-xx2rh started at 2023-01-12 06:45:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.474: INFO: rs-867mv started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container donothing ready: true, restart count 0
Jan 12 06:47:23.474: INFO: fail-once-local-htmdf started at 2023-01-12 06:46:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.474: INFO: failed-jobs-history-limit-27891767-gr299 started at 2023-01-12 06:47:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.474: INFO: failed-jobs-history-limit-27891764-4xh2d started at 2023-01-12 06:44:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.474: INFO: failed-jobs-history-limit-27891766-gcf9c started at 2023-01-12 06:46:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.474: INFO: rand-non-local-gzghw started at 2023-01-12 06:35:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.474: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bvnhn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.474: INFO: webserver-pod started at 2023-01-12 06:46:22 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container agnhost ready: false, restart count 0
Jan 12 06:47:23.474: INFO: termination-message-container7b894dd6-f82b-4520-9a82-ad0d900c7699 started at 2023-01-12 06:46:10 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container termination-message-container ready: false, restart count 0
Jan 12 06:47:23.474: INFO: ebs-csi-node-bvknd started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:47:23.474: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:47:23.474: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:47:23.474: INFO: rs-5hrnk started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container donothing ready: true, restart count 0
Jan 12 06:47:23.474: INFO: webserver-6d4b8f66f8-gmhds started at 2023-01-12 06:46:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container httpd ready: false, restart count 0
Jan 12 06:47:23.474: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kfdmq started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.474: INFO: rand-non-local-flpwd started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.474: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-97p2z started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.474: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-mfrbf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.474: INFO: cilium-b5cfc started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:47:23.474: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:47:23.474: INFO: ss2-1 started at 2023-01-12 06:43:20 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container webserver ready: false, restart count 0
Jan 12 06:47:23.474: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-z8qq5 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.474: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.719: INFO: 
Latency metrics for node i-01ebb116de9e964dc
Jan 12 06:47:23.719: INFO: 
Logging node info for node i-0b95e3cb438ca1933
Jan 12 06:47:23.751: INFO: Node Info: &Node{ObjectMeta:{i-0b95e3cb438ca1933    410c9a77-76a5-49fd-81d8-dcf127193ecf 21927 0 2023-01-12 06:26:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b95e3cb438ca1933 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0b95e3cb438ca1933 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.177 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9408":"i-0b95e3cb438ca1933","csi-mock-csi-mock-volumes-6423":"i-0b95e3cb438ca1933","ebs.csi.aws.com":"i-0b95e3cb438ca1933"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:47:18 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-12 06:47:18 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0b95e3cb438ca1933,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:18 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:18 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:18 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:47:18 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.177,},NodeAddress{Type:ExternalIP,Address:99.79.51.51,},NodeAddress{Type:InternalDNS,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-51-51.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23cc76a58199e94cb916e26a0dbdd4,SystemUUID:ec23cc76-a581-99e9-4cb9-16e26a0dbdd4,BootID:769bca70-45b1-4d4c-82b2-ff7e3a4f99ff,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-9408^4b703937-9244-11ed-90ee-5a4921a595cd kubernetes.io/csi/ebs.csi.aws.com^vol-05ecc12fc3c9108e9],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-028193f16d96bc435,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05ecc12fc3c9108e9,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-9408^4b703937-9244-11ed-90ee-5a4921a595cd,DevicePath:,},},Config:nil,},}
Jan 12 06:47:23.753: INFO: 
Logging kubelet events for node i-0b95e3cb438ca1933
Jan 12 06:47:23.786: INFO: 
Logging pods the kubelet thinks is on node i-0b95e3cb438ca1933
Jan 12 06:47:23.835: INFO: hostexec-i-0b95e3cb438ca1933-khpg6 started at 2023-01-12 06:43:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:47:23.835: INFO: csi-mockplugin-attacher-0 started at 2023-01-12 06:38:21 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:47:23.835: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-2j6p9 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.835: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b6bbr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.835: INFO: pod-9b3963d4-4868-4645-b6f8-b227e904776f started at 2023-01-12 06:46:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container write-pod ready: false, restart count 0
Jan 12 06:47:23.835: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4sqlp started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:47:23.835: INFO: fail-once-non-local-l62nm started at 2023-01-12 06:35:21 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.835: INFO: ss2-0 started at 2023-01-12 06:42:09 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container webserver ready: true, restart count 0
Jan 12 06:47:23.835: INFO: proxy-service-867gl-qt6l8 started at 2023-01-12 06:44:46 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container proxy-service-867gl ready: false, restart count 0
Jan 12 06:47:23.835: INFO: fail-once-non-local-w64vm started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.835: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dqrr9 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.835: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-gtbjw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.835: INFO: pod-153238b0-9e98-4ea6-89af-a4d97bf91a29 started at 2023-01-12 06:43:16 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container write-pod ready: false, restart count 0
Jan 12 06:47:23.835: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:41:01 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:47:23.835: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:47:23.835: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 12 06:47:23.835: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 12 06:47:23.835: INFO: 	Container hostpath ready: true, restart count 0
Jan 12 06:47:23.835: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:47:23.835: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:47:23.835: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-wnxfm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:47:23.835: INFO: pod-d667ea05-9b07-48b9-add3-bf00899c0b3a started at 2023-01-12 06:46:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container write-pod ready: false, restart count 0
Jan 12 06:47:23.835: INFO: rs-j5p6n started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:47:23.835: INFO: rs-kdm5p started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:47:23.835: INFO: failed-jobs-history-limit-27891763-zn5tf started at 2023-01-12 06:43:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.835: INFO: ebs-csi-node-x6qtj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:47:23.835: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:47:23.835: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:47:23.835: INFO: csi-mockplugin-0 started at 2023-01-12 06:38:21 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:47:23.835: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 12 06:47:23.835: INFO: 	Container mock ready: true, restart count 0
Jan 12 06:47:23.835: INFO: pod-subpath-test-preprovisionedpv-zlls started at 2023-01-12 06:43:49 +0000 UTC (2+2 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Init container init-volume-preprovisionedpv-zlls ready: false, restart count 0
Jan 12 06:47:23.835: INFO: 	Init container test-init-subpath-preprovisionedpv-zlls ready: false, restart count 0
Jan 12 06:47:23.835: INFO: 	Container test-container-subpath-preprovisionedpv-zlls ready: false, restart count 0
Jan 12 06:47:23.835: INFO: 	Container test-container-volume-preprovisionedpv-zlls ready: false, restart count 0
Jan 12 06:47:23.835: INFO: pod-update-activedeadlineseconds-84c26f00-3af0-4d49-a6c1-0b2ec9b0dd8d started at 2023-01-12 06:46:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container pause ready: false, restart count 0
Jan 12 06:47:23.835: INFO: webserver-6d4b8f66f8-hx7ws started at 2023-01-12 06:46:23 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container httpd ready: false, restart count 0
Jan 12 06:47:23.835: INFO: pod-subpath-test-dynamicpv-csdk started at 2023-01-12 06:46:14 +0000 UTC (2+2 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Init container init-volume-dynamicpv-csdk ready: false, restart count 0
Jan 12 06:47:23.835: INFO: 	Init container test-init-subpath-dynamicpv-csdk ready: false, restart count 0
Jan 12 06:47:23.835: INFO: 	Container test-container-subpath-dynamicpv-csdk ready: false, restart count 0
Jan 12 06:47:23.835: INFO: 	Container test-container-volume-dynamicpv-csdk ready: false, restart count 0
Jan 12 06:47:23.835: INFO: hostexec-i-0b95e3cb438ca1933-prc4l started at 2023-01-12 06:43:42 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:47:23.835: INFO: inline-volume-tester-xjgl9 started at 2023-01-12 06:42:34 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 12 06:47:23.835: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vp5q6 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.835: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k9rkg started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.835: INFO: cilium-l6rqm started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:47:23.835: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:47:23.835: INFO: fail-once-non-local-vcv58 started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.835: INFO: pod-configmaps-6be46a5b-d62c-41d0-ae96-d36b55b76a82 started at 2023-01-12 06:46:47 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container env-test ready: false, restart count 0
Jan 12 06:47:23.835: INFO: webserver-778cd87d5b-cxrc7 started at 2023-01-12 06:46:52 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container httpd ready: false, restart count 0
Jan 12 06:47:23.835: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-27f6c started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.835: INFO: fail-once-non-local-p94zd started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.835: INFO: fail-once-non-local-h8qrp started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container c ready: false, restart count 0
Jan 12 06:47:23.835: INFO: hostexec-i-0b95e3cb438ca1933-m2cm7 started at 2023-01-12 06:46:34 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:47:23.835: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-7xqlb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:23.835: INFO: rs-qh54h started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:23.835: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:47:24.074: INFO: 
Latency metrics for node i-0b95e3cb438ca1933
Jan 12 06:47:24.074: INFO: 
Logging node info for node i-0bcea138229cdd410
Jan 12 06:47:24.106: INFO: Node Info: &Node{ObjectMeta:{i-0bcea138229cdd410    95f2bbd5-be1b-44e9-a59a-66f87015f9d2 20790 0 2023-01-12 06:26:24 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bcea138229cdd410 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0bcea138229cdd410 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.32.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bcea138229cdd410"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:45:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0bcea138229cdd410,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:45:40 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:45:40 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:45:40 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:45:40 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.32.113,},NodeAddress{Type:ExternalIP,Address:35.182.71.1,},NodeAddress{Type:InternalDNS,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-71-1.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21ffd1efd1b61b9def5afc88b88dba,SystemUUID:ec21ffd1-efd1-b61b-9def-5afc88b88dba,BootID:65b83838-2717-4c2d-8957-6fdcb4152c24,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:47:24.108: INFO: 
Logging kubelet events for node i-0bcea138229cdd410
Jan 12 06:47:24.141: INFO: 
Logging pods the kubelet thinks is on node i-0bcea138229cdd410
Jan 12 06:47:24.178: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bg28w started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:24.178: INFO: csi-mockplugin-0 started at 2023-01-12 06:46:19 +0000 UTC (0+4 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container busybox ready: false, restart count 0
Jan 12 06:47:24.178: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:47:24.178: INFO: 	Container driver-registrar ready: false, restart count 0
Jan 12 06:47:24.178: INFO: 	Container mock ready: false, restart count 0
Jan 12 06:47:24.178: INFO: coredns-559769c974-z5pf2 started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:47:24.178: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:43:00 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 12 06:47:24.178: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:47:24.178: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 12 06:47:24.178: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 12 06:47:24.178: INFO: 	Container hostpath ready: false, restart count 0
Jan 12 06:47:24.178: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 12 06:47:24.178: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 12 06:47:24.178: INFO: rs-rbvm4 started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:47:24.178: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-h6kb8 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:24.178: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-8zhgf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:24.178: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6blc8 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:24.178: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vxhrc started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:24.178: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6ngxj started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:24.178: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kd57q started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:24.178: INFO: ebs-csi-node-g2mwj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:47:24.178: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:47:24.178: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:47:24.178: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b9cmz started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:24.178: INFO: rs-x4kpg started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:47:24.178: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dxzmh started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:24.178: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6p5qk started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:47:24.178: INFO: cilium-q5hq4 started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:47:24.178: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:47:24.178: INFO: coredns-autoscaler-7cb5c5b969-lzjqb started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:47:24.178: INFO: 	Container autoscaler ready: true, restart count 0
Jan 12 06:47:24.358: INFO: 
Latency metrics for node i-0bcea138229cdd410
[DeferCleanup (Each)] [sig-apps] CronJob
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "cronjob-3444" for this suite. �[38;5;243m01/12/23 06:47:24.359�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-apps] Deployment should not disrupt a cloud load-balancer's connectivity during rollout 8m8s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sDeployment\sshould\snot\sdisrupt\sa\scloud\sload\-balancer\'s\sconnectivity\sduring\srollout$'

test/e2e/apps/deployment.go:1435
k8s.io/kubernetes/test/e2e/apps.testRollingUpdateDeploymentWithLocalTrafficLoadBalancer(0x801e128?)
	test/e2e/apps/deployment.go:1435 +0xc7f
k8s.io/kubernetes/test/e2e/apps.glob..func5.12()
	test/e2e/apps/deployment.go:169 +0x118
				[BeforeEach] [sig-apps] Deployment
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/12/23 06:35:04.684�[0m
Jan 12 06:35:04.684: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename deployment �[38;5;243m01/12/23 06:35:04.685�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/12/23 06:35:04.78�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/12/23 06:35:04.842�[0m
[BeforeEach] [sig-apps] Deployment
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] Deployment
  test/e2e/apps/deployment.go:91
[It] should not disrupt a cloud load-balancer's connectivity during rollout
  test/e2e/apps/deployment.go:163
Jan 12 06:35:04.935: INFO: Creating Deployment "test-rolling-update-with-lb"
Jan 12 06:35:05.010: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:0, UpdatedReplicas:0, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"NewReplicaSetCreated", Message:"Created new replica set \"test-rolling-update-with-lb-56d9b65d4c\""}, v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:35:07.042: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:0, AvailableReplicas:0, UnavailableReplicas:3, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 5, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:35:09.041: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 7, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:35:11.041: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 7, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:35:13.047: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 7, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:35:15.041: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 7, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:35:17.041: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:1, AvailableReplicas:1, UnavailableReplicas:2, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 7, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:35:19.043: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:1, Replicas:3, UpdatedReplicas:3, ReadyReplicas:2, AvailableReplicas:2, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"False", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"MinimumReplicasUnavailable", Message:"Deployment does not have minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 17, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-56d9b65d4c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:35:21.041: INFO: Creating a service test-rolling-update-with-lb with type=LoadBalancer and externalTrafficPolicy=Local in namespace deployment-8113
�[1mSTEP:�[0m creating a service deployment-8113/test-rolling-update-with-lb with type=LoadBalancer �[38;5;243m01/12/23 06:35:21.074�[0m
�[1mSTEP:�[0m waiting for loadbalancer for service deployment-8113/test-rolling-update-with-lb �[38;5;243m01/12/23 06:35:21.114�[0m
Jan 12 06:35:21.114: INFO: Waiting up to 15m0s for service "test-rolling-update-with-lb" to have a LoadBalancer
Jan 12 06:38:01.181: INFO: Hitting the replica set's pods through the service's load balancer
Jan 12 06:38:01.181: INFO: Poking "http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"
Jan 12 06:38:01.291: INFO: Poke("http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"): Get "http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello": EOF
Jan 12 06:38:03.292: INFO: Poking "http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"
Jan 12 06:38:03.384: INFO: Poke("http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"): Get "http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello": EOF
Jan 12 06:38:05.292: INFO: Poking "http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"
Jan 12 06:38:05.382: INFO: Poke("http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"): Get "http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello": EOF
Jan 12 06:38:07.291: INFO: Poking "http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"
Jan 12 06:38:07.388: INFO: Poke("http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"): Get "http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello": EOF
Jan 12 06:38:09.292: INFO: Poking "http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"
Jan 12 06:38:09.387: INFO: Poke("http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"): Get "http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello": EOF
Jan 12 06:38:11.292: INFO: Poking "http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"
Jan 12 06:38:11.370: INFO: Poke("http://a4c054311646146f593748a6a7569763-207504530.ca-central-1.elb.amazonaws.com:80/echo?msg=hello"): success
Jan 12 06:38:11.370: INFO: Starting a goroutine to watch the service's endpoints in the background
Jan 12 06:38:11.370: INFO: Triggering a rolling deployment several times
Jan 12 06:38:11.370: INFO: Updating label deployment "test-rolling-update-with-lb" pod spec (iteration #1)
Jan 12 06:38:11.435: INFO: Updating deployment test-rolling-update-with-lb
Jan 12 06:38:11.435: INFO: Waiting for observed generation 2
Jan 12 06:38:11.469: INFO: Make sure deployment "test-rolling-update-with-lb" is complete
Jan 12 06:38:11.531: INFO: 
Jan 12 06:38:11.531: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:13.595: INFO: 
Jan 12 06:38:13.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:15.595: INFO: 
Jan 12 06:38:15.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:17.594: INFO: 
Jan 12 06:38:17.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:19.595: INFO: 
Jan 12 06:38:19.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:21.595: INFO: 
Jan 12 06:38:21.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:23.595: INFO: 
Jan 12 06:38:23.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:25.595: INFO: 
Jan 12 06:38:25.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:27.595: INFO: 
Jan 12 06:38:27.596: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:29.595: INFO: 
Jan 12 06:38:29.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:31.595: INFO: 
Jan 12 06:38:31.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:33.596: INFO: 
Jan 12 06:38:33.596: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:35.595: INFO: 
Jan 12 06:38:35.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:37.595: INFO: 
Jan 12 06:38:37.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:39.595: INFO: 
Jan 12 06:38:39.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:41.595: INFO: 
Jan 12 06:38:41.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:43.595: INFO: 
Jan 12 06:38:43.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:45.595: INFO: 
Jan 12 06:38:45.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:47.594: INFO: 
Jan 12 06:38:47.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:49.595: INFO: 
Jan 12 06:38:49.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:51.595: INFO: 
Jan 12 06:38:51.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:53.595: INFO: 
Jan 12 06:38:53.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:55.595: INFO: 
Jan 12 06:38:55.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:57.594: INFO: 
Jan 12 06:38:57.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:38:59.594: INFO: 
Jan 12 06:38:59.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:01.595: INFO: 
Jan 12 06:39:01.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:03.595: INFO: 
Jan 12 06:39:03.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:05.595: INFO: 
Jan 12 06:39:05.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:07.595: INFO: 
Jan 12 06:39:07.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:09.596: INFO: 
Jan 12 06:39:09.596: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:11.594: INFO: 
Jan 12 06:39:11.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:13.595: INFO: 
Jan 12 06:39:13.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:15.594: INFO: 
Jan 12 06:39:15.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:17.595: INFO: 
Jan 12 06:39:17.596: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:19.595: INFO: 
Jan 12 06:39:19.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:21.595: INFO: 
Jan 12 06:39:21.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:23.595: INFO: 
Jan 12 06:39:23.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:25.595: INFO: 
Jan 12 06:39:25.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:27.595: INFO: 
Jan 12 06:39:27.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:29.595: INFO: 
Jan 12 06:39:29.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:31.594: INFO: 
Jan 12 06:39:31.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:33.595: INFO: 
Jan 12 06:39:33.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:35.594: INFO: 
Jan 12 06:39:35.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:37.597: INFO: 
Jan 12 06:39:37.597: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:39.595: INFO: 
Jan 12 06:39:39.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:41.594: INFO: 
Jan 12 06:39:41.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:43.595: INFO: 
Jan 12 06:39:43.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:45.595: INFO: 
Jan 12 06:39:45.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:47.595: INFO: 
Jan 12 06:39:47.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:49.595: INFO: 
Jan 12 06:39:49.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:51.595: INFO: 
Jan 12 06:39:51.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:53.594: INFO: 
Jan 12 06:39:53.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:55.595: INFO: 
Jan 12 06:39:55.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:57.595: INFO: 
Jan 12 06:39:57.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:39:59.595: INFO: 
Jan 12 06:39:59.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:01.595: INFO: 
Jan 12 06:40:01.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:03.595: INFO: 
Jan 12 06:40:03.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:05.594: INFO: 
Jan 12 06:40:05.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:07.594: INFO: 
Jan 12 06:40:07.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:09.595: INFO: 
Jan 12 06:40:09.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:11.594: INFO: 
Jan 12 06:40:11.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:13.595: INFO: 
Jan 12 06:40:13.596: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:15.599: INFO: 
Jan 12 06:40:15.599: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:17.595: INFO: 
Jan 12 06:40:17.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:19.595: INFO: 
Jan 12 06:40:19.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:21.595: INFO: 
Jan 12 06:40:21.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:23.595: INFO: 
Jan 12 06:40:23.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:25.594: INFO: 
Jan 12 06:40:25.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:27.594: INFO: 
Jan 12 06:40:27.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:29.595: INFO: 
Jan 12 06:40:29.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:31.595: INFO: 
Jan 12 06:40:31.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:33.594: INFO: 
Jan 12 06:40:33.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:35.594: INFO: 
Jan 12 06:40:35.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:37.595: INFO: 
Jan 12 06:40:37.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:39.595: INFO: 
Jan 12 06:40:39.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:41.595: INFO: 
Jan 12 06:40:41.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:43.594: INFO: 
Jan 12 06:40:43.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:45.595: INFO: 
Jan 12 06:40:45.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:47.594: INFO: 
Jan 12 06:40:47.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:49.594: INFO: 
Jan 12 06:40:49.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:51.597: INFO: 
Jan 12 06:40:51.597: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:53.594: INFO: 
Jan 12 06:40:53.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:55.598: INFO: 
Jan 12 06:40:55.598: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:57.606: INFO: 
Jan 12 06:40:57.606: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:40:59.594: INFO: 
Jan 12 06:40:59.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:01.594: INFO: 
Jan 12 06:41:01.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:03.595: INFO: 
Jan 12 06:41:03.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:05.596: INFO: 
Jan 12 06:41:05.596: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:07.594: INFO: 
Jan 12 06:41:07.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:09.595: INFO: 
Jan 12 06:41:09.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:11.594: INFO: 
Jan 12 06:41:11.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:13.594: INFO: 
Jan 12 06:41:13.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:15.595: INFO: 
Jan 12 06:41:15.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:17.595: INFO: 
Jan 12 06:41:17.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:19.595: INFO: 
Jan 12 06:41:19.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:21.595: INFO: 
Jan 12 06:41:21.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:23.594: INFO: 
Jan 12 06:41:23.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:25.595: INFO: 
Jan 12 06:41:25.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:1, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 38, 11, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:27.595: INFO: 
Jan 12 06:41:27.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:29.595: INFO: 
Jan 12 06:41:29.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:31.594: INFO: 
Jan 12 06:41:31.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:33.594: INFO: 
Jan 12 06:41:33.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:35.595: INFO: 
Jan 12 06:41:35.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:37.594: INFO: 
Jan 12 06:41:37.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:39.595: INFO: 
Jan 12 06:41:39.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:41.594: INFO: 
Jan 12 06:41:41.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:43.595: INFO: 
Jan 12 06:41:43.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:45.595: INFO: 
Jan 12 06:41:45.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:47.595: INFO: 
Jan 12 06:41:47.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:49.594: INFO: 
Jan 12 06:41:49.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:51.595: INFO: 
Jan 12 06:41:51.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:53.595: INFO: 
Jan 12 06:41:53.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:55.594: INFO: 
Jan 12 06:41:55.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:57.594: INFO: 
Jan 12 06:41:57.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:41:59.595: INFO: 
Jan 12 06:41:59.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:01.595: INFO: 
Jan 12 06:42:01.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:03.594: INFO: 
Jan 12 06:42:03.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:05.595: INFO: 
Jan 12 06:42:05.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:07.595: INFO: 
Jan 12 06:42:07.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:09.594: INFO: 
Jan 12 06:42:09.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:11.595: INFO: 
Jan 12 06:42:11.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:13.595: INFO: 
Jan 12 06:42:13.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:15.594: INFO: 
Jan 12 06:42:15.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:17.595: INFO: 
Jan 12 06:42:17.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:19.595: INFO: 
Jan 12 06:42:19.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:21.595: INFO: 
Jan 12 06:42:21.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:23.594: INFO: 
Jan 12 06:42:23.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:25.594: INFO: 
Jan 12 06:42:25.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:27.596: INFO: 
Jan 12 06:42:27.596: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:29.594: INFO: 
Jan 12 06:42:29.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:31.595: INFO: 
Jan 12 06:42:31.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:33.596: INFO: 
Jan 12 06:42:33.596: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:35.595: INFO: 
Jan 12 06:42:35.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:37.595: INFO: 
Jan 12 06:42:37.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:39.595: INFO: 
Jan 12 06:42:39.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:41.594: INFO: 
Jan 12 06:42:41.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:43.594: INFO: 
Jan 12 06:42:43.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:45.595: INFO: 
Jan 12 06:42:45.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:47.596: INFO: 
Jan 12 06:42:47.596: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:49.599: INFO: 
Jan 12 06:42:49.599: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:51.596: INFO: 
Jan 12 06:42:51.596: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:53.594: INFO: 
Jan 12 06:42:53.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:55.594: INFO: 
Jan 12 06:42:55.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:57.594: INFO: 
Jan 12 06:42:57.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:42:59.594: INFO: 
Jan 12 06:42:59.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:43:01.594: INFO: 
Jan 12 06:43:01.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:43:03.595: INFO: 
Jan 12 06:43:03.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:43:05.595: INFO: 
Jan 12 06:43:05.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:43:07.595: INFO: 
Jan 12 06:43:07.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:43:09.595: INFO: 
Jan 12 06:43:09.595: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:43:11.594: INFO: 
Jan 12 06:43:11.594: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:43:11.657: INFO: 
Jan 12 06:43:11.657: INFO: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}
Jan 12 06:43:11.657: INFO: Unexpected error: 
    <*errors.errorString | 0xc0010a66e0>: {
        s: "error waiting for deployment \"test-rolling-update-with-lb\" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:\"Available\", Status:\"True\", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:\"MinimumReplicasAvailable\", Message:\"Deployment has minimum availability.\"}, v1.DeploymentCondition{Type:\"Progressing\", Status:\"True\", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:\"ReplicaSetUpdated\", Message:\"ReplicaSet \\\"test-rolling-update-with-lb-85b8b59c8c\\\" is progressing.\"}}, CollisionCount:(*int32)(nil)}",
    }
Jan 12 06:43:11.657: FAIL: error waiting for deployment "test-rolling-update-with-lb" status to match expectation: deployment status: v1.DeploymentStatus{ObservedGeneration:2, Replicas:4, UpdatedReplicas:2, ReadyReplicas:3, AvailableReplicas:3, UnavailableReplicas:1, Conditions:[]v1.DeploymentCondition{v1.DeploymentCondition{Type:"Available", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 19, 0, time.Local), Reason:"MinimumReplicasAvailable", Message:"Deployment has minimum availability."}, v1.DeploymentCondition{Type:"Progressing", Status:"True", LastUpdateTime:time.Date(2023, time.January, 12, 6, 41, 27, 0, time.Local), LastTransitionTime:time.Date(2023, time.January, 12, 6, 35, 4, 0, time.Local), Reason:"ReplicaSetUpdated", Message:"ReplicaSet \"test-rolling-update-with-lb-85b8b59c8c\" is progressing."}}, CollisionCount:(*int32)(nil)}

Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.testRollingUpdateDeploymentWithLocalTrafficLoadBalancer(0x801e128?)
	test/e2e/apps/deployment.go:1435 +0xc7f
k8s.io/kubernetes/test/e2e/apps.glob..func5.12()
	test/e2e/apps/deployment.go:169 +0x118
[AfterEach] [sig-apps] Deployment
  test/e2e/apps/deployment.go:84
Jan 12 06:43:11.689: INFO: Deployment "test-rolling-update-with-lb":
&Deployment{ObjectMeta:{test-rolling-update-with-lb  deployment-8113  6132f87f-0461-48fd-b7f4-155bb64c4c57 19157 2 2023-01-12 06:35:04 +0000 UTC <nil> <nil> map[name:test-rolling-update-with-lb] map[deployment.kubernetes.io/revision:2] [] [] [{e2e.test Update apps/v1 2023-01-12 06:38:11 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{".":{},"f:name":{}}},"f:spec":{"f:progressDeadlineSeconds":{},"f:replicas":{},"f:revisionHistoryLimit":{},"f:selector":{},"f:strategy":{"f:rollingUpdate":{".":{},"f:maxSurge":{},"f:maxUnavailable":{}},"f:type":{}},"f:template":{"f:metadata":{"f:labels":{".":{},"f:iteration":{},"f:name":{}}},"f:spec":{"f:affinity":{".":{},"f:podAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-12 06:41:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/revision":{}}},"f:status":{"f:availableReplicas":{},"f:conditions":{".":{},"k:{\"type\":\"Available\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Progressing\"}":{".":{},"f:lastTransitionTime":{},"f:lastUpdateTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{},"f:unavailableReplicas":{},"f:updatedReplicas":{}}} status}]},Spec:DeploymentSpec{Replicas:*3,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: test-rolling-update-with-lb,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[iteration:1 name:test-rolling-update-with-lb] map[] [] [] []} {[] [] [{agnhost registry.k8s.io/e2e-test-images/agnhost:2.43 [] [netexec --http-port=80 --udp-port=80]  [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00095c6a8 <nil> ClusterFirst map[]   <nil>  false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} []   &Affinity{NodeAffinity:nil,PodAffinity:&PodAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:NotIn,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},} default-scheduler [] []  <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},Strategy:DeploymentStrategy{Type:RollingUpdate,RollingUpdate:&RollingUpdateDeployment{MaxUnavailable:0,MaxSurge:1,},},MinReadySeconds:0,RevisionHistoryLimit:*10,Paused:false,ProgressDeadlineSeconds:*600,},Status:DeploymentStatus{ObservedGeneration:2,Replicas:4,UpdatedReplicas:2,AvailableReplicas:3,UnavailableReplicas:1,Conditions:[]DeploymentCondition{DeploymentCondition{Type:Available,Status:True,Reason:MinimumReplicasAvailable,Message:Deployment has minimum availability.,LastUpdateTime:2023-01-12 06:35:19 +0000 UTC,LastTransitionTime:2023-01-12 06:35:19 +0000 UTC,},DeploymentCondition{Type:Progressing,Status:True,Reason:ReplicaSetUpdated,Message:ReplicaSet "test-rolling-update-with-lb-85b8b59c8c" is progressing.,LastUpdateTime:2023-01-12 06:41:27 +0000 UTC,LastTransitionTime:2023-01-12 06:35:04 +0000 UTC,},},ReadyReplicas:3,CollisionCount:nil,},}

Jan 12 06:43:11.721: INFO: New ReplicaSet "test-rolling-update-with-lb-85b8b59c8c" of Deployment "test-rolling-update-with-lb":
&ReplicaSet{ObjectMeta:{test-rolling-update-with-lb-85b8b59c8c  deployment-8113  fcb0c25e-10ce-4ed6-a6c9-4448b8de4b7f 19156 2 2023-01-12 06:38:11 +0000 UTC <nil> <nil> map[iteration:1 name:test-rolling-update-with-lb pod-template-hash:85b8b59c8c] map[deployment.kubernetes.io/desired-replicas:3 deployment.kubernetes.io/max-replicas:4 deployment.kubernetes.io/revision:2] [{apps/v1 Deployment test-rolling-update-with-lb 6132f87f-0461-48fd-b7f4-155bb64c4c57 0xc00095cef7 0xc00095cef8}] [] [{kube-controller-manager Update apps/v1 2023-01-12 06:41:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"6132f87f-0461-48fd-b7f4-155bb64c4c57\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:affinity":{".":{},"f:podAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-12 06:41:27 +0000 UTC FieldsV1 {"f:status":{"f:availableReplicas":{},"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*2,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: test-rolling-update-with-lb,pod-template-hash: 85b8b59c8c,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[iteration:1 name:test-rolling-update-with-lb pod-template-hash:85b8b59c8c] map[] [] [] []} {[] [] [{agnhost registry.k8s.io/e2e-test-images/agnhost:2.43 [] [netexec --http-port=80 --udp-port=80]  [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00095cfb8 <nil> ClusterFirst map[]   <nil>  false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} []   &Affinity{NodeAffinity:nil,PodAffinity:&PodAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:NotIn,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},} default-scheduler [] []  <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:2,FullyLabeledReplicas:2,ObservedGeneration:2,ReadyReplicas:1,AvailableReplicas:1,Conditions:[]ReplicaSetCondition{},},}
Jan 12 06:43:11.721: INFO: All old ReplicaSets of Deployment "test-rolling-update-with-lb":
Jan 12 06:43:11.721: INFO: &ReplicaSet{ObjectMeta:{test-rolling-update-with-lb-56d9b65d4c  deployment-8113  d8024d48-c2c7-4024-8150-8c181353cd25 19148 2 2023-01-12 06:35:04 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:56d9b65d4c] map[deployment.kubernetes.io/desired-replicas:3 deployment.kubernetes.io/max-replicas:4 deployment.kubernetes.io/revision:1] [{apps/v1 Deployment test-rolling-update-with-lb 6132f87f-0461-48fd-b7f4-155bb64c4c57 0xc00095ccf7 0xc00095ccf8}] [] [{kube-controller-manager Update apps/v1 2023-01-12 06:41:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:deployment.kubernetes.io/desired-replicas":{},"f:deployment.kubernetes.io/max-replicas":{},"f:deployment.kubernetes.io/revision":{}},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"6132f87f-0461-48fd-b7f4-155bb64c4c57\"}":{}}},"f:spec":{"f:replicas":{},"f:selector":{},"f:template":{"f:metadata":{"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}}}} } {kube-controller-manager Update apps/v1 2023-01-12 06:41:27 +0000 UTC FieldsV1 {"f:status":{"f:availableReplicas":{},"f:fullyLabeledReplicas":{},"f:observedGeneration":{},"f:readyReplicas":{},"f:replicas":{}}} status}]},Spec:ReplicaSetSpec{Replicas:*2,Selector:&v1.LabelSelector{MatchLabels:map[string]string{name: test-rolling-update-with-lb,pod-template-hash: 56d9b65d4c,},MatchExpressions:[]LabelSelectorRequirement{},},Template:{{      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:56d9b65d4c] map[] [] [] []} {[] [] [{agnhost registry.k8s.io/e2e-test-images/agnhost:2.43 [] [netexec --http-port=80 --udp-port=80]  [] [] [] {map[] map[] []} [] [] nil nil nil nil /dev/termination-log File IfNotPresent SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,} false false false}] [] Always 0xc00095cdc8 <nil> ClusterFirst map[]   <nil>  false false false <nil> &PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,} []   &Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},} default-scheduler [] []  <nil> nil [] <nil> <nil> <nil> map[] [] <nil> nil <nil> [] []}},MinReadySeconds:0,},Status:ReplicaSetStatus{Replicas:2,FullyLabeledReplicas:2,ObservedGeneration:2,ReadyReplicas:2,AvailableReplicas:2,Conditions:[]ReplicaSetCondition{},},}
Jan 12 06:43:11.752: INFO: Pod "test-rolling-update-with-lb-56d9b65d4c-cgjx2" is available:
&Pod{ObjectMeta:{test-rolling-update-with-lb-56d9b65d4c-cgjx2 test-rolling-update-with-lb-56d9b65d4c- deployment-8113  35d41269-1847-4b6a-b2c9-236ada808309 15154 0 2023-01-12 06:35:04 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:56d9b65d4c] map[] [{apps/v1 ReplicaSet test-rolling-update-with-lb-56d9b65d4c d8024d48-c2c7-4024-8150-8c181353cd25 0xc0016f4fc7 0xc0016f4fc8}] [] [{kube-controller-manager Update v1 2023-01-12 06:35:04 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d8024d48-c2c7-4024-8150-8c181353cd25\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-12 06:35:07 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.56.41\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-2779p,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,Command:[],Args:[netexec --http-port=80 --udp-port=80],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-2779p,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-0029a94fa7f902ab5,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:&Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},},SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:35:04 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:35:07 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:35:07 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:35:04 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.48.235,PodIP:172.20.56.41,StartTime:2023-01-12 06:35:04 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-12 06:35:07 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,ImageID:registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e,ContainerID:containerd://42306268e44246c9c55408c1ae49301eedb0c503eb14de5b6d1efacd5ea35aa6,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.56.41,},},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 12 06:43:11.753: INFO: Pod "test-rolling-update-with-lb-56d9b65d4c-fppl4" is available:
&Pod{ObjectMeta:{test-rolling-update-with-lb-56d9b65d4c-fppl4 test-rolling-update-with-lb-56d9b65d4c- deployment-8113  4e627f53-f03e-4847-9fd3-f5ce7d99ebbb 15737 0 2023-01-12 06:35:04 +0000 UTC <nil> <nil> map[iteration:0 name:test-rolling-update-with-lb pod-template-hash:56d9b65d4c] map[] [{apps/v1 ReplicaSet test-rolling-update-with-lb-56d9b65d4c d8024d48-c2c7-4024-8150-8c181353cd25 0xc0016f51e7 0xc0016f51e8}] [] [{kube-controller-manager Update v1 2023-01-12 06:35:04 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"d8024d48-c2c7-4024-8150-8c181353cd25\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-12 06:35:19 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.58.125\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-gt2p5,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,Command:[],Args:[netexec --http-port=80 --udp-port=80],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-gt2p5,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-01ebb116de9e964dc,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:&Affinity{NodeAffinity:nil,PodAffinity:nil,PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[0],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},},SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:35:04 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:35:06 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:35:06 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:35:04 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.41.44,PodIP:172.20.58.125,StartTime:2023-01-12 06:35:04 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-12 06:35:06 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,ImageID:registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e,ContainerID:containerd://720fe9ffbbe2f82ed711dfd6e87f6e726db97db486ea0543055cee3552e70025,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.58.125,},},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 12 06:43:11.753: INFO: Pod "test-rolling-update-with-lb-85b8b59c8c-c2484" is not available:
&Pod{ObjectMeta:{test-rolling-update-with-lb-85b8b59c8c-c2484 test-rolling-update-with-lb-85b8b59c8c- deployment-8113  a0b30853-52a8-4e3a-9ea6-4915df59a894 19155 0 2023-01-12 06:41:27 +0000 UTC <nil> <nil> map[iteration:1 name:test-rolling-update-with-lb pod-template-hash:85b8b59c8c] map[] [{apps/v1 ReplicaSet test-rolling-update-with-lb-85b8b59c8c fcb0c25e-10ce-4ed6-a6c9-4448b8de4b7f 0xc0016f5407 0xc0016f5408}] [] [{kube-controller-manager Update v1 2023-01-12 06:41:27 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"fcb0c25e-10ce-4ed6-a6c9-4448b8de4b7f\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-12 06:41:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-j8jgz,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,Command:[],Args:[netexec --http-port=80 --udp-port=80],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-j8jgz,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-0029a94fa7f902ab5,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:&Affinity{NodeAffinity:nil,PodAffinity:&PodAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:NotIn,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},},SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:41:27 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:41:27 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [agnhost],},PodCondition{Type:ContainersReady,Status:False,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:41:27 +0000 UTC,Reason:ContainersNotReady,Message:containers with unready status: [agnhost],},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:41:27 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.48.235,PodIP:,StartTime:2023-01-12 06:41:27 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:&ContainerStateWaiting{Reason:ContainerCreating,Message:,},Running:nil,Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:false,RestartCount:0,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,ImageID:,ContainerID:,Started:*false,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 12 06:43:11.753: INFO: Pod "test-rolling-update-with-lb-85b8b59c8c-rdnwt" is available:
&Pod{ObjectMeta:{test-rolling-update-with-lb-85b8b59c8c-rdnwt test-rolling-update-with-lb-85b8b59c8c- deployment-8113  c94c29c8-29d3-4935-bc6b-e4b436ae449b 19129 0 2023-01-12 06:38:11 +0000 UTC <nil> <nil> map[iteration:1 name:test-rolling-update-with-lb pod-template-hash:85b8b59c8c] map[] [{apps/v1 ReplicaSet test-rolling-update-with-lb-85b8b59c8c fcb0c25e-10ce-4ed6-a6c9-4448b8de4b7f 0xc0016f5757 0xc0016f5758}] [] [{kube-controller-manager Update v1 2023-01-12 06:38:11 +0000 UTC FieldsV1 {"f:metadata":{"f:generateName":{},"f:labels":{".":{},"f:iteration":{},"f:name":{},"f:pod-template-hash":{}},"f:ownerReferences":{".":{},"k:{\"uid\":\"fcb0c25e-10ce-4ed6-a6c9-4448b8de4b7f\"}":{}}},"f:spec":{"f:affinity":{".":{},"f:podAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}},"f:podAntiAffinity":{".":{},"f:requiredDuringSchedulingIgnoredDuringExecution":{}}},"f:containers":{"k:{\"name\":\"agnhost\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} } {kubelet Update v1 2023-01-12 06:41:27 +0000 UTC FieldsV1 {"f:status":{"f:conditions":{"k:{\"type\":\"ContainersReady\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Initialized\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}},"k:{\"type\":\"Ready\"}":{".":{},"f:lastProbeTime":{},"f:lastTransitionTime":{},"f:status":{},"f:type":{}}},"f:containerStatuses":{},"f:hostIP":{},"f:phase":{},"f:podIP":{},"f:podIPs":{".":{},"k:{\"ip\":\"172.20.43.33\"}":{".":{},"f:ip":{}}},"f:startTime":{}}} status}]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-njs2f,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,Command:[],Args:[netexec --http-port=80 --udp-port=80],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-njs2f,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:ClusterFirst,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:i-0b95e3cb438ca1933,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:&Affinity{NodeAffinity:nil,PodAffinity:&PodAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:NotIn,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},PodAntiAffinity:&PodAntiAffinity{RequiredDuringSchedulingIgnoredDuringExecution:[]PodAffinityTerm{PodAffinityTerm{LabelSelector:&v1.LabelSelector{MatchLabels:map[string]string{},MatchExpressions:[]LabelSelectorRequirement{LabelSelectorRequirement{Key:name,Operator:In,Values:[test-rolling-update-with-lb],},LabelSelectorRequirement{Key:iteration,Operator:In,Values:[1],},},},Namespaces:[],TopologyKey:kubernetes.io/hostname,NamespaceSelector:nil,},},PreferredDuringSchedulingIgnoredDuringExecution:[]WeightedPodAffinityTerm{},},},SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:nil,ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Running,Conditions:[]PodCondition{PodCondition{Type:Initialized,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:38:11 +0000 UTC,Reason:,Message:,},PodCondition{Type:Ready,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:41:27 +0000 UTC,Reason:,Message:,},PodCondition{Type:ContainersReady,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:41:27 +0000 UTC,Reason:,Message:,},PodCondition{Type:PodScheduled,Status:True,LastProbeTime:0001-01-01 00:00:00 +0000 UTC,LastTransitionTime:2023-01-12 06:38:11 +0000 UTC,Reason:,Message:,},},Message:,Reason:,HostIP:172.20.43.177,PodIP:172.20.43.33,StartTime:2023-01-12 06:38:11 +0000 UTC,ContainerStatuses:[]ContainerStatus{ContainerStatus{Name:agnhost,State:ContainerState{Waiting:nil,Running:&ContainerStateRunning{StartedAt:2023-01-12 06:41:27 +0000 UTC,},Terminated:nil,},LastTerminationState:ContainerState{Waiting:nil,Running:nil,Terminated:nil,},Ready:true,RestartCount:0,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,ImageID:registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e,ContainerID:containerd://b7ba91629b748f3becc9ca3b2e6306af99ca6bd0bf3f78fe2db8adcf29e137ce,Started:*true,},},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{PodIP{IP:172.20.43.33,},},EphemeralContainerStatuses:[]ContainerStatus{},},}
[AfterEach] [sig-apps] Deployment
  test/e2e/framework/node/init/init.go:32
Jan 12 06:43:11.753: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] Deployment
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] Deployment
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/12/23 06:43:11.785�[0m
�[1mSTEP:�[0m Collecting events from namespace "deployment-8113". �[38;5;243m01/12/23 06:43:11.786�[0m
�[1mSTEP:�[0m Found 54 events. �[38;5;243m01/12/23 06:43:11.818�[0m
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:04 +0000 UTC - event for test-rolling-update-with-lb: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rolling-update-with-lb-56d9b65d4c to 3
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:04 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-56d9b65d4c-866wj
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:04 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-56d9b65d4c-fppl4
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:04 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-56d9b65d4c-cgjx2
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:04 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-866wj: {default-scheduler } Scheduled: Successfully assigned deployment-8113/test-rolling-update-with-lb-56d9b65d4c-866wj to i-0b95e3cb438ca1933
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:04 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-cgjx2: {default-scheduler } Scheduled: Successfully assigned deployment-8113/test-rolling-update-with-lb-56d9b65d4c-cgjx2 to i-0029a94fa7f902ab5
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:04 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-fppl4: {default-scheduler } Scheduled: Successfully assigned deployment-8113/test-rolling-update-with-lb-56d9b65d4c-fppl4 to i-01ebb116de9e964dc
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:05 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-fppl4: {kubelet i-01ebb116de9e964dc} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:06 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-866wj: {kubelet i-0b95e3cb438ca1933} Created: Created container agnhost
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:06 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-866wj: {kubelet i-0b95e3cb438ca1933} Started: Started container agnhost
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:06 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-866wj: {kubelet i-0b95e3cb438ca1933} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:06 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-fppl4: {kubelet i-01ebb116de9e964dc} Created: Created container agnhost
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:06 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-fppl4: {kubelet i-01ebb116de9e964dc} Started: Started container agnhost
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:07 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-cgjx2: {kubelet i-0029a94fa7f902ab5} Started: Started container agnhost
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:07 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-cgjx2: {kubelet i-0029a94fa7f902ab5} Created: Created container agnhost
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:07 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-cgjx2: {kubelet i-0029a94fa7f902ab5} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:21 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } EnsuringLoadBalancer: Ensuring load balancer
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:22 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } SyncLoadBalancerFailed: Error syncing load balancer: failed to ensure load balancer: Unable to update load balancer attributes during attribute sync: "AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf--v1fsnt/i-00a1700b2a4dc039f is not authorized to perform: elasticloadbalancing:ModifyLoadBalancerAttributes on resource: arn:aws:elasticloadbalancing:ca-central-1:768319786644:loadbalancer/a4c054311646146f593748a6a7569763 because no identity-based policy allows the elasticloadbalancing:ModifyLoadBalancerAttributes action\n\tstatus code: 403, request id: 07929c34-01e7-4929-ad89-6359f187bdc0"
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:28 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } SyncLoadBalancerFailed: Error syncing load balancer: failed to ensure load balancer: Unable to update load balancer attributes during attribute sync: "AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf--v1fsnt/i-00a1700b2a4dc039f is not authorized to perform: elasticloadbalancing:ModifyLoadBalancerAttributes on resource: arn:aws:elasticloadbalancing:ca-central-1:768319786644:loadbalancer/a4c054311646146f593748a6a7569763 because no identity-based policy allows the elasticloadbalancing:ModifyLoadBalancerAttributes action\n\tstatus code: 403, request id: 4837b76a-2ad6-4f7b-9d1b-cfad0da4e30d"
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:38 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } SyncLoadBalancerFailed: Error syncing load balancer: failed to ensure load balancer: Unable to update load balancer attributes during attribute sync: "AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf--v1fsnt/i-00a1700b2a4dc039f is not authorized to perform: elasticloadbalancing:ModifyLoadBalancerAttributes on resource: arn:aws:elasticloadbalancing:ca-central-1:768319786644:loadbalancer/a4c054311646146f593748a6a7569763 because no identity-based policy allows the elasticloadbalancing:ModifyLoadBalancerAttributes action\n\tstatus code: 403, request id: 5713437b-44f8-4f18-bc14-2fda8c8e4282"
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:35:58 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } SyncLoadBalancerFailed: Error syncing load balancer: failed to ensure load balancer: Unable to update load balancer attributes during attribute sync: "AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf--v1fsnt/i-00a1700b2a4dc039f is not authorized to perform: elasticloadbalancing:ModifyLoadBalancerAttributes on resource: arn:aws:elasticloadbalancing:ca-central-1:768319786644:loadbalancer/a4c054311646146f593748a6a7569763 because no identity-based policy allows the elasticloadbalancing:ModifyLoadBalancerAttributes action\n\tstatus code: 403, request id: 0d682095-b2df-409f-8e9f-26f488da7716"
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:36:39 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } SyncLoadBalancerFailed: Error syncing load balancer: failed to ensure load balancer: Unable to update load balancer attributes during attribute sync: "AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf--v1fsnt/i-00a1700b2a4dc039f is not authorized to perform: elasticloadbalancing:ModifyLoadBalancerAttributes on resource: arn:aws:elasticloadbalancing:ca-central-1:768319786644:loadbalancer/a4c054311646146f593748a6a7569763 because no identity-based policy allows the elasticloadbalancing:ModifyLoadBalancerAttributes action\n\tstatus code: 403, request id: 03767993-2d2c-4eba-b0a5-0360350f901b"
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:38:00 +0000 UTC - event for test-rolling-update-with-lb: {service-controller } EnsuredLoadBalancer: Ensured load balancer
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:38:11 +0000 UTC - event for test-rolling-update-with-lb: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rolling-update-with-lb-85b8b59c8c to 1
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:38:11 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-85b8b59c8c-rdnwt
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:38:11 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {default-scheduler } Scheduled: Successfully assigned deployment-8113/test-rolling-update-with-lb-85b8b59c8c-rdnwt to i-0b95e3cb438ca1933
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:38:11 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5434b535096376596208961e3178e772a6bdf03aef06d5a5406415cab4fe2328": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:38:26 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fdff2ea433d41a0a23060bf154f65bda54a8a10aa632745b4a3391f6d0832287": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:38:38 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f0b76327ada84d1576613559a32e483c180dcdb9af592755c1db014a12351750": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:38:49 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f1e4de1d0a29b0a5c26f6f4169d69fd04a79abe2920eed0edd05da5c4a383253": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:39:03 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "30ed1bc16a524c60e65d4efe431414d92017096663011a4384530f2a298538c2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:39:17 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "88fbc5c65089d5b3df293a016570d7b678bc437d9eb6ac371dc6d696c062aba3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:39:32 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "04b427f73c1cfbaf4481ec2678c40b96843af65f945920edbe73656fd3f638ae": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:39:44 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6fc75626e2cdfbd7ff254079e61736b57d50d6a060e9112af73a505add37ac5b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:39:59 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cd23860519b63a5e6d08bc39cde5fce38856c38d1319cf5cc4fd6e7ae5ed7f48": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:40:11 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a9522cea7d347ceff7efb09847272365bfb69c465f52b238bcc6e426ba702f37": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:26 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} Created: Created container agnhost
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:26 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} Pulled: Container image "registry.k8s.io/e2e-test-images/agnhost:2.43" already present on machine
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:27 +0000 UTC - event for test-rolling-update-with-lb: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rolling-update-with-lb-85b8b59c8c to 2 from 1
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:27 +0000 UTC - event for test-rolling-update-with-lb: {deployment-controller } ScalingReplicaSet: Scaled down replica set test-rolling-update-with-lb-56d9b65d4c to 2 from 3
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:27 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rolling-update-with-lb-56d9b65d4c-866wj
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:27 +0000 UTC - event for test-rolling-update-with-lb-56d9b65d4c-866wj: {kubelet i-0b95e3cb438ca1933} Killing: Stopping container agnhost
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:27 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c: {replicaset-controller } SuccessfulCreate: Created pod: test-rolling-update-with-lb-85b8b59c8c-c2484
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:27 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-c2484: {kubelet i-0029a94fa7f902ab5} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4dfbd01d4a00f98d899eb289fd180fa81cba540c3dd3ff516aa142722366bd39": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:27 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-c2484: {default-scheduler } Scheduled: Successfully assigned deployment-8113/test-rolling-update-with-lb-85b8b59c8c-c2484 to i-0029a94fa7f902ab5
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:27 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-rdnwt: {kubelet i-0b95e3cb438ca1933} Started: Started container agnhost
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:38 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-c2484: {kubelet i-0029a94fa7f902ab5} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c30dd3977b2b10bd32ae799fd61f133db0ea44c45129642f44fdd95ed862bde8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:41:52 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-c2484: {kubelet i-0029a94fa7f902ab5} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a94258a7076e33302e112e2a1de87291deac0fe3d2320547bdded988e07c062d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:42:04 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-c2484: {kubelet i-0029a94fa7f902ab5} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ce04ca66969e8f0d01353713a161f4a3a45b65950b015d8d10e018dac0e1ca4a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:42:19 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-c2484: {kubelet i-0029a94fa7f902ab5} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "44d3b7386db9565088144dedeb127e798f7a6dc682939c8f5d4c6a51a687db0d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:42:31 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-c2484: {kubelet i-0029a94fa7f902ab5} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2badab21b6ea2c0cafa7e53a2c6cfd4796f71f3b625af7a846f2b4edc2dc3f6f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:42:45 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-c2484: {kubelet i-0029a94fa7f902ab5} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "02e1ad3824126b6c255751efd381b60774066bf4d4f77f62dd0aa1d669d785ea": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:42:56 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-c2484: {kubelet i-0029a94fa7f902ab5} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5ba92438cf6d9fab9c99c88431d5459dc2e21d51d31219f2506656d13c0d3a1a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.818: INFO: At 2023-01-12 06:43:08 +0000 UTC - event for test-rolling-update-with-lb-85b8b59c8c-c2484: {kubelet i-0029a94fa7f902ab5} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6f2563b9fcc5068dcaa944363cb04e9ebc4fbdbd6fb7363b41ea9494ac947268": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:43:11.849: INFO: POD                                           NODE                 PHASE    GRACE  CONDITIONS
Jan 12 06:43:11.849: INFO: test-rolling-update-with-lb-56d9b65d4c-cgjx2  i-0029a94fa7f902ab5  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:04 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:07 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:07 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:04 +0000 UTC  }]
Jan 12 06:43:11.849: INFO: test-rolling-update-with-lb-56d9b65d4c-fppl4  i-01ebb116de9e964dc  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:04 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:06 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:06 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:04 +0000 UTC  }]
Jan 12 06:43:11.849: INFO: test-rolling-update-with-lb-85b8b59c8c-c2484  i-0029a94fa7f902ab5  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:41:27 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:41:27 +0000 UTC ContainersNotReady containers with unready status: [agnhost]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:41:27 +0000 UTC ContainersNotReady containers with unready status: [agnhost]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:41:27 +0000 UTC  }]
Jan 12 06:43:11.849: INFO: test-rolling-update-with-lb-85b8b59c8c-rdnwt  i-0b95e3cb438ca1933  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:38:11 +0000 UTC  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:41:27 +0000 UTC  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:41:27 +0000 UTC  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:38:11 +0000 UTC  }]
Jan 12 06:43:11.849: INFO: 
Jan 12 06:43:11.952: INFO: Unable to fetch deployment-8113/test-rolling-update-with-lb-85b8b59c8c-c2484/agnhost logs: the server rejected our request for an unknown reason (get pods test-rolling-update-with-lb-85b8b59c8c-c2484)
Jan 12 06:43:12.018: INFO: 
Logging node info for node i-0029a94fa7f902ab5
Jan 12 06:43:12.050: INFO: Node Info: &Node{ObjectMeta:{i-0029a94fa7f902ab5    086bb9cc-b77b-48db-a8ae-537b7cbf6e36 20026 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0029a94fa7f902ab5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0029a94fa7f902ab5 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.235 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0029a94fa7f902ab5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:43:01 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0029a94fa7f902ab5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:43:00 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:43:00 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:43:00 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:43:00 +0000 UTC,LastTransitionTime:2023-01-12 06:26:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.235,},NodeAddress{Type:ExternalIP,Address:15.222.254.31,},NodeAddress{Type:InternalDNS,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-254-31.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2680cab44fba5db711d741fbe294e7,SystemUUID:ec2680ca-b44f-ba5d-b711-d741fbe294e7,BootID:01f1463d-4c68-4aa0-8900-0499980b4f60,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:43:12.050: INFO: 
Logging kubelet events for node i-0029a94fa7f902ab5
Jan 12 06:43:12.084: INFO: 
Logging pods the kubelet thinks is on node i-0029a94fa7f902ab5
Jan 12 06:43:12.123: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-krdq2 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.123: INFO: coredns-559769c974-p2fts started at 2023-01-12 06:27:03 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:43:12.123: INFO: hostexec-i-0029a94fa7f902ab5-bvfqt started at 2023-01-12 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:43:12.123: INFO: pod-subpath-test-preprovisionedpv-kgb2 started at 2023-01-12 06:43:09 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container test-container-subpath-preprovisionedpv-kgb2 ready: false, restart count 0
Jan 12 06:43:12.123: INFO: rs-bxvdw started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container donothing ready: true, restart count 0
Jan 12 06:43:12.123: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4c699 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.123: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-jrdnf started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.123: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-tm86v started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:43:12.123: INFO: rs-82mlf started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:43:12.123: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-w5hzb started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.123: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-qdh5s started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.123: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k5j26 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.123: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ccxfb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.123: INFO: cilium-v2fq9 started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:43:12.123: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:43:12.123: INFO: hostexec-i-0029a94fa7f902ab5-bwdb7 started at 2023-01-12 06:42:26 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:43:12.123: INFO: pod-subpath-test-preprovisionedpv-2r8b started at 2023-01-12 06:41:03 +0000 UTC (2+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Init container init-volume-preprovisionedpv-2r8b ready: false, restart count 0
Jan 12 06:43:12.123: INFO: 	Init container test-init-volume-preprovisionedpv-2r8b ready: false, restart count 0
Jan 12 06:43:12.123: INFO: 	Container test-container-subpath-preprovisionedpv-2r8b ready: false, restart count 0
Jan 12 06:43:12.123: INFO: test-rolling-update-with-lb-85b8b59c8c-c2484 started at 2023-01-12 06:41:27 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container agnhost ready: false, restart count 0
Jan 12 06:43:12.123: INFO: ebs-csi-node-wfgs2 started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:43:12.123: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:43:12.123: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:43:12.123: INFO: test-rolling-update-with-lb-56d9b65d4c-cgjx2 started at 2023-01-12 06:35:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:43:12.123: INFO: affinity-clusterip-timeout-bjvbr started at 2023-01-12 06:41:02 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container affinity-clusterip-timeout ready: false, restart count 0
Jan 12 06:43:12.123: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ds9hr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.123: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-798lx started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.123: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.398: INFO: 
Latency metrics for node i-0029a94fa7f902ab5
Jan 12 06:43:12.398: INFO: 
Logging node info for node i-00a1700b2a4dc039f
Jan 12 06:43:12.433: INFO: Node Info: &Node{ObjectMeta:{i-00a1700b2a4dc039f    31b14f9e-702c-4bf4-8b4f-160f1e8d2e78 19332 0 2023-01-12 06:24:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00a1700b2a4dc039f kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.107 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00a1700b2a4dc039f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-12 06:24:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-12 06:25:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:25:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-12 06:42:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00a1700b2a4dc039f,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:00 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:00 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:00 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:42:00 +0000 UTC,LastTransitionTime:2023-01-12 06:25:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.107,},NodeAddress{Type:ExternalIP,Address:99.79.69.225,},NodeAddress{Type:InternalDNS,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-69-225.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2aefdb0e1836236784b773a0de1726,SystemUUID:ec2aefdb-0e18-3623-6784-b773a0de1726,BootID:efa2d6a5-f933-4174-9d1e-f2c2ada73f29,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451206,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42803449,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967343,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:43:12.434: INFO: 
Logging kubelet events for node i-00a1700b2a4dc039f
Jan 12 06:43:12.488: INFO: 
Logging pods the kubelet thinks is on node i-00a1700b2a4dc039f
Jan 12 06:43:12.530: INFO: kube-apiserver-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Container healthcheck ready: true, restart count 0
Jan 12 06:43:12.530: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 12 06:43:12.530: INFO: kube-scheduler-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 12 06:43:12.530: INFO: cilium-f68z5 started at 2023-01-12 06:25:04 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:43:12.530: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:43:12.530: INFO: dns-controller-69987775c6-n2lqn started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Container dns-controller ready: true, restart count 0
Jan 12 06:43:12.530: INFO: cilium-operator-5dd44dc49f-zvdwf started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 12 06:43:12.530: INFO: aws-cloud-controller-manager-vj4cr started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 12 06:43:12.530: INFO: etcd-manager-events-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:43:12.530: INFO: etcd-manager-main-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:43:12.530: INFO: ebs-csi-controller-5bd98b456f-s56qb started at 2023-01-12 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:43:12.530: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:43:12.530: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 12 06:43:12.530: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:43:12.530: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:43:12.530: INFO: kops-controller-h6cd7 started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Container kops-controller ready: true, restart count 0
Jan 12 06:43:12.530: INFO: kube-controller-manager-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 12 06:43:12.530: INFO: ebs-csi-node-vtl8h started at 2023-01-12 06:25:04 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:43:12.530: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:43:12.530: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:43:12.530: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:43:12.696: INFO: 
Latency metrics for node i-00a1700b2a4dc039f
Jan 12 06:43:12.696: INFO: 
Logging node info for node i-01ebb116de9e964dc
Jan 12 06:43:12.728: INFO: Node Info: &Node{ObjectMeta:{i-01ebb116de9e964dc    9bba0dc4-469e-4f38-b41b-aa672131ad87 19124 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01ebb116de9e964dc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01ebb116de9e964dc topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.44 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01ebb116de9e964dc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:41:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01ebb116de9e964dc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:41:26 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:41:26 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:41:26 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:41:26 +0000 UTC,LastTransitionTime:2023-01-12 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.44,},NodeAddress{Type:ExternalIP,Address:3.99.142.186,},NodeAddress{Type:InternalDNS,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-142-186.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec264bf9915ff9f6f2894d5911a8df83,SystemUUID:ec264bf9-915f-f9f6-f289-4d5911a8df83,BootID:00d4d8a1-d87c-4c57-bee6-69bb72398b91,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:43:12.728: INFO: 
Logging kubelet events for node i-01ebb116de9e964dc
Jan 12 06:43:12.762: INFO: 
Logging pods the kubelet thinks is on node i-01ebb116de9e964dc
Jan 12 06:43:12.801: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-js9bn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.801: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-q9c9s started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.801: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-9j6sw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.801: INFO: test-grpc-1aa5d57d-fe72-441c-bb01-7fd0c4407d5d started at 2023-01-12 06:42:22 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container etcd ready: true, restart count 0
Jan 12 06:43:12.801: INFO: rs-867mv started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:43:12.801: INFO: rand-non-local-gzghw started at 2023-01-12 06:35:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container c ready: false, restart count 0
Jan 12 06:43:12.801: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bvnhn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.801: INFO: ebs-csi-node-bvknd started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:43:12.801: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:43:12.801: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:43:12.801: INFO: rs-5hrnk started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:43:12.801: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kfdmq started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.801: INFO: pod-csi-inline-volumes started at 2023-01-12 06:42:23 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container pod-csi-inline-volumes ready: false, restart count 0
Jan 12 06:43:12.801: INFO: rand-non-local-flpwd started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container c ready: false, restart count 0
Jan 12 06:43:12.801: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-97p2z started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.801: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-mfrbf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.801: INFO: cilium-b5cfc started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:43:12.801: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:43:12.801: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-z8qq5 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.801: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-5pqpn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.801: INFO: test-rolling-update-with-lb-56d9b65d4c-fppl4 started at 2023-01-12 06:35:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:43:12.801: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-nwxqm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:12.801: INFO: rs-7sf6x started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:43:12.801: INFO: busybox1 started at 2023-01-12 06:43:07 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:12.801: INFO: 	Container busybox ready: false, restart count 0
Jan 12 06:43:13.001: INFO: 
Latency metrics for node i-01ebb116de9e964dc
Jan 12 06:43:13.001: INFO: 
Logging node info for node i-0b95e3cb438ca1933
Jan 12 06:43:13.032: INFO: Node Info: &Node{ObjectMeta:{i-0b95e3cb438ca1933    410c9a77-76a5-49fd-81d8-dcf127193ecf 19775 0 2023-01-12 06:26:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b95e3cb438ca1933 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0b95e3cb438ca1933 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.177 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9408":"i-0b95e3cb438ca1933","csi-mock-csi-mock-volumes-6423":"i-0b95e3cb438ca1933","ebs.csi.aws.com":"i-0b95e3cb438ca1933"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:42:35 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-12 06:42:43 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0b95e3cb438ca1933,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:43 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:43 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:43 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:42:43 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.177,},NodeAddress{Type:ExternalIP,Address:99.79.51.51,},NodeAddress{Type:InternalDNS,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-51-51.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23cc76a58199e94cb916e26a0dbdd4,SystemUUID:ec23cc76-a581-99e9-4cb9-16e26a0dbdd4,BootID:769bca70-45b1-4d4c-82b2-ff7e3a4f99ff,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-9408^4b703937-9244-11ed-90ee-5a4921a595cd kubernetes.io/csi/csi-mock-csi-mock-volumes-6423^3c4b8f7a-9244-11ed-9717-8632b2062acf],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-9408^4b703937-9244-11ed-90ee-5a4921a595cd,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-6423^3c4b8f7a-9244-11ed-9717-8632b2062acf,DevicePath:,},},Config:nil,},}
Jan 12 06:43:13.033: INFO: 
Logging kubelet events for node i-0b95e3cb438ca1933
Jan 12 06:43:13.066: INFO: 
Logging pods the kubelet thinks is on node i-0b95e3cb438ca1933
Jan 12 06:43:13.108: INFO: ebs-csi-node-x6qtj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:43:13.108: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:43:13.108: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:43:13.108: INFO: csi-mockplugin-0 started at 2023-01-12 06:38:21 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:43:13.108: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 12 06:43:13.108: INFO: 	Container mock ready: true, restart count 0
Jan 12 06:43:13.108: INFO: alpine-nnp-true-294399b3-dd8d-444b-9d8b-4d6bc97dcba1 started at 2023-01-12 06:41:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container alpine-nnp-true-294399b3-dd8d-444b-9d8b-4d6bc97dcba1 ready: false, restart count 0
Jan 12 06:43:13.108: INFO: inline-volume-tester-xjgl9 started at 2023-01-12 06:42:34 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 12 06:43:13.108: INFO: test-rolling-update-with-lb-85b8b59c8c-rdnwt started at 2023-01-12 06:38:11 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:43:13.108: INFO: hairpin started at 2023-01-12 06:40:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 12 06:43:13.108: INFO: pod-subpath-test-inlinevolume-d8rd started at 2023-01-12 06:41:10 +0000 UTC (2+2 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Init container init-volume-inlinevolume-d8rd ready: false, restart count 0
Jan 12 06:43:13.108: INFO: 	Init container test-init-subpath-inlinevolume-d8rd ready: false, restart count 0
Jan 12 06:43:13.108: INFO: 	Container test-container-subpath-inlinevolume-d8rd ready: false, restart count 0
Jan 12 06:43:13.108: INFO: 	Container test-container-volume-inlinevolume-d8rd ready: false, restart count 0
Jan 12 06:43:13.108: INFO: security-context-db8fe60c-6582-4454-b4b6-941c9614ce8e started at 2023-01-12 06:41:10 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container test-container ready: false, restart count 0
Jan 12 06:43:13.108: INFO: pod-hostip-0806b4ac-73af-498b-a9ca-89d40796f256 started at 2023-01-12 06:41:44 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container test ready: false, restart count 0
Jan 12 06:43:13.108: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vp5q6 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.108: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k9rkg started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.108: INFO: cilium-l6rqm started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:43:13.108: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:43:13.108: INFO: fail-once-non-local-vcv58 started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container c ready: false, restart count 0
Jan 12 06:43:13.108: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-27f6c started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.108: INFO: fail-once-non-local-h8qrp started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container c ready: false, restart count 0
Jan 12 06:43:13.108: INFO: pvc-volume-tester-gbnzs started at 2023-01-12 06:42:10 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container volume-tester ready: false, restart count 0
Jan 12 06:43:13.108: INFO: fail-once-non-local-p94zd started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container c ready: false, restart count 0
Jan 12 06:43:13.108: INFO: rs-qh54h started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:43:13.108: INFO: affinity-clusterip-timeout-9f8jh started at 2023-01-12 06:41:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container affinity-clusterip-timeout ready: false, restart count 0
Jan 12 06:43:13.108: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-7xqlb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.108: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-2j6p9 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.108: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b6bbr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.108: INFO: pod-host-path-test started at 2023-01-12 06:40:45 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container test-container-1 ready: false, restart count 0
Jan 12 06:43:13.108: INFO: 	Container test-container-2 ready: false, restart count 0
Jan 12 06:43:13.108: INFO: hostexec-i-0b95e3cb438ca1933-sttpl started at 2023-01-12 06:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:43:13.108: INFO: csi-mockplugin-attacher-0 started at 2023-01-12 06:38:21 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:43:13.108: INFO: fail-once-non-local-w64vm started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container c ready: false, restart count 0
Jan 12 06:43:13.108: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dqrr9 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.108: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-gtbjw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.108: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4sqlp started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:43:13.108: INFO: fail-once-non-local-l62nm started at 2023-01-12 06:35:21 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container c ready: false, restart count 0
Jan 12 06:43:13.108: INFO: ss2-0 started at 2023-01-12 06:42:09 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container webserver ready: false, restart count 0
Jan 12 06:43:13.108: INFO: pod-configmaps-085510c8-09ee-4f9d-a395-d462020dcfcf started at 2023-01-12 06:35:43 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 12 06:43:13.108: INFO: 	Container configmap-volume-binary-test ready: false, restart count 0
Jan 12 06:43:13.108: INFO: pod-subpath-test-preprovisionedpv-48mj started at 2023-01-12 06:41:04 +0000 UTC (2+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Init container init-volume-preprovisionedpv-48mj ready: false, restart count 0
Jan 12 06:43:13.108: INFO: 	Init container test-init-volume-preprovisionedpv-48mj ready: false, restart count 0
Jan 12 06:43:13.108: INFO: 	Container test-container-subpath-preprovisionedpv-48mj ready: false, restart count 0
Jan 12 06:43:13.108: INFO: rs-j5p6n started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:43:13.108: INFO: rs-kdm5p started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:43:13.108: INFO: failed-jobs-history-limit-27891763-zn5tf started at 2023-01-12 06:43:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container c ready: false, restart count 0
Jan 12 06:43:13.108: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:41:01 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:43:13.108: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:43:13.108: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 12 06:43:13.108: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 12 06:43:13.108: INFO: 	Container hostpath ready: true, restart count 0
Jan 12 06:43:13.108: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:43:13.108: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:43:13.108: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-wnxfm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.108: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:43:13.308: INFO: 
Latency metrics for node i-0b95e3cb438ca1933
Jan 12 06:43:13.308: INFO: 
Logging node info for node i-0bcea138229cdd410
Jan 12 06:43:13.339: INFO: Node Info: &Node{ObjectMeta:{i-0bcea138229cdd410    95f2bbd5-be1b-44e9-a59a-66f87015f9d2 18244 0 2023-01-12 06:26:24 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bcea138229cdd410 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0bcea138229cdd410 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.32.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bcea138229cdd410"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:40:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0bcea138229cdd410,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.32.113,},NodeAddress{Type:ExternalIP,Address:35.182.71.1,},NodeAddress{Type:InternalDNS,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-71-1.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21ffd1efd1b61b9def5afc88b88dba,SystemUUID:ec21ffd1-efd1-b61b-9def-5afc88b88dba,BootID:65b83838-2717-4c2d-8957-6fdcb4152c24,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:43:13.339: INFO: 
Logging kubelet events for node i-0bcea138229cdd410
Jan 12 06:43:13.373: INFO: 
Logging pods the kubelet thinks is on node i-0bcea138229cdd410
Jan 12 06:43:13.413: INFO: rs-x4kpg started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:43:13.413: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dxzmh started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.413: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6p5qk started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.413: INFO: cilium-q5hq4 started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:43:13.413: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:43:13.413: INFO: coredns-autoscaler-7cb5c5b969-lzjqb started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container autoscaler ready: true, restart count 0
Jan 12 06:43:13.413: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b9cmz started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.413: INFO: affinity-clusterip-timeout-xvt8w started at 2023-01-12 06:41:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container affinity-clusterip-timeout ready: false, restart count 0
Jan 12 06:43:13.413: INFO: pod-subpath-test-preprovisionedpv-vzj5 started at 2023-01-12 06:41:04 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container test-container-subpath-preprovisionedpv-vzj5 ready: false, restart count 0
Jan 12 06:43:13.413: INFO: 	Container test-container-volume-preprovisionedpv-vzj5 ready: false, restart count 0
Jan 12 06:43:13.413: INFO: coredns-559769c974-z5pf2 started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:43:13.413: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:43:00 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 12 06:43:13.413: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:43:13.413: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 12 06:43:13.413: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 12 06:43:13.413: INFO: 	Container hostpath ready: false, restart count 0
Jan 12 06:43:13.413: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 12 06:43:13.413: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 12 06:43:13.413: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bg28w started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.413: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-h6kb8 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.413: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-8zhgf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.413: INFO: rs-rbvm4 started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:43:13.413: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6ngxj started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.413: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kd57q started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.413: INFO: hostexec-i-0bcea138229cdd410-j7qft started at 2023-01-12 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:43:13.413: INFO: ebs-csi-node-g2mwj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:43:13.413: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:43:13.413: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:43:13.413: INFO: hostexec-i-0bcea138229cdd410-hx972 started at 2023-01-12 06:40:53 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:43:13.413: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6blc8 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.413: INFO: pod-subpath-test-preprovisionedpv-xblf started at 2023-01-12 06:41:04 +0000 UTC (2+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Init container init-volume-preprovisionedpv-xblf ready: false, restart count 0
Jan 12 06:43:13.413: INFO: 	Init container test-init-volume-preprovisionedpv-xblf ready: false, restart count 0
Jan 12 06:43:13.413: INFO: 	Container test-container-subpath-preprovisionedpv-xblf ready: false, restart count 0
Jan 12 06:43:13.413: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vxhrc started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:43:13.413: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:43:13.593: INFO: 
Latency metrics for node i-0bcea138229cdd410
[DeferCleanup (Each)] [sig-apps] Deployment
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "deployment-8113" for this suite. �[38;5;243m01/12/23 06:43:13.593�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-apps] ReplicationController should serve a basic image on each replica with a public image [Conformance] 5m2s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sReplicationController\sshould\sserve\sa\sbasic\simage\son\seach\sreplica\swith\sa\spublic\simage\s\s\[Conformance\]$'

test/e2e/apps/rc.go:499
k8s.io/kubernetes/test/e2e/apps.TestReplicationControllerServeImageOrFail(0xc000ebd1d0, {0x75b8d9b, 0x5}, {0xc00020d7d0, 0x2c})
	test/e2e/apps/rc.go:499 +0xb85
k8s.io/kubernetes/test/e2e/apps.glob..func8.2()
	test/e2e/apps/rc.go:68 +0x37
				[BeforeEach] [sig-apps] ReplicationController
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/12/23 06:35:59.36�[0m
Jan 12 06:35:59.360: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename replication-controller �[38;5;243m01/12/23 06:35:59.361�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/12/23 06:35:59.457�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/12/23 06:35:59.518�[0m
[BeforeEach] [sig-apps] ReplicationController
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-apps] ReplicationController
  test/e2e/apps/rc.go:57
[It] should serve a basic image on each replica with a public image  [Conformance]
  test/e2e/apps/rc.go:67
�[1mSTEP:�[0m Creating replication controller my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a �[38;5;243m01/12/23 06:35:59.58�[0m
Jan 12 06:35:59.645: INFO: Pod name my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a: Found 1 pods out of 1
Jan 12 06:35:59.645: INFO: Ensuring all pods for ReplicationController "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a" are running
Jan 12 06:35:59.645: INFO: Waiting up to 5m0s for pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j" in namespace "replication-controller-357" to be "running"
Jan 12 06:35:59.677: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 31.406246ms
Jan 12 06:36:01.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2.063434444s
Jan 12 06:36:03.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4.06342635s
Jan 12 06:36:05.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 6.063566478s
Jan 12 06:36:07.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 8.063540956s
Jan 12 06:36:09.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 10.06284194s
Jan 12 06:36:11.711: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 12.065126854s
Jan 12 06:36:13.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 14.063141055s
Jan 12 06:36:15.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 16.06306758s
Jan 12 06:36:17.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 18.062517851s
Jan 12 06:36:19.714: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 20.068568022s
Jan 12 06:36:21.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 22.063950215s
Jan 12 06:36:23.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 24.063048633s
Jan 12 06:36:25.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 26.062988283s
Jan 12 06:36:27.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 28.063503688s
Jan 12 06:36:29.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 30.063782281s
Jan 12 06:36:31.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 32.06293805s
Jan 12 06:36:33.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 34.062891903s
Jan 12 06:36:35.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 36.063380763s
Jan 12 06:36:37.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 38.063382651s
Jan 12 06:36:39.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 40.063074588s
Jan 12 06:36:41.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 42.063947701s
Jan 12 06:36:43.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 44.063215123s
Jan 12 06:36:45.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 46.063076894s
Jan 12 06:36:47.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 48.063401071s
Jan 12 06:36:49.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 50.063100623s
Jan 12 06:36:51.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 52.063082517s
Jan 12 06:36:53.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 54.063474835s
Jan 12 06:36:55.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 56.06326213s
Jan 12 06:36:57.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 58.063756855s
Jan 12 06:36:59.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.0633789s
Jan 12 06:37:01.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.062878919s
Jan 12 06:37:03.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.062979727s
Jan 12 06:37:05.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.063542887s
Jan 12 06:37:07.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.06340553s
Jan 12 06:37:09.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.063220538s
Jan 12 06:37:11.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.063072177s
Jan 12 06:37:13.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.06350511s
Jan 12 06:37:15.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.063659931s
Jan 12 06:37:17.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.063879927s
Jan 12 06:37:19.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.063658605s
Jan 12 06:37:21.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.063051105s
Jan 12 06:37:23.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.063496775s
Jan 12 06:37:25.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.063336361s
Jan 12 06:37:27.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.063794855s
Jan 12 06:37:29.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.062898411s
Jan 12 06:37:31.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.06366365s
Jan 12 06:37:33.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.063966407s
Jan 12 06:37:35.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.062883936s
Jan 12 06:37:37.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.063518232s
Jan 12 06:37:39.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.063729768s
Jan 12 06:37:41.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.063807454s
Jan 12 06:37:43.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.06317669s
Jan 12 06:37:45.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.063065931s
Jan 12 06:37:47.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.063443417s
Jan 12 06:37:49.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.063109667s
Jan 12 06:37:51.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.063684346s
Jan 12 06:37:53.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.063066473s
Jan 12 06:37:55.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.063259872s
Jan 12 06:37:57.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.063610649s
Jan 12 06:37:59.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.062923422s
Jan 12 06:38:01.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.062932379s
Jan 12 06:38:03.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.06324027s
Jan 12 06:38:05.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.063102834s
Jan 12 06:38:07.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.063583869s
Jan 12 06:38:09.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.063607709s
Jan 12 06:38:11.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.063337292s
Jan 12 06:38:13.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.063634105s
Jan 12 06:38:15.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.062886199s
Jan 12 06:38:17.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.063741223s
Jan 12 06:38:19.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.063180812s
Jan 12 06:38:21.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.062819592s
Jan 12 06:38:23.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.06372541s
Jan 12 06:38:25.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.063099788s
Jan 12 06:38:27.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.063401507s
Jan 12 06:38:29.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.063139002s
Jan 12 06:38:31.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.063295851s
Jan 12 06:38:33.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.062884464s
Jan 12 06:38:35.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.063209641s
Jan 12 06:38:37.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.063114743s
Jan 12 06:38:39.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.063324475s
Jan 12 06:38:41.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.063057448s
Jan 12 06:38:43.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.062969947s
Jan 12 06:38:45.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.063438094s
Jan 12 06:38:47.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.062945236s
Jan 12 06:38:49.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.063247037s
Jan 12 06:38:51.710: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.064412123s
Jan 12 06:38:53.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.063316374s
Jan 12 06:38:55.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.06340514s
Jan 12 06:38:57.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.063640387s
Jan 12 06:38:59.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.063533658s
Jan 12 06:39:01.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.063442471s
Jan 12 06:39:03.710: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.064137046s
Jan 12 06:39:05.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.063414749s
Jan 12 06:39:07.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.063381444s
Jan 12 06:39:09.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.062899936s
Jan 12 06:39:11.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.06371151s
Jan 12 06:39:13.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.063227829s
Jan 12 06:39:15.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.063034595s
Jan 12 06:39:17.710: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.064334018s
Jan 12 06:39:19.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.063231597s
Jan 12 06:39:21.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.063453436s
Jan 12 06:39:23.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.063873942s
Jan 12 06:39:25.710: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.064080043s
Jan 12 06:39:27.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.063544072s
Jan 12 06:39:29.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.063928224s
Jan 12 06:39:31.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.063368655s
Jan 12 06:39:33.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.063003385s
Jan 12 06:39:35.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.06323351s
Jan 12 06:39:37.710: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.064078234s
Jan 12 06:39:39.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.063567882s
Jan 12 06:39:41.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.063742854s
Jan 12 06:39:43.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.063623328s
Jan 12 06:39:45.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.063932988s
Jan 12 06:39:47.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.063339059s
Jan 12 06:39:49.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.063512409s
Jan 12 06:39:51.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.063966387s
Jan 12 06:39:53.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.063060801s
Jan 12 06:39:55.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.063267098s
Jan 12 06:39:57.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.063222054s
Jan 12 06:39:59.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.063294647s
Jan 12 06:40:01.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.063901665s
Jan 12 06:40:03.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.063923447s
Jan 12 06:40:05.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.063781923s
Jan 12 06:40:07.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.063127589s
Jan 12 06:40:09.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.063004274s
Jan 12 06:40:11.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.063046449s
Jan 12 06:40:13.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.063966982s
Jan 12 06:40:15.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.063559613s
Jan 12 06:40:17.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.063485269s
Jan 12 06:40:19.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.062769563s
Jan 12 06:40:21.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.063127246s
Jan 12 06:40:23.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.063250154s
Jan 12 06:40:25.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.063348481s
Jan 12 06:40:27.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.063065163s
Jan 12 06:40:29.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.063648623s
Jan 12 06:40:31.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.062782907s
Jan 12 06:40:33.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.062921739s
Jan 12 06:40:35.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.063352938s
Jan 12 06:40:37.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.06341438s
Jan 12 06:40:39.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.063171362s
Jan 12 06:40:41.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.063199241s
Jan 12 06:40:43.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.062853869s
Jan 12 06:40:45.710: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.064374012s
Jan 12 06:40:47.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.063414396s
Jan 12 06:40:49.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.06334502s
Jan 12 06:40:51.710: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.064304876s
Jan 12 06:40:53.708: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.062608757s
Jan 12 06:40:55.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.063534692s
Jan 12 06:40:57.709: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.063499682s
Jan 12 06:40:59.711: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.06530665s
Jan 12 06:40:59.750: INFO: Pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.104587309s
Jan 12 06:40:59.782: INFO: Unexpected error: 
    <*errors.errorString | 0xc00105e930>: {
        s: "pod \"my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j\" never run (phase: Pending, conditions: [{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-12 06:35:59 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-12 06:35:59 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-12 06:35:59 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-12 06:35:59 +0000 UTC Reason: Message:}]): timed out while waiting for pod replication-controller-357/my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j to be running",
    }
Jan 12 06:40:59.783: FAIL: pod "my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j" never run (phase: Pending, conditions: [{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-12 06:35:59 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-12 06:35:59 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-12 06:35:59 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2023-01-12 06:35:59 +0000 UTC Reason: Message:}]): timed out while waiting for pod replication-controller-357/my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j to be running

Full Stack Trace
k8s.io/kubernetes/test/e2e/apps.TestReplicationControllerServeImageOrFail(0xc000ebd1d0, {0x75b8d9b, 0x5}, {0xc00020d7d0, 0x2c})
	test/e2e/apps/rc.go:499 +0xb85
k8s.io/kubernetes/test/e2e/apps.glob..func8.2()
	test/e2e/apps/rc.go:68 +0x37
[AfterEach] [sig-apps] ReplicationController
  test/e2e/framework/node/init/init.go:32
Jan 12 06:40:59.783: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-apps] ReplicationController
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-apps] ReplicationController
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/12/23 06:40:59.887�[0m
�[1mSTEP:�[0m Collecting events from namespace "replication-controller-357". �[38;5;243m01/12/23 06:40:59.887�[0m
�[1mSTEP:�[0m Found 12 events. �[38;5;243m01/12/23 06:40:59.921�[0m
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:35:59 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a: {replication-controller } SuccessfulCreate: Created pod: my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:35:59 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j: {default-scheduler } Scheduled: Successfully assigned replication-controller-357/my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j to i-0b95e3cb438ca1933
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:35:59 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e284a9d6f992e4a4beca24fb6eb7a8bfa616c0dda200e2cf47a2bf32aa0cfc20": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:36:12 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9fc51ed1c2b5ccb68f384eb894baf1d3bb43698492166ccaa76f61556c9ebd19": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:36:23 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "be7aec68b1d2dd37d0ab4192b412cbc63dfb37588da7b7d490141369ef76d4fa": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:36:36 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "011e5bdd75292d7038866ca526624f06ec6e4d57fcac870a87a3c71526c73e5e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:36:49 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1fa0951ffe754dbda8abc622cab86319ca0f81b1921162cb24ae04a8a3c45f9f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:37:04 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4d9647d26c244254ca0507fca885f5f02f9631e7cc75d8f671746a444319698c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:37:15 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b24d2db7a7117b22e53fb950c0bf81eab5639c0a4a7d51ea5a9c1d36e389a83b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:37:29 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "832247d0fdd556afc1884bb43a704e43ed583cd36483b218f144ab8ab0a02716": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:37:41 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "af9c153c2a9003d306551dd65a0292a396e6bf78e5fe2ba87de1881220cf0d3b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:59.921: INFO: At 2023-01-12 06:37:55 +0000 UTC - event for my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b6e571f643ddfbc2d98ab6c172fae8c911da1180b83c499ee445ce98753e6553": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:59.974: INFO: POD                                                           NODE                 PHASE    GRACE  CONDITIONS
Jan 12 06:40:59.974: INFO: my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j  i-0b95e3cb438ca1933  Pending         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:59 +0000 UTC  } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:59 +0000 UTC ContainersNotReady containers with unready status: [my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:59 +0000 UTC ContainersNotReady containers with unready status: [my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-12 06:35:59 +0000 UTC  }]
Jan 12 06:40:59.974: INFO: 
Jan 12 06:41:00.040: INFO: Unable to fetch replication-controller-357/my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j/my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a logs: the server rejected our request for an unknown reason (get pods my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j)
Jan 12 06:41:00.092: INFO: 
Logging node info for node i-0029a94fa7f902ab5
Jan 12 06:41:00.125: INFO: Node Info: &Node{ObjectMeta:{i-0029a94fa7f902ab5    086bb9cc-b77b-48db-a8ae-537b7cbf6e36 18758 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0029a94fa7f902ab5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0029a94fa7f902ab5 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.235 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1054":"i-0029a94fa7f902ab5","ebs.csi.aws.com":"i-0029a94fa7f902ab5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:41:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0029a94fa7f902ab5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.235,},NodeAddress{Type:ExternalIP,Address:15.222.254.31,},NodeAddress{Type:InternalDNS,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-254-31.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2680cab44fba5db711d741fbe294e7,SystemUUID:ec2680ca-b44f-ba5d-b711-d741fbe294e7,BootID:01f1463d-4c68-4aa0-8900-0499980b4f60,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:41:00.125: INFO: 
Logging kubelet events for node i-0029a94fa7f902ab5
Jan 12 06:41:00.170: INFO: 
Logging pods the kubelet thinks is on node i-0029a94fa7f902ab5
Jan 12 06:41:00.219: INFO: cilium-v2fq9 started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:41:00.219: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:41:00.219: INFO: up-down-1-lvmbh started at 2023-01-12 06:35:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container up-down-1 ready: true, restart count 0
Jan 12 06:41:00.219: INFO: up-down-2-lw8c9 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container up-down-2 ready: true, restart count 0
Jan 12 06:41:00.219: INFO: ebs-csi-node-wfgs2 started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:41:00.219: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:41:00.219: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:41:00.219: INFO: test-rolling-update-with-lb-56d9b65d4c-cgjx2 started at 2023-01-12 06:35:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:41:00.219: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ds9hr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.219: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-798lx started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:41:00.219: INFO: coredns-559769c974-p2fts started at 2023-01-12 06:27:03 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:41:00.219: INFO: hostexec-i-0029a94fa7f902ab5-bvfqt started at 2023-01-12 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:41:00.219: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:40:58 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 12 06:41:00.219: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:41:00.219: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 12 06:41:00.219: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 12 06:41:00.219: INFO: 	Container hostpath ready: false, restart count 0
Jan 12 06:41:00.219: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 12 06:41:00.219: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 12 06:41:00.219: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4c699 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.219: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-jrdnf started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.219: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-tm86v started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:41:00.219: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-krdq2 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:41:00.219: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-w5hzb started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.219: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-qdh5s started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.219: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k5j26 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.219: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ccxfb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.219: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.424: INFO: 
Latency metrics for node i-0029a94fa7f902ab5
Jan 12 06:41:00.424: INFO: 
Logging node info for node i-00a1700b2a4dc039f
Jan 12 06:41:00.456: INFO: Node Info: &Node{ObjectMeta:{i-00a1700b2a4dc039f    31b14f9e-702c-4bf4-8b4f-160f1e8d2e78 17128 0 2023-01-12 06:24:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00a1700b2a4dc039f kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.107 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00a1700b2a4dc039f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-12 06:24:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-12 06:25:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:25:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-12 06:36:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00a1700b2a4dc039f,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:25:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.107,},NodeAddress{Type:ExternalIP,Address:99.79.69.225,},NodeAddress{Type:InternalDNS,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-69-225.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2aefdb0e1836236784b773a0de1726,SystemUUID:ec2aefdb-0e18-3623-6784-b773a0de1726,BootID:efa2d6a5-f933-4174-9d1e-f2c2ada73f29,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451206,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42803449,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967343,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:41:00.456: INFO: 
Logging kubelet events for node i-00a1700b2a4dc039f
Jan 12 06:41:00.492: INFO: 
Logging pods the kubelet thinks is on node i-00a1700b2a4dc039f
Jan 12 06:41:00.532: INFO: aws-cloud-controller-manager-vj4cr started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.532: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 12 06:41:00.532: INFO: etcd-manager-events-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.532: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:41:00.532: INFO: etcd-manager-main-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.532: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:41:00.532: INFO: kube-apiserver-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:41:00.532: INFO: 	Container healthcheck ready: true, restart count 0
Jan 12 06:41:00.532: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 12 06:41:00.532: INFO: kube-scheduler-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.532: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 12 06:41:00.532: INFO: cilium-f68z5 started at 2023-01-12 06:25:04 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:41:00.532: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:41:00.532: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:41:00.532: INFO: dns-controller-69987775c6-n2lqn started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.532: INFO: 	Container dns-controller ready: true, restart count 0
Jan 12 06:41:00.532: INFO: cilium-operator-5dd44dc49f-zvdwf started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.532: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 12 06:41:00.532: INFO: kube-controller-manager-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.532: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 12 06:41:00.533: INFO: ebs-csi-node-vtl8h started at 2023-01-12 06:25:04 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:41:00.533: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:41:00.533: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:41:00.533: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:41:00.533: INFO: ebs-csi-controller-5bd98b456f-s56qb started at 2023-01-12 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 12 06:41:00.533: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:41:00.533: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:41:00.533: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 12 06:41:00.533: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:41:00.533: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:41:00.533: INFO: kops-controller-h6cd7 started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.533: INFO: 	Container kops-controller ready: true, restart count 0
Jan 12 06:41:00.699: INFO: 
Latency metrics for node i-00a1700b2a4dc039f
Jan 12 06:41:00.699: INFO: 
Logging node info for node i-01ebb116de9e964dc
Jan 12 06:41:00.730: INFO: Node Info: &Node{ObjectMeta:{i-01ebb116de9e964dc    9bba0dc4-469e-4f38-b41b-aa672131ad87 18325 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01ebb116de9e964dc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01ebb116de9e964dc topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.44 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01ebb116de9e964dc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:40:46 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-12 06:40:46 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01ebb116de9e964dc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:46 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:46 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:46 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:40:46 +0000 UTC,LastTransitionTime:2023-01-12 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.44,},NodeAddress{Type:ExternalIP,Address:3.99.142.186,},NodeAddress{Type:InternalDNS,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-142-186.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec264bf9915ff9f6f2894d5911a8df83,SystemUUID:ec264bf9-915f-f9f6-f289-4d5911a8df83,BootID:00d4d8a1-d87c-4c57-bee6-69bb72398b91,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0a8f30cd8b848c7b2],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0a8f30cd8b848c7b2,DevicePath:,},},Config:nil,},}
Jan 12 06:41:00.731: INFO: 
Logging kubelet events for node i-01ebb116de9e964dc
Jan 12 06:41:00.764: INFO: 
Logging pods the kubelet thinks is on node i-01ebb116de9e964dc
Jan 12 06:41:00.804: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-q9c9s started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.804: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.804: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-9j6sw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.804: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.804: INFO: httpd started at 2023-01-12 06:37:19 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.804: INFO: 	Container httpd ready: false, restart count 0
Jan 12 06:41:00.804: INFO: sysctl-768ebc0f-0f71-430e-9df7-6aaeed1048d0 started at 2023-01-12 06:36:26 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.804: INFO: 	Container test-container ready: false, restart count 0
Jan 12 06:41:00.804: INFO: rand-non-local-gzghw started at 2023-01-12 06:35:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.804: INFO: 	Container c ready: false, restart count 0
Jan 12 06:41:00.804: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bvnhn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.804: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.804: INFO: verify-service-up-exec-pod-rlmgx started at 2023-01-12 06:37:07 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.804: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 12 06:41:00.805: INFO: ebs-csi-node-bvknd started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:41:00.805: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:41:00.805: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:41:00.805: INFO: up-down-2-766bd started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container up-down-2 ready: true, restart count 0
Jan 12 06:41:00.805: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kfdmq started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.805: INFO: externalname-service-nclch started at 2023-01-12 06:35:49 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container externalname-service ready: true, restart count 0
Jan 12 06:41:00.805: INFO: up-down-1-w9s7j started at 2023-01-12 06:35:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container up-down-1 ready: true, restart count 0
Jan 12 06:41:00.805: INFO: rand-non-local-flpwd started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container c ready: false, restart count 0
Jan 12 06:41:00.805: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-97p2z started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:41:00.805: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-mfrbf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.805: INFO: cilium-b5cfc started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:41:00.805: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:41:00.805: INFO: downward-api-8a5f93e4-4779-4ea5-af67-a3cbe3ffed2d started at 2023-01-12 06:40:33 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container dapi-container ready: false, restart count 0
Jan 12 06:41:00.805: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-z8qq5 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:41:00.805: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-5pqpn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.805: INFO: test-rolling-update-with-lb-56d9b65d4c-fppl4 started at 2023-01-12 06:35:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:41:00.805: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-nwxqm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:00.805: INFO: pod-91f7acff-e88b-46ac-b71d-8d86ccb55d48 started at 2023-01-12 06:37:17 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container write-pod ready: false, restart count 0
Jan 12 06:41:00.805: INFO: pod-0 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:41:00.805: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-js9bn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:00.805: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.049: INFO: 
Latency metrics for node i-01ebb116de9e964dc
Jan 12 06:41:01.049: INFO: 
Logging node info for node i-0b95e3cb438ca1933
Jan 12 06:41:01.080: INFO: Node Info: &Node{ObjectMeta:{i-0b95e3cb438ca1933    410c9a77-76a5-49fd-81d8-dcf127193ecf 18469 0 2023-01-12 06:26:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b95e3cb438ca1933 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0b95e3cb438ca1933 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.177 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0b95e3cb438ca1933"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:40:51 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-12 06:40:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0b95e3cb438ca1933,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:52 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:52 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:52 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:40:52 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.177,},NodeAddress{Type:ExternalIP,Address:99.79.51.51,},NodeAddress{Type:InternalDNS,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-51-51.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23cc76a58199e94cb916e26a0dbdd4,SystemUUID:ec23cc76-a581-99e9-4cb9-16e26a0dbdd4,BootID:769bca70-45b1-4d4c-82b2-ff7e3a4f99ff,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-0ac51d4255eea1878],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0ac51d4255eea1878,DevicePath:,},},Config:nil,},}
Jan 12 06:41:01.081: INFO: 
Logging kubelet events for node i-0b95e3cb438ca1933
Jan 12 06:41:01.115: INFO: 
Logging pods the kubelet thinks is on node i-0b95e3cb438ca1933
Jan 12 06:41:01.166: INFO: pod-1 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:41:01.166: INFO: inline-volume-tester-nhjm6 started at 2023-01-12 06:40:49 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 12 06:41:01.166: INFO: kube-proxy-mode-detector started at 2023-01-12 06:40:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:41:01.166: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-7xqlb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.166: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-2j6p9 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.166: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b6bbr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.166: INFO: pod-host-path-test started at 2023-01-12 06:40:45 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container test-container-1 ready: false, restart count 0
Jan 12 06:41:01.166: INFO: 	Container test-container-2 ready: false, restart count 0
Jan 12 06:41:01.166: INFO: hostexec-i-0b95e3cb438ca1933-sttpl started at 2023-01-12 06:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:41:01.166: INFO: up-down-2-265s2 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container up-down-2 ready: true, restart count 0
Jan 12 06:41:01.166: INFO: csi-mockplugin-attacher-0 started at 2023-01-12 06:38:21 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:41:01.166: INFO: test-rolling-update-with-lb-56d9b65d4c-866wj started at 2023-01-12 06:35:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:41:01.166: INFO: fail-once-non-local-w64vm started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container c ready: false, restart count 0
Jan 12 06:41:01.166: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dqrr9 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.166: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-gtbjw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.166: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4sqlp started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:41:01.166: INFO: fail-once-non-local-l62nm started at 2023-01-12 06:35:21 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container c ready: false, restart count 0
Jan 12 06:41:01.166: INFO: pod-configmaps-085510c8-09ee-4f9d-a395-d462020dcfcf started at 2023-01-12 06:35:43 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 12 06:41:01.166: INFO: 	Container configmap-volume-binary-test ready: false, restart count 0
Jan 12 06:41:01.166: INFO: externalname-service-pbv8g started at 2023-01-12 06:35:49 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container externalname-service ready: false, restart count 0
Jan 12 06:41:01.166: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-wnxfm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:41:01.166: INFO: up-down-1-n4tsw started at 2023-01-12 06:35:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container up-down-1 ready: true, restart count 0
Jan 12 06:41:01.166: INFO: ebs-csi-node-x6qtj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:41:01.166: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:41:01.166: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:41:01.166: INFO: csi-mockplugin-0 started at 2023-01-12 06:38:21 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:41:01.166: INFO: 	Container driver-registrar ready: false, restart count 0
Jan 12 06:41:01.166: INFO: 	Container mock ready: false, restart count 0
Jan 12 06:41:01.166: INFO: test-rolling-update-with-lb-85b8b59c8c-rdnwt started at 2023-01-12 06:38:11 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container agnhost ready: false, restart count 0
Jan 12 06:41:01.166: INFO: hairpin started at 2023-01-12 06:40:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 12 06:41:01.166: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vp5q6 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.166: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k9rkg started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:41:01.166: INFO: cilium-l6rqm started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:41:01.166: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:41:01.166: INFO: fail-once-non-local-vcv58 started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container c ready: false, restart count 0
Jan 12 06:41:01.166: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-27f6c started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.166: INFO: fail-once-non-local-h8qrp started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container c ready: false, restart count 0
Jan 12 06:41:01.166: INFO: my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a-k978j started at 2023-01-12 06:35:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container my-hostname-basic-41a19caa-b1dd-4bfa-9487-68b907c3661a ready: false, restart count 0
Jan 12 06:41:01.166: INFO: verify-service-up-host-exec-pod started at 2023-01-12 06:37:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:41:01.166: INFO: fail-once-non-local-p94zd started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.166: INFO: 	Container c ready: false, restart count 0
Jan 12 06:41:01.354: INFO: 
Latency metrics for node i-0b95e3cb438ca1933
Jan 12 06:41:01.354: INFO: 
Logging node info for node i-0bcea138229cdd410
Jan 12 06:41:01.386: INFO: Node Info: &Node{ObjectMeta:{i-0bcea138229cdd410    95f2bbd5-be1b-44e9-a59a-66f87015f9d2 18244 0 2023-01-12 06:26:24 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bcea138229cdd410 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0bcea138229cdd410 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.32.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bcea138229cdd410"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:40:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0bcea138229cdd410,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.32.113,},NodeAddress{Type:ExternalIP,Address:35.182.71.1,},NodeAddress{Type:InternalDNS,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-71-1.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21ffd1efd1b61b9def5afc88b88dba,SystemUUID:ec21ffd1-efd1-b61b-9def-5afc88b88dba,BootID:65b83838-2717-4c2d-8957-6fdcb4152c24,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:41:01.386: INFO: 
Logging kubelet events for node i-0bcea138229cdd410
Jan 12 06:41:01.419: INFO: 
Logging pods the kubelet thinks is on node i-0bcea138229cdd410
Jan 12 06:41:01.461: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6ngxj started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.461: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kd57q started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.461: INFO: hostexec-i-0bcea138229cdd410-j7qft started at 2023-01-12 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:41:01.461: INFO: ebs-csi-node-g2mwj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:41:01.461: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:41:01.461: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:41:01.461: INFO: hostexec-i-0bcea138229cdd410-hx972 started at 2023-01-12 06:40:53 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:41:01.461: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6blc8 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.461: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vxhrc started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.461: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dxzmh started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.461: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6p5qk started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.461: INFO: cilium-q5hq4 started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:41:01.461: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:41:01.461: INFO: coredns-autoscaler-7cb5c5b969-lzjqb started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container autoscaler ready: true, restart count 0
Jan 12 06:41:01.461: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b9cmz started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.461: INFO: coredns-559769c974-z5pf2 started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:41:01.461: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bg28w started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:41:01.461: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-h6kb8 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.461: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-8zhgf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:41:01.461: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:37:34 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:41:01.461: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 12 06:41:01.461: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:41:01.461: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 12 06:41:01.461: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 12 06:41:01.461: INFO: 	Container hostpath ready: false, restart count 0
Jan 12 06:41:01.461: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 12 06:41:01.461: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 12 06:41:01.645: INFO: 
Latency metrics for node i-0bcea138229cdd410
[DeferCleanup (Each)] [sig-apps] ReplicationController
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "replication-controller-357" for this suite. �[38;5;243m01/12/23 06:41:01.645�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-cli] Kubectl client Kubectl copy should copy a file from a running Pod 5m3s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sKubectl\scopy\sshould\scopy\sa\sfile\sfrom\sa\srunning\sPod$'

test/e2e/kubectl/kubectl.go:1537
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.22.1()
	test/e2e/kubectl/kubectl.go:1537 +0x205
				[BeforeEach] [sig-cli] Kubectl client
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/12/23 06:43:06.117�[0m
Jan 12 06:43:06.117: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/12/23 06:43:06.118�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/12/23 06:43:06.211�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/12/23 06:43:06.272�[0m
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/kubectl/kubectl.go:274
[BeforeEach] Kubectl copy
  test/e2e/kubectl/kubectl.go:1533
�[1mSTEP:�[0m creating the pod �[38;5;243m01/12/23 06:43:06.333�[0m
Jan 12 06:43:06.333: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1b203a2f-9241-11ed-901d-e2a8de243d6a/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-8576 create -f -'
Jan 12 06:43:07.073: INFO: stderr: ""
Jan 12 06:43:07.073: INFO: stdout: "pod/busybox1 created\n"
Jan 12 06:43:07.073: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [busybox1]
Jan 12 06:43:07.073: INFO: Waiting up to 5m0s for pod "busybox1" in namespace "kubectl-8576" to be "running and ready"
Jan 12 06:43:07.103: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 30.714129ms
Jan 12 06:43:07.103: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:09.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062306937s
Jan 12 06:43:09.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:11.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4.062564882s
Jan 12 06:43:11.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:13.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 6.06197344s
Jan 12 06:43:13.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:15.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 8.062664866s
Jan 12 06:43:15.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:17.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 10.062188718s
Jan 12 06:43:17.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:19.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 12.061955967s
Jan 12 06:43:19.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:21.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 14.063098996s
Jan 12 06:43:21.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:23.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 16.062239667s
Jan 12 06:43:23.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:25.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 18.062348312s
Jan 12 06:43:25.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:27.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 20.062391677s
Jan 12 06:43:27.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:29.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 22.062281617s
Jan 12 06:43:29.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:31.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 24.062210653s
Jan 12 06:43:31.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:33.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 26.062231343s
Jan 12 06:43:33.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:35.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 28.062524297s
Jan 12 06:43:35.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:37.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 30.062319481s
Jan 12 06:43:37.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:39.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 32.062598074s
Jan 12 06:43:39.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:41.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 34.061832312s
Jan 12 06:43:41.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:43.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 36.062401276s
Jan 12 06:43:43.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:45.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 38.062594286s
Jan 12 06:43:45.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:47.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 40.062923706s
Jan 12 06:43:47.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:49.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 42.062031561s
Jan 12 06:43:49.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:51.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 44.062357318s
Jan 12 06:43:51.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:53.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 46.062494175s
Jan 12 06:43:53.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:55.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 48.06184103s
Jan 12 06:43:55.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:57.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 50.062462669s
Jan 12 06:43:57.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:43:59.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 52.062582361s
Jan 12 06:43:59.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:01.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 54.062502456s
Jan 12 06:44:01.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:03.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 56.06240289s
Jan 12 06:44:03.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:05.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 58.06215616s
Jan 12 06:44:05.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:07.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.062754057s
Jan 12 06:44:07.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:09.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.062260583s
Jan 12 06:44:09.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:11.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.062633664s
Jan 12 06:44:11.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:13.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.06218241s
Jan 12 06:44:13.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:15.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.062537654s
Jan 12 06:44:15.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:17.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.062213765s
Jan 12 06:44:17.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:19.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.062527122s
Jan 12 06:44:19.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:21.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.06207672s
Jan 12 06:44:21.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:23.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.062256478s
Jan 12 06:44:23.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:25.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.062383065s
Jan 12 06:44:25.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:27.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.062167218s
Jan 12 06:44:27.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:29.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.062151735s
Jan 12 06:44:29.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:31.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.062975271s
Jan 12 06:44:31.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:33.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.062331316s
Jan 12 06:44:33.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:35.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.062050389s
Jan 12 06:44:35.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:37.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.062642241s
Jan 12 06:44:37.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:39.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.062284212s
Jan 12 06:44:39.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:41.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.06212466s
Jan 12 06:44:41.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:43.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.062379055s
Jan 12 06:44:43.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:45.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.062152466s
Jan 12 06:44:45.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:47.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.062878933s
Jan 12 06:44:47.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:49.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.062463969s
Jan 12 06:44:49.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:51.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.062153959s
Jan 12 06:44:51.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:53.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.062402539s
Jan 12 06:44:53.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:55.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.062883443s
Jan 12 06:44:55.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:57.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.063286025s
Jan 12 06:44:57.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:44:59.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.062739685s
Jan 12 06:44:59.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:01.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.06197146s
Jan 12 06:45:01.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:03.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.062169699s
Jan 12 06:45:03.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:05.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.062463031s
Jan 12 06:45:05.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:07.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.062052377s
Jan 12 06:45:07.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:09.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.062580259s
Jan 12 06:45:09.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:11.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.063201394s
Jan 12 06:45:11.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:13.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.063800494s
Jan 12 06:45:13.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:15.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.063398688s
Jan 12 06:45:15.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:17.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.062961059s
Jan 12 06:45:17.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:19.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.062944545s
Jan 12 06:45:19.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:21.138: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.065290438s
Jan 12 06:45:21.138: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:23.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.063780397s
Jan 12 06:45:23.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:25.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.063298638s
Jan 12 06:45:25.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:27.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.063006502s
Jan 12 06:45:27.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:29.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.062918306s
Jan 12 06:45:29.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:31.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.063857508s
Jan 12 06:45:31.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:33.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.062849677s
Jan 12 06:45:33.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:35.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.062361961s
Jan 12 06:45:35.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:37.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.062262186s
Jan 12 06:45:37.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:39.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.062681176s
Jan 12 06:45:39.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:41.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.062929457s
Jan 12 06:45:41.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:43.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.064079707s
Jan 12 06:45:43.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:45.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.06319633s
Jan 12 06:45:45.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:47.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.06426541s
Jan 12 06:45:47.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:49.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.06270384s
Jan 12 06:45:49.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:51.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.063252037s
Jan 12 06:45:51.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:53.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.062770414s
Jan 12 06:45:53.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:55.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.063652982s
Jan 12 06:45:55.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:57.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.063201469s
Jan 12 06:45:57.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:45:59.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.06275715s
Jan 12 06:45:59.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:01.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.062020654s
Jan 12 06:46:01.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:03.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.063686473s
Jan 12 06:46:03.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:05.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.063798796s
Jan 12 06:46:05.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:07.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.063556492s
Jan 12 06:46:07.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:09.141: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.068634292s
Jan 12 06:46:09.141: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:11.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.063315231s
Jan 12 06:46:11.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:13.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.064351202s
Jan 12 06:46:13.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:15.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.06300654s
Jan 12 06:46:15.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:17.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.062748518s
Jan 12 06:46:17.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:19.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.063313956s
Jan 12 06:46:19.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:21.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.06445773s
Jan 12 06:46:21.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:23.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.062431651s
Jan 12 06:46:23.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:25.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.063422684s
Jan 12 06:46:25.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:27.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.063226982s
Jan 12 06:46:27.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:29.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.062982749s
Jan 12 06:46:29.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:31.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.063144493s
Jan 12 06:46:31.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:33.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.062569111s
Jan 12 06:46:33.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:35.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.063682376s
Jan 12 06:46:35.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:37.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.063080149s
Jan 12 06:46:37.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:39.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.063843776s
Jan 12 06:46:39.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:41.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.062222851s
Jan 12 06:46:41.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:43.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.063688411s
Jan 12 06:46:43.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:45.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.062265535s
Jan 12 06:46:45.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:47.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.062811716s
Jan 12 06:46:47.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:49.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.062847542s
Jan 12 06:46:49.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:51.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.063345897s
Jan 12 06:46:51.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:53.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.063807735s
Jan 12 06:46:53.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:55.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.063316113s
Jan 12 06:46:55.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:57.140: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.067351825s
Jan 12 06:46:57.140: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:46:59.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.063299178s
Jan 12 06:46:59.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:01.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.06285603s
Jan 12 06:47:01.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:03.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.063536787s
Jan 12 06:47:03.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:05.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.063856785s
Jan 12 06:47:05.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:07.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.062644006s
Jan 12 06:47:07.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:09.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.063483274s
Jan 12 06:47:09.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:11.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.063199487s
Jan 12 06:47:11.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:13.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.063142454s
Jan 12 06:47:13.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:15.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.062691898s
Jan 12 06:47:15.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:17.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.063526836s
Jan 12 06:47:17.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:19.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.062967594s
Jan 12 06:47:19.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:21.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.063964126s
Jan 12 06:47:21.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:23.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.063152289s
Jan 12 06:47:23.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:25.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.06321027s
Jan 12 06:47:25.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:27.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.063024067s
Jan 12 06:47:27.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:29.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.063391893s
Jan 12 06:47:29.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:31.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.063791284s
Jan 12 06:47:31.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:33.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.063378531s
Jan 12 06:47:33.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:35.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.06420306s
Jan 12 06:47:35.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:37.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.062586306s
Jan 12 06:47:37.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:39.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.062383324s
Jan 12 06:47:39.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:41.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.062947019s
Jan 12 06:47:41.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:43.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.062463814s
Jan 12 06:47:43.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:45.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.063373918s
Jan 12 06:47:45.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:47.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.063413706s
Jan 12 06:47:47.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:49.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.063358583s
Jan 12 06:47:49.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:51.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.062880523s
Jan 12 06:47:51.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:53.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.063200458s
Jan 12 06:47:53.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:55.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.063812111s
Jan 12 06:47:55.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:57.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.063299101s
Jan 12 06:47:57.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:47:59.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.063657113s
Jan 12 06:47:59.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:48:01.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.06399251s
Jan 12 06:48:01.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:48:03.137: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.063792594s
Jan 12 06:48:03.137: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:48:05.136: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.062935353s
Jan 12 06:48:05.136: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:48:07.135: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.06218077s
Jan 12 06:48:07.135: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:48:07.166: INFO: Pod "busybox1": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.093079922s
Jan 12 06:48:07.166: INFO: Error evaluating pod condition running and ready: want pod 'busybox1' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:48:07.166: INFO: Pod busybox1 failed to be running and ready.
Jan 12 06:48:07.166: INFO: Wanted all 1 pods to be running and ready. Result: false. Pods: [busybox1]
Jan 12 06:48:07.166: FAIL: Expected
    <bool>: false
to equal
    <bool>: true

Full Stack Trace
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.22.1()
	test/e2e/kubectl/kubectl.go:1537 +0x205
[AfterEach] Kubectl copy
  test/e2e/kubectl/kubectl.go:1539
�[1mSTEP:�[0m using delete to clean up resources �[38;5;243m01/12/23 06:48:07.166�[0m
Jan 12 06:48:07.166: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1b203a2f-9241-11ed-901d-e2a8de243d6a/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-8576 delete --grace-period=0 --force -f -'
Jan 12 06:48:07.492: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n"
Jan 12 06:48:07.492: INFO: stdout: "pod \"busybox1\" force deleted\n"
Jan 12 06:48:07.492: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1b203a2f-9241-11ed-901d-e2a8de243d6a/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-8576 get rc,svc -l app=busybox1 --no-headers'
Jan 12 06:48:07.823: INFO: stderr: "No resources found in kubectl-8576 namespace.\n"
Jan 12 06:48:07.823: INFO: stdout: ""
Jan 12 06:48:07.823: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1b203a2f-9241-11ed-901d-e2a8de243d6a/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-8576 get pods -l app=busybox1 -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}'
Jan 12 06:48:08.113: INFO: stderr: ""
Jan 12 06:48:08.113: INFO: stdout: ""
[AfterEach] [sig-cli] Kubectl client
  test/e2e/framework/node/init/init.go:32
Jan 12 06:48:08.113: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl client
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/12/23 06:48:08.145�[0m
�[1mSTEP:�[0m Collecting events from namespace "kubectl-8576". �[38;5;243m01/12/23 06:48:08.145�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/12/23 06:48:08.177�[0m
Jan 12 06:48:08.177: INFO: At 2023-01-12 06:43:07 +0000 UTC - event for busybox1: {default-scheduler } Scheduled: Successfully assigned kubectl-8576/busybox1 to i-01ebb116de9e964dc
Jan 12 06:48:08.177: INFO: At 2023-01-12 06:43:07 +0000 UTC - event for busybox1: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4a94a84600b62014cae7a1f8163af3f944b7e9dee5054f7e14283c8edda667f9": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:48:08.177: INFO: At 2023-01-12 06:43:22 +0000 UTC - event for busybox1: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9b6ca6a51790648b5da51b57db710e8560b324dae5ba5557ebadcf3a9fe817eb": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:48:08.177: INFO: At 2023-01-12 06:43:37 +0000 UTC - event for busybox1: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d10c8c9c690fcb2839f304b18a5ccf6d593ca9422d412052aedef91ce2ad6868": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:48:08.177: INFO: At 2023-01-12 06:43:51 +0000 UTC - event for busybox1: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b6e299f18731e64d63ee97696e38ba1770657465199f9a28a94310fd0e10fab1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:48:08.177: INFO: At 2023-01-12 06:44:03 +0000 UTC - event for busybox1: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1a48b75c591a9a63a3720ea6469468bdd11ead2ac17f7e14e1a5b85a5009522b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:48:08.177: INFO: At 2023-01-12 06:44:15 +0000 UTC - event for busybox1: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d90f58c3d4906a8ce6d026484dd4d977695f67f1a9f39bee24854aa54dfa7ca5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:48:08.177: INFO: At 2023-01-12 06:44:28 +0000 UTC - event for busybox1: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5ad90be8c3215ea1258528480d1f78cd742916c7f3b7c3e2ca03464b1b4b57df": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:48:08.177: INFO: At 2023-01-12 06:44:41 +0000 UTC - event for busybox1: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6b22d62539e25486a6cff446d8c006e4ad88b3f06f527858ca6b44c1bdb9d537": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:48:08.177: INFO: At 2023-01-12 06:44:55 +0000 UTC - event for busybox1: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "15dd1b901785b95a505bc5f73ce188f206f4b5f00f2fe56e76eea23bd248519b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:48:08.177: INFO: At 2023-01-12 06:45:07 +0000 UTC - event for busybox1: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "04118e6230fe197f4a305328c023744d3f3d05fbfd37bc6e31ca473887dea690": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:48:08.207: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 12 06:48:08.207: INFO: 
Jan 12 06:48:08.241: INFO: 
Logging node info for node i-0029a94fa7f902ab5
Jan 12 06:48:08.273: INFO: Node Info: &Node{ObjectMeta:{i-0029a94fa7f902ab5    086bb9cc-b77b-48db-a8ae-537b7cbf6e36 22328 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0029a94fa7f902ab5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0029a94fa7f902ab5 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.235 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0029a94fa7f902ab5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:48:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0029a94fa7f902ab5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:48:08 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:48:08 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:48:08 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:48:08 +0000 UTC,LastTransitionTime:2023-01-12 06:26:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.235,},NodeAddress{Type:ExternalIP,Address:15.222.254.31,},NodeAddress{Type:InternalDNS,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-254-31.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2680cab44fba5db711d741fbe294e7,SystemUUID:ec2680ca-b44f-ba5d-b711-d741fbe294e7,BootID:01f1463d-4c68-4aa0-8900-0499980b4f60,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:48:08.273: INFO: 
Logging kubelet events for node i-0029a94fa7f902ab5
Jan 12 06:48:08.306: INFO: 
Logging pods the kubelet thinks is on node i-0029a94fa7f902ab5
Jan 12 06:48:08.350: INFO: hostexec-i-0029a94fa7f902ab5-bwdb7 started at 2023-01-12 06:42:26 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:48:08.350: INFO: hostexec-i-0029a94fa7f902ab5-c4sjv started at 2023-01-12 06:47:51 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:48:08.350: INFO: pod-cec7cf8a-f7ee-4560-a85b-35d159e83ca6 started at 2023-01-12 06:47:54 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container write-pod ready: false, restart count 0
Jan 12 06:48:08.350: INFO: cilium-v2fq9 started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:48:08.350: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:48:08.350: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ds9hr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.350: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-798lx started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.350: INFO: ebs-csi-node-wfgs2 started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:48:08.350: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:48:08.350: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:48:08.350: INFO: hostexec-i-0029a94fa7f902ab5-l6bg6 started at 2023-01-12 06:47:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:48:08.350: INFO: pod-subpath-test-preprovisionedpv-kgb2 started at 2023-01-12 06:43:09 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container test-container-subpath-preprovisionedpv-kgb2 ready: false, restart count 0
Jan 12 06:48:08.350: INFO: rs-bxvdw started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container donothing ready: true, restart count 0
Jan 12 06:48:08.350: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4c699 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.350: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-jrdnf started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.350: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-tm86v started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.350: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-krdq2 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.350: INFO: coredns-559769c974-p2fts started at 2023-01-12 06:27:03 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:48:08.350: INFO: pod-ea16f487-c120-41d8-8fe0-837471e51980 started at 2023-01-12 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container write-pod ready: false, restart count 0
Jan 12 06:48:08.350: INFO: hostexec-i-0029a94fa7f902ab5-tsxwm started at 2023-01-12 06:45:49 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:48:08.350: INFO: exec-volume-test-preprovisionedpv-x45t started at 2023-01-12 06:46:05 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container exec-container-preprovisionedpv-x45t ready: false, restart count 0
Jan 12 06:48:08.350: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-w5hzb started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.350: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-qdh5s started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.350: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k5j26 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.350: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ccxfb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.350: INFO: rs-82mlf started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.350: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:48:08.584: INFO: 
Latency metrics for node i-0029a94fa7f902ab5
Jan 12 06:48:08.584: INFO: 
Logging node info for node i-00a1700b2a4dc039f
Jan 12 06:48:08.617: INFO: Node Info: &Node{ObjectMeta:{i-00a1700b2a4dc039f    31b14f9e-702c-4bf4-8b4f-160f1e8d2e78 21874 0 2023-01-12 06:24:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00a1700b2a4dc039f kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.107 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00a1700b2a4dc039f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-12 06:24:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-12 06:25:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:25:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-12 06:47:06 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00a1700b2a4dc039f,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:06 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:06 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:06 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:47:06 +0000 UTC,LastTransitionTime:2023-01-12 06:25:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.107,},NodeAddress{Type:ExternalIP,Address:99.79.69.225,},NodeAddress{Type:InternalDNS,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-69-225.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2aefdb0e1836236784b773a0de1726,SystemUUID:ec2aefdb-0e18-3623-6784-b773a0de1726,BootID:efa2d6a5-f933-4174-9d1e-f2c2ada73f29,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451206,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42803449,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967343,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:48:08.617: INFO: 
Logging kubelet events for node i-00a1700b2a4dc039f
Jan 12 06:48:08.651: INFO: 
Logging pods the kubelet thinks is on node i-00a1700b2a4dc039f
Jan 12 06:48:08.691: INFO: cilium-f68z5 started at 2023-01-12 06:25:04 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:48:08.691: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:48:08.691: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:48:08.691: INFO: dns-controller-69987775c6-n2lqn started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.691: INFO: 	Container dns-controller ready: true, restart count 0
Jan 12 06:48:08.691: INFO: cilium-operator-5dd44dc49f-zvdwf started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.691: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 12 06:48:08.691: INFO: aws-cloud-controller-manager-vj4cr started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.691: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 12 06:48:08.691: INFO: etcd-manager-events-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.691: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:48:08.691: INFO: etcd-manager-main-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.691: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:48:08.691: INFO: kube-apiserver-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:48:08.691: INFO: 	Container healthcheck ready: true, restart count 0
Jan 12 06:48:08.691: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 12 06:48:08.691: INFO: kube-scheduler-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.691: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 12 06:48:08.691: INFO: kube-controller-manager-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.691: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 12 06:48:08.691: INFO: ebs-csi-node-vtl8h started at 2023-01-12 06:25:04 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:48:08.691: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:48:08.691: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:48:08.691: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:48:08.691: INFO: ebs-csi-controller-5bd98b456f-s56qb started at 2023-01-12 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 12 06:48:08.691: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:48:08.691: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:48:08.691: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 12 06:48:08.691: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:48:08.691: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:48:08.692: INFO: kops-controller-h6cd7 started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.692: INFO: 	Container kops-controller ready: true, restart count 0
Jan 12 06:48:08.871: INFO: 
Latency metrics for node i-00a1700b2a4dc039f
Jan 12 06:48:08.871: INFO: 
Logging node info for node i-01ebb116de9e964dc
Jan 12 06:48:08.902: INFO: Node Info: &Node{ObjectMeta:{i-01ebb116de9e964dc    9bba0dc4-469e-4f38-b41b-aa672131ad87 21645 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01ebb116de9e964dc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01ebb116de9e964dc topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.44 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01ebb116de9e964dc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:46:33 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01ebb116de9e964dc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:46:33 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:46:33 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:46:33 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:46:33 +0000 UTC,LastTransitionTime:2023-01-12 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.44,},NodeAddress{Type:ExternalIP,Address:3.99.142.186,},NodeAddress{Type:InternalDNS,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-142-186.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec264bf9915ff9f6f2894d5911a8df83,SystemUUID:ec264bf9-915f-f9f6-f289-4d5911a8df83,BootID:00d4d8a1-d87c-4c57-bee6-69bb72398b91,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:48:08.903: INFO: 
Logging kubelet events for node i-01ebb116de9e964dc
Jan 12 06:48:08.936: INFO: 
Logging pods the kubelet thinks is on node i-01ebb116de9e964dc
Jan 12 06:48:08.984: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-5pqpn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.984: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-nwxqm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.984: INFO: rs-7sf6x started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:48:08.984: INFO: webserver-778cd87d5b-7jsl5 started at 2023-01-12 06:47:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container httpd ready: false, restart count 0
Jan 12 06:48:08.984: INFO: fail-once-local-mv5qs started at 2023-01-12 06:46:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container c ready: false, restart count 0
Jan 12 06:48:08.984: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-js9bn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.984: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-q9c9s started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.984: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-9j6sw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.984: INFO: rs-867mv started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container donothing ready: true, restart count 0
Jan 12 06:48:08.984: INFO: fail-once-local-htmdf started at 2023-01-12 06:46:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container c ready: false, restart count 0
Jan 12 06:48:08.984: INFO: rand-non-local-gzghw started at 2023-01-12 06:35:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container c ready: false, restart count 0
Jan 12 06:48:08.984: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bvnhn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.984: INFO: webserver-pod started at 2023-01-12 06:46:22 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container agnhost ready: false, restart count 0
Jan 12 06:48:08.984: INFO: termination-message-container7b894dd6-f82b-4520-9a82-ad0d900c7699 started at 2023-01-12 06:46:10 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container termination-message-container ready: false, restart count 0
Jan 12 06:48:08.984: INFO: ebs-csi-node-bvknd started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:48:08.984: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:48:08.984: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:48:08.984: INFO: rs-5hrnk started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container donothing ready: true, restart count 0
Jan 12 06:48:08.984: INFO: webserver-6d4b8f66f8-gmhds started at 2023-01-12 06:46:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container httpd ready: false, restart count 0
Jan 12 06:48:08.984: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kfdmq started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.984: INFO: rand-non-local-flpwd started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container c ready: false, restart count 0
Jan 12 06:48:08.984: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-97p2z started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.984: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-mfrbf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:08.984: INFO: cilium-b5cfc started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:48:08.984: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:48:08.984: INFO: ss2-1 started at 2023-01-12 06:43:20 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container webserver ready: false, restart count 0
Jan 12 06:48:08.984: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-z8qq5 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:08.984: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.228: INFO: 
Latency metrics for node i-01ebb116de9e964dc
Jan 12 06:48:09.228: INFO: 
Logging node info for node i-0b95e3cb438ca1933
Jan 12 06:48:09.260: INFO: Node Info: &Node{ObjectMeta:{i-0b95e3cb438ca1933    410c9a77-76a5-49fd-81d8-dcf127193ecf 22182 0 2023-01-12 06:26:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b95e3cb438ca1933 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0b95e3cb438ca1933 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.177 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-9408":"i-0b95e3cb438ca1933","ebs.csi.aws.com":"i-0b95e3cb438ca1933"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:47:30 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status} {kube-controller-manager Update v1 2023-01-12 06:47:40 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0b95e3cb438ca1933,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:18 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:18 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:47:18 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:47:18 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.177,},NodeAddress{Type:ExternalIP,Address:99.79.51.51,},NodeAddress{Type:InternalDNS,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-51-51.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23cc76a58199e94cb916e26a0dbdd4,SystemUUID:ec23cc76-a581-99e9-4cb9-16e26a0dbdd4,BootID:769bca70-45b1-4d4c-82b2-ff7e3a4f99ff,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-9408^4b703937-9244-11ed-90ee-5a4921a595cd kubernetes.io/csi/ebs.csi.aws.com^vol-05ecc12fc3c9108e9],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-05ecc12fc3c9108e9,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-9408^4b703937-9244-11ed-90ee-5a4921a595cd,DevicePath:,},},Config:nil,},}
Jan 12 06:48:09.261: INFO: 
Logging kubelet events for node i-0b95e3cb438ca1933
Jan 12 06:48:09.295: INFO: 
Logging pods the kubelet thinks is on node i-0b95e3cb438ca1933
Jan 12 06:48:09.341: INFO: fail-once-non-local-vcv58 started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container c ready: false, restart count 0
Jan 12 06:48:09.341: INFO: webserver-778cd87d5b-cxrc7 started at 2023-01-12 06:46:52 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container httpd ready: true, restart count 0
Jan 12 06:48:09.341: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vp5q6 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.341: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k9rkg started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.341: INFO: cilium-l6rqm started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:48:09.341: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:48:09.341: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-27f6c started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.341: INFO: fail-once-non-local-p94zd started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container c ready: false, restart count 0
Jan 12 06:48:09.341: INFO: fail-once-non-local-h8qrp started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container c ready: false, restart count 0
Jan 12 06:48:09.341: INFO: hostexec-i-0b95e3cb438ca1933-m2cm7 started at 2023-01-12 06:46:34 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:48:09.341: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-7xqlb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.341: INFO: rs-qh54h started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:48:09.341: INFO: oidc-discovery-validator started at 2023-01-12 06:47:38 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container oidc-discovery-validator ready: false, restart count 0
Jan 12 06:48:09.341: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-2j6p9 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.341: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b6bbr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.341: INFO: pod-9b3963d4-4868-4645-b6f8-b227e904776f started at 2023-01-12 06:46:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container write-pod ready: false, restart count 0
Jan 12 06:48:09.341: INFO: hostexec-i-0b95e3cb438ca1933-khpg6 started at 2023-01-12 06:43:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:48:09.341: INFO: proxy-service-867gl-qt6l8 started at 2023-01-12 06:44:46 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container proxy-service-867gl ready: false, restart count 0
Jan 12 06:48:09.341: INFO: fail-once-non-local-w64vm started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container c ready: false, restart count 0
Jan 12 06:48:09.341: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dqrr9 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.341: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-gtbjw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.341: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4sqlp started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:48:09.341: INFO: fail-once-non-local-l62nm started at 2023-01-12 06:35:21 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container c ready: false, restart count 0
Jan 12 06:48:09.341: INFO: ss2-0 started at 2023-01-12 06:42:09 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container webserver ready: true, restart count 0
Jan 12 06:48:09.341: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-wnxfm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:48:09.341: INFO: rs-j5p6n started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container donothing ready: true, restart count 0
Jan 12 06:48:09.341: INFO: rs-kdm5p started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:48:09.341: INFO: pod-153238b0-9e98-4ea6-89af-a4d97bf91a29 started at 2023-01-12 06:43:16 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container write-pod ready: false, restart count 0
Jan 12 06:48:09.341: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:41:01 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:48:09.341: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:48:09.341: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 12 06:48:09.341: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 12 06:48:09.341: INFO: 	Container hostpath ready: true, restart count 0
Jan 12 06:48:09.341: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:48:09.341: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:48:09.341: INFO: pod-subpath-test-preprovisionedpv-zlls started at 2023-01-12 06:43:49 +0000 UTC (2+2 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Init container init-volume-preprovisionedpv-zlls ready: false, restart count 0
Jan 12 06:48:09.341: INFO: 	Init container test-init-subpath-preprovisionedpv-zlls ready: false, restart count 0
Jan 12 06:48:09.341: INFO: 	Container test-container-subpath-preprovisionedpv-zlls ready: false, restart count 0
Jan 12 06:48:09.341: INFO: 	Container test-container-volume-preprovisionedpv-zlls ready: false, restart count 0
Jan 12 06:48:09.341: INFO: pod-update-activedeadlineseconds-84c26f00-3af0-4d49-a6c1-0b2ec9b0dd8d started at 2023-01-12 06:46:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container pause ready: false, restart count 0
Jan 12 06:48:09.341: INFO: webserver-6d4b8f66f8-hx7ws started at 2023-01-12 06:46:23 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container httpd ready: false, restart count 0
Jan 12 06:48:09.341: INFO: pod-subpath-test-dynamicpv-csdk started at 2023-01-12 06:46:14 +0000 UTC (2+2 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Init container init-volume-dynamicpv-csdk ready: false, restart count 0
Jan 12 06:48:09.341: INFO: 	Init container test-init-subpath-dynamicpv-csdk ready: false, restart count 0
Jan 12 06:48:09.341: INFO: 	Container test-container-subpath-dynamicpv-csdk ready: false, restart count 0
Jan 12 06:48:09.341: INFO: 	Container test-container-volume-dynamicpv-csdk ready: false, restart count 0
Jan 12 06:48:09.341: INFO: ebs-csi-node-x6qtj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:48:09.341: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:48:09.341: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:48:09.341: INFO: test-ss-0 started at 2023-01-12 06:47:35 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container webserver ready: false, restart count 0
Jan 12 06:48:09.341: INFO: inline-volume-tester-xjgl9 started at 2023-01-12 06:42:34 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container csi-volume-tester ready: false, restart count 0
Jan 12 06:48:09.341: INFO: hostexec-i-0b95e3cb438ca1933-prc4l started at 2023-01-12 06:43:42 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.341: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:48:09.602: INFO: 
Latency metrics for node i-0b95e3cb438ca1933
Jan 12 06:48:09.602: INFO: 
Logging node info for node i-0bcea138229cdd410
Jan 12 06:48:09.633: INFO: Node Info: &Node{ObjectMeta:{i-0bcea138229cdd410    95f2bbd5-be1b-44e9-a59a-66f87015f9d2 20790 0 2023-01-12 06:26:24 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bcea138229cdd410 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0bcea138229cdd410 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.32.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bcea138229cdd410"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:45:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0bcea138229cdd410,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:45:40 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:45:40 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:45:40 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:45:40 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.32.113,},NodeAddress{Type:ExternalIP,Address:35.182.71.1,},NodeAddress{Type:InternalDNS,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-71-1.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21ffd1efd1b61b9def5afc88b88dba,SystemUUID:ec21ffd1-efd1-b61b-9def-5afc88b88dba,BootID:65b83838-2717-4c2d-8957-6fdcb4152c24,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:48:09.634: INFO: 
Logging kubelet events for node i-0bcea138229cdd410
Jan 12 06:48:09.667: INFO: 
Logging pods the kubelet thinks is on node i-0bcea138229cdd410
Jan 12 06:48:09.705: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6blc8 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.705: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vxhrc started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.705: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6ngxj started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.705: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kd57q started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.705: INFO: ebs-csi-node-g2mwj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:48:09.705: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:48:09.705: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:48:09.705: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b9cmz started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.705: INFO: rs-x4kpg started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:48:09.705: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dxzmh started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.705: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6p5qk started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.705: INFO: cilium-q5hq4 started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:48:09.705: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:48:09.705: INFO: coredns-autoscaler-7cb5c5b969-lzjqb started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container autoscaler ready: true, restart count 0
Jan 12 06:48:09.705: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bg28w started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.705: INFO: csi-mockplugin-0 started at 2023-01-12 06:46:19 +0000 UTC (0+4 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container busybox ready: false, restart count 0
Jan 12 06:48:09.705: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:48:09.705: INFO: 	Container driver-registrar ready: false, restart count 0
Jan 12 06:48:09.705: INFO: 	Container mock ready: false, restart count 0
Jan 12 06:48:09.705: INFO: coredns-559769c974-z5pf2 started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:48:09.705: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:43:00 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 12 06:48:09.705: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:48:09.705: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 12 06:48:09.705: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 12 06:48:09.705: INFO: 	Container hostpath ready: false, restart count 0
Jan 12 06:48:09.705: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 12 06:48:09.705: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 12 06:48:09.705: INFO: rs-rbvm4 started at 2023-01-12 06:42:24 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:48:09.705: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-h6kb8 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.705: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-8zhgf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:48:09.705: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:48:09.942: INFO: 
Latency metrics for node i-0bcea138229cdd410
[DeferCleanup (Each)] [sig-cli] Kubectl client
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "kubectl-8576" for this suite. �[38;5;243m01/12/23 06:48:09.943�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-cli] Kubectl client Simple pod should return command exit codes execing into a container with a failing command 5m3s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\sreturn\scommand\sexit\scodes\sexecing\sinto\sa\scontainer\swith\sa\sfailing\scommand$'

test/e2e/kubectl/kubectl.go:415
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.1()
	test/e2e/kubectl/kubectl.go:415 +0x245
				[BeforeEach] [sig-cli] Kubectl client
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/12/23 06:37:18.538�[0m
Jan 12 06:37:18.538: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/12/23 06:37:18.539�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/12/23 06:37:18.633�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/12/23 06:37:18.694�[0m
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-cli] Kubectl client
  test/e2e/kubectl/kubectl.go:274
[BeforeEach] Simple pod
  test/e2e/kubectl/kubectl.go:411
�[1mSTEP:�[0m creating the pod from apiVersion: v1
kind: Pod
metadata:
  name: httpd
  labels:
    name: httpd
spec:
  containers:
  - name: httpd
    image: registry.k8s.io/e2e-test-images/httpd:2.4.38-4
    ports:
    - containerPort: 80
    readinessProbe:
      httpGet:
        path: /
        port: 80
      initialDelaySeconds: 5
      timeoutSeconds: 5
 �[38;5;243m01/12/23 06:37:18.755�[0m
Jan 12 06:37:18.755: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1b203a2f-9241-11ed-901d-e2a8de243d6a/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-6584 create -f -'
Jan 12 06:37:19.690: INFO: stderr: ""
Jan 12 06:37:19.690: INFO: stdout: "pod/httpd created\n"
Jan 12 06:37:19.690: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd]
Jan 12 06:37:19.690: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-6584" to be "running and ready"
Jan 12 06:37:19.721: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 30.902569ms
Jan 12 06:37:19.721: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:21.755: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.064651112s
Jan 12 06:37:21.755: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:23.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.062351801s
Jan 12 06:37:23.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:25.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.062560062s
Jan 12 06:37:25.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:27.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.062551347s
Jan 12 06:37:27.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:29.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.062511292s
Jan 12 06:37:29.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:31.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.062781432s
Jan 12 06:37:31.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:33.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.062401933s
Jan 12 06:37:33.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:35.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.063223682s
Jan 12 06:37:35.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:37.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 18.062826963s
Jan 12 06:37:37.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:39.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 20.062130141s
Jan 12 06:37:39.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:41.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 22.06294051s
Jan 12 06:37:41.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:43.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 24.062701613s
Jan 12 06:37:43.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:45.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 26.062622288s
Jan 12 06:37:45.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:47.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 28.062335848s
Jan 12 06:37:47.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:49.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 30.062716616s
Jan 12 06:37:49.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:51.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 32.062821038s
Jan 12 06:37:51.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:53.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 34.062232906s
Jan 12 06:37:53.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:55.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 36.063033569s
Jan 12 06:37:55.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:57.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 38.062908921s
Jan 12 06:37:57.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:37:59.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 40.062538648s
Jan 12 06:37:59.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:01.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 42.062606642s
Jan 12 06:38:01.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:03.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 44.062713096s
Jan 12 06:38:03.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:05.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 46.062890036s
Jan 12 06:38:05.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:07.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 48.0628326s
Jan 12 06:38:07.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:09.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 50.063128861s
Jan 12 06:38:09.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:11.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 52.062580795s
Jan 12 06:38:11.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:13.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 54.062667335s
Jan 12 06:38:13.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:15.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 56.062305878s
Jan 12 06:38:15.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:17.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 58.061921835s
Jan 12 06:38:17.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:19.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.062848454s
Jan 12 06:38:19.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:21.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.063165872s
Jan 12 06:38:21.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:23.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.062876904s
Jan 12 06:38:23.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:25.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.062543803s
Jan 12 06:38:25.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:27.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.062972921s
Jan 12 06:38:27.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:29.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.062855639s
Jan 12 06:38:29.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:31.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.062909082s
Jan 12 06:38:31.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:33.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.062400616s
Jan 12 06:38:33.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:35.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.062978805s
Jan 12 06:38:35.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:37.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.062827987s
Jan 12 06:38:37.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:39.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.062609484s
Jan 12 06:38:39.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:41.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.062192882s
Jan 12 06:38:41.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:43.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.061981747s
Jan 12 06:38:43.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:45.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.063128147s
Jan 12 06:38:45.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:47.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.062467433s
Jan 12 06:38:47.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:49.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.062989972s
Jan 12 06:38:49.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:51.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.063445312s
Jan 12 06:38:51.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:53.756: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.065680322s
Jan 12 06:38:53.756: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:55.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.062802871s
Jan 12 06:38:55.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:57.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.062570519s
Jan 12 06:38:57.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:38:59.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.062663665s
Jan 12 06:38:59.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:01.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.062618325s
Jan 12 06:39:01.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:03.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.062813548s
Jan 12 06:39:03.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:05.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.062271917s
Jan 12 06:39:05.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:07.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.062923154s
Jan 12 06:39:07.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:09.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.062447724s
Jan 12 06:39:09.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:11.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.063006509s
Jan 12 06:39:11.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:13.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.062395496s
Jan 12 06:39:13.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:15.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.062685802s
Jan 12 06:39:15.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:17.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.06285432s
Jan 12 06:39:17.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:19.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.062736018s
Jan 12 06:39:19.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:21.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.063176057s
Jan 12 06:39:21.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:23.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.062574325s
Jan 12 06:39:23.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:25.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.06283999s
Jan 12 06:39:25.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:27.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.06238035s
Jan 12 06:39:27.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:29.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.06254721s
Jan 12 06:39:29.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:31.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.062545749s
Jan 12 06:39:31.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:33.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.062830435s
Jan 12 06:39:33.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:35.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.062902025s
Jan 12 06:39:35.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:37.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.062913883s
Jan 12 06:39:37.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:39.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.062799954s
Jan 12 06:39:39.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:41.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.063100126s
Jan 12 06:39:41.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:43.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.062679879s
Jan 12 06:39:43.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:45.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.062410674s
Jan 12 06:39:45.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:47.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.062233401s
Jan 12 06:39:47.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:49.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.063010164s
Jan 12 06:39:49.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:51.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.062824016s
Jan 12 06:39:51.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:53.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.062734197s
Jan 12 06:39:53.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:55.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.062072576s
Jan 12 06:39:55.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:57.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.063182863s
Jan 12 06:39:57.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:39:59.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.06309078s
Jan 12 06:39:59.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:01.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.062987807s
Jan 12 06:40:01.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:03.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.062963282s
Jan 12 06:40:03.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:05.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.062992507s
Jan 12 06:40:05.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:07.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.062301149s
Jan 12 06:40:07.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:09.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.062251333s
Jan 12 06:40:09.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:11.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.062514626s
Jan 12 06:40:11.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:13.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.062218511s
Jan 12 06:40:13.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:15.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.06275816s
Jan 12 06:40:15.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:17.755: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.064635935s
Jan 12 06:40:17.755: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:19.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.062721111s
Jan 12 06:40:19.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:21.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.063178289s
Jan 12 06:40:21.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:23.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.062588878s
Jan 12 06:40:23.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:25.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.062118237s
Jan 12 06:40:25.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:27.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.062478097s
Jan 12 06:40:27.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:29.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.062928675s
Jan 12 06:40:29.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:31.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.061999052s
Jan 12 06:40:31.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:33.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.062233059s
Jan 12 06:40:33.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:35.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.062569298s
Jan 12 06:40:35.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:37.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.062988269s
Jan 12 06:40:37.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:39.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.062133809s
Jan 12 06:40:39.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:41.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.062049602s
Jan 12 06:40:41.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:43.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.062598128s
Jan 12 06:40:43.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:45.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.062871564s
Jan 12 06:40:45.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:47.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.063067181s
Jan 12 06:40:47.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:49.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.063113086s
Jan 12 06:40:49.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:51.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.062668506s
Jan 12 06:40:51.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:53.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.06262329s
Jan 12 06:40:53.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:55.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.062899868s
Jan 12 06:40:55.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:57.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.062693588s
Jan 12 06:40:57.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:40:59.754: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.063574508s
Jan 12 06:40:59.754: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:01.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.062195963s
Jan 12 06:41:01.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:03.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.062784033s
Jan 12 06:41:03.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:05.757: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.067540032s
Jan 12 06:41:05.758: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:07.758: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.06822785s
Jan 12 06:41:07.758: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:09.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.06191228s
Jan 12 06:41:09.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:11.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.062442986s
Jan 12 06:41:11.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:13.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.062267213s
Jan 12 06:41:13.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:15.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.062886864s
Jan 12 06:41:15.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:17.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.062995437s
Jan 12 06:41:17.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:19.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.06245494s
Jan 12 06:41:19.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:21.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.062963079s
Jan 12 06:41:21.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:23.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.06305328s
Jan 12 06:41:23.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:25.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.062863906s
Jan 12 06:41:25.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:27.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.062920015s
Jan 12 06:41:27.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:29.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.062730602s
Jan 12 06:41:29.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:31.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.063188047s
Jan 12 06:41:31.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:33.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.062254345s
Jan 12 06:41:33.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:35.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.062750899s
Jan 12 06:41:35.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:37.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.062684148s
Jan 12 06:41:37.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:39.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.062258758s
Jan 12 06:41:39.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:41.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.062974962s
Jan 12 06:41:41.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:43.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.062983787s
Jan 12 06:41:43.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:45.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.062952964s
Jan 12 06:41:45.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:47.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.062654503s
Jan 12 06:41:47.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:49.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.062821602s
Jan 12 06:41:49.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:51.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.062725584s
Jan 12 06:41:51.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:53.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.062648041s
Jan 12 06:41:53.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:55.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.06274957s
Jan 12 06:41:55.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:57.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.062869867s
Jan 12 06:41:57.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:41:59.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.06277187s
Jan 12 06:41:59.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:01.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.062583745s
Jan 12 06:42:01.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:03.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.062935667s
Jan 12 06:42:03.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:05.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.062592367s
Jan 12 06:42:05.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:07.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.06231763s
Jan 12 06:42:07.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:09.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.062543598s
Jan 12 06:42:09.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:11.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.062826252s
Jan 12 06:42:11.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:13.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.062441282s
Jan 12 06:42:13.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:15.752: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.062189539s
Jan 12 06:42:15.752: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:17.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.062670335s
Jan 12 06:42:17.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:19.753: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.062848509s
Jan 12 06:42:19.753: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:19.784: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.093808119s
Jan 12 06:42:19.784: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-01ebb116de9e964dc' to be 'Running' but was 'Pending'
Jan 12 06:42:19.784: INFO: Pod httpd failed to be running and ready.
Jan 12 06:42:19.784: INFO: Wanted all 1 pods to be running and ready. Result: false. Pods: [httpd]
Jan 12 06:42:19.784: FAIL: Expected
    <bool>: false
to equal
    <bool>: true

Full Stack Trace
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.1()
	test/e2e/kubectl/kubectl.go:415 +0x245
[AfterEach] Simple pod
  test/e2e/kubectl/kubectl.go:417
�[1mSTEP:�[0m using delete to clean up resources �[38;5;243m01/12/23 06:42:19.784�[0m
Jan 12 06:42:19.784: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1b203a2f-9241-11ed-901d-e2a8de243d6a/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-6584 delete --grace-period=0 --force -f -'
Jan 12 06:42:20.033: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n"
Jan 12 06:42:20.033: INFO: stdout: "pod \"httpd\" force deleted\n"
Jan 12 06:42:20.033: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1b203a2f-9241-11ed-901d-e2a8de243d6a/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-6584 get rc,svc -l name=httpd --no-headers'
Jan 12 06:42:20.264: INFO: stderr: "No resources found in kubectl-6584 namespace.\n"
Jan 12 06:42:20.264: INFO: stdout: ""
Jan 12 06:42:20.264: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/1b203a2f-9241-11ed-901d-e2a8de243d6a/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-6584 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}'
Jan 12 06:42:20.457: INFO: stderr: ""
Jan 12 06:42:20.457: INFO: stdout: ""
[AfterEach] [sig-cli] Kubectl client
  test/e2e/framework/node/init/init.go:32
Jan 12 06:42:20.457: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl client
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl client
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/12/23 06:42:20.489�[0m
�[1mSTEP:�[0m Collecting events from namespace "kubectl-6584". �[38;5;243m01/12/23 06:42:20.489�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/12/23 06:42:20.52�[0m
Jan 12 06:42:20.520: INFO: At 2023-01-12 06:37:19 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-6584/httpd to i-01ebb116de9e964dc
Jan 12 06:42:20.520: INFO: At 2023-01-12 06:37:20 +0000 UTC - event for httpd: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c84b012ae1e59f571103c71df1b20931ddb3b9be7de53b9eadcd67aab6dd9ea2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:42:20.520: INFO: At 2023-01-12 06:37:34 +0000 UTC - event for httpd: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e7144e8af821be6b15cadaf6db5e651f928dead5280a89daef3f6fceff17b67d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:42:20.520: INFO: At 2023-01-12 06:37:47 +0000 UTC - event for httpd: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3e84189098b75f53a7cb4971a9e6b25d29cd9750c7d24701c7118d87372f5c5f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:42:20.520: INFO: At 2023-01-12 06:38:00 +0000 UTC - event for httpd: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d40f1dd9830a05d467e2b8a916d5e47e702d92d247f763bd32dd4d8222a810f1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:42:20.520: INFO: At 2023-01-12 06:38:13 +0000 UTC - event for httpd: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7258dbc4d2817af4a2ee33252457250ead763df5485c8eee8688a31689c8b430": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:42:20.520: INFO: At 2023-01-12 06:38:28 +0000 UTC - event for httpd: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6f92f46f6f3102aac15e3def3c7b335ecb95cd950219f683665fd9cf7736f587": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:42:20.520: INFO: At 2023-01-12 06:38:43 +0000 UTC - event for httpd: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c3392e98d4bc42e2cd96432d6816710de9d0609cd18dde3d5751e9451511da83": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:42:20.520: INFO: At 2023-01-12 06:38:57 +0000 UTC - event for httpd: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a4a99f2c955c9a1daa31d8fcfbea3827c2aa44621c4c9afcd901980daf4b3de6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:42:20.520: INFO: At 2023-01-12 06:39:11 +0000 UTC - event for httpd: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cff9208e27321e3fa4d27c4522506c29149cf5857a7d9d9cbd784239b0e3437f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:42:20.520: INFO: At 2023-01-12 06:39:26 +0000 UTC - event for httpd: {kubelet i-01ebb116de9e964dc} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7d559879a7af435ef939678628d6f9bd8cd1ad5d76e61034675debe21b5b6194": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:42:20.551: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 12 06:42:20.551: INFO: 
Jan 12 06:42:20.583: INFO: 
Logging node info for node i-0029a94fa7f902ab5
Jan 12 06:42:20.613: INFO: Node Info: &Node{ObjectMeta:{i-0029a94fa7f902ab5    086bb9cc-b77b-48db-a8ae-537b7cbf6e36 18972 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0029a94fa7f902ab5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0029a94fa7f902ab5 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.235 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-1054":"i-0029a94fa7f902ab5","ebs.csi.aws.com":"i-0029a94fa7f902ab5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:41:02 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-12 06:41:08 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0029a94fa7f902ab5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:41:08 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:41:08 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:41:08 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:41:08 +0000 UTC,LastTransitionTime:2023-01-12 06:26:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.235,},NodeAddress{Type:ExternalIP,Address:15.222.254.31,},NodeAddress{Type:InternalDNS,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-254-31.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2680cab44fba5db711d741fbe294e7,SystemUUID:ec2680ca-b44f-ba5d-b711-d741fbe294e7,BootID:01f1463d-4c68-4aa0-8900-0499980b4f60,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-1054^13f30bd6-9244-11ed-93f4-969b58486a24 kubernetes.io/csi/csi-hostpath-ephemeral-1054^13f344b7-9244-11ed-93f4-969b58486a24],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1054^13f30bd6-9244-11ed-93f4-969b58486a24,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-1054^13f344b7-9244-11ed-93f4-969b58486a24,DevicePath:,},},Config:nil,},}
Jan 12 06:42:20.614: INFO: 
Logging kubelet events for node i-0029a94fa7f902ab5
Jan 12 06:42:20.647: INFO: 
Logging pods the kubelet thinks is on node i-0029a94fa7f902ab5
Jan 12 06:42:20.686: INFO: pod-subpath-test-preprovisionedpv-2r8b started at 2023-01-12 06:41:03 +0000 UTC (2+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Init container init-volume-preprovisionedpv-2r8b ready: false, restart count 0
Jan 12 06:42:20.686: INFO: 	Init container test-init-volume-preprovisionedpv-2r8b ready: false, restart count 0
Jan 12 06:42:20.686: INFO: 	Container test-container-subpath-preprovisionedpv-2r8b ready: false, restart count 0
Jan 12 06:42:20.686: INFO: test-rolling-update-with-lb-85b8b59c8c-c2484 started at 2023-01-12 06:41:27 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container agnhost ready: false, restart count 0
Jan 12 06:42:20.686: INFO: cilium-v2fq9 started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:42:20.686: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:42:20.686: INFO: inline-volume-tester-r6bbm started at 2023-01-12 06:41:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container csi-volume-tester ready: true, restart count 0
Jan 12 06:42:20.686: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-798lx started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:42:20.686: INFO: ebs-csi-node-wfgs2 started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:42:20.686: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:42:20.686: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:42:20.686: INFO: test-rolling-update-with-lb-56d9b65d4c-cgjx2 started at 2023-01-12 06:35:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:42:20.686: INFO: affinity-clusterip-timeout-bjvbr started at 2023-01-12 06:41:02 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container affinity-clusterip-timeout ready: false, restart count 0
Jan 12 06:42:20.686: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ds9hr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:20.686: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4c699 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:20.686: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-jrdnf started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:20.686: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-tm86v started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:42:20.686: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-krdq2 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:20.686: INFO: coredns-559769c974-p2fts started at 2023-01-12 06:27:03 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:42:20.686: INFO: hostexec-i-0029a94fa7f902ab5-bvfqt started at 2023-01-12 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:42:20.686: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:40:58 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:42:20.686: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:42:20.686: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 12 06:42:20.686: INFO: 	Container csi-snapshotter ready: true, restart count 0
Jan 12 06:42:20.686: INFO: 	Container hostpath ready: true, restart count 0
Jan 12 06:42:20.686: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:42:20.686: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:42:20.686: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-qdh5s started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:20.686: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k5j26 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:20.686: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ccxfb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:20.686: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-w5hzb started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:20.686: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:20.883: INFO: 
Latency metrics for node i-0029a94fa7f902ab5
Jan 12 06:42:20.883: INFO: 
Logging node info for node i-00a1700b2a4dc039f
Jan 12 06:42:20.914: INFO: Node Info: &Node{ObjectMeta:{i-00a1700b2a4dc039f    31b14f9e-702c-4bf4-8b4f-160f1e8d2e78 19332 0 2023-01-12 06:24:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00a1700b2a4dc039f kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.107 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00a1700b2a4dc039f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-12 06:24:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-12 06:25:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:25:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-12 06:42:00 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00a1700b2a4dc039f,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:00 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:00 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:00 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:42:00 +0000 UTC,LastTransitionTime:2023-01-12 06:25:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.107,},NodeAddress{Type:ExternalIP,Address:99.79.69.225,},NodeAddress{Type:InternalDNS,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-69-225.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2aefdb0e1836236784b773a0de1726,SystemUUID:ec2aefdb-0e18-3623-6784-b773a0de1726,BootID:efa2d6a5-f933-4174-9d1e-f2c2ada73f29,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451206,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42803449,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4967343,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:42:20.914: INFO: 
Logging kubelet events for node i-00a1700b2a4dc039f
Jan 12 06:42:20.947: INFO: 
Logging pods the kubelet thinks is on node i-00a1700b2a4dc039f
Jan 12 06:42:21.013: INFO: cilium-f68z5 started at 2023-01-12 06:25:04 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:42:21.013: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:42:21.013: INFO: dns-controller-69987775c6-n2lqn started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Container dns-controller ready: true, restart count 0
Jan 12 06:42:21.013: INFO: cilium-operator-5dd44dc49f-zvdwf started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Container cilium-operator ready: true, restart count 0
Jan 12 06:42:21.013: INFO: aws-cloud-controller-manager-vj4cr started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Container aws-cloud-controller-manager ready: true, restart count 0
Jan 12 06:42:21.013: INFO: etcd-manager-events-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:42:21.013: INFO: etcd-manager-main-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Container etcd-manager ready: true, restart count 0
Jan 12 06:42:21.013: INFO: kube-apiserver-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Container healthcheck ready: true, restart count 0
Jan 12 06:42:21.013: INFO: 	Container kube-apiserver ready: true, restart count 1
Jan 12 06:42:21.013: INFO: kube-scheduler-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Container kube-scheduler ready: true, restart count 0
Jan 12 06:42:21.013: INFO: kube-controller-manager-i-00a1700b2a4dc039f started at 2023-01-12 06:24:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Container kube-controller-manager ready: true, restart count 2
Jan 12 06:42:21.013: INFO: ebs-csi-node-vtl8h started at 2023-01-12 06:25:04 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:42:21.013: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:42:21.013: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:42:21.013: INFO: ebs-csi-controller-5bd98b456f-s56qb started at 2023-01-12 06:25:08 +0000 UTC (0+5 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:42:21.013: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:42:21.013: INFO: 	Container csi-resizer ready: true, restart count 0
Jan 12 06:42:21.013: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:42:21.013: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:42:21.013: INFO: kops-controller-h6cd7 started at 2023-01-12 06:25:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.013: INFO: 	Container kops-controller ready: true, restart count 0
Jan 12 06:42:21.177: INFO: 
Latency metrics for node i-00a1700b2a4dc039f
Jan 12 06:42:21.177: INFO: 
Logging node info for node i-01ebb116de9e964dc
Jan 12 06:42:21.208: INFO: Node Info: &Node{ObjectMeta:{i-01ebb116de9e964dc    9bba0dc4-469e-4f38-b41b-aa672131ad87 19124 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-01ebb116de9e964dc kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-01ebb116de9e964dc topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.41.44 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-01ebb116de9e964dc"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:41:26 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-01ebb116de9e964dc,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:41:26 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:41:26 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:41:26 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:41:26 +0000 UTC,LastTransitionTime:2023-01-12 06:26:40 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.41.44,},NodeAddress{Type:ExternalIP,Address:3.99.142.186,},NodeAddress{Type:InternalDNS,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-01ebb116de9e964dc.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-3-99-142-186.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec264bf9915ff9f6f2894d5911a8df83,SystemUUID:ec264bf9-915f-f9f6-f289-4d5911a8df83,BootID:00d4d8a1-d87c-4c57-bee6-69bb72398b91,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:42:21.209: INFO: 
Logging kubelet events for node i-01ebb116de9e964dc
Jan 12 06:42:21.242: INFO: 
Logging pods the kubelet thinks is on node i-01ebb116de9e964dc
Jan 12 06:42:21.278: INFO: rand-non-local-flpwd started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container c ready: false, restart count 0
Jan 12 06:42:21.278: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-97p2z started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.278: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-mfrbf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.278: INFO: cilium-b5cfc started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:42:21.278: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:42:21.278: INFO: downward-api-8a5f93e4-4779-4ea5-af67-a3cbe3ffed2d started at 2023-01-12 06:40:33 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container dapi-container ready: false, restart count 0
Jan 12 06:42:21.278: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-z8qq5 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:42:21.278: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-5pqpn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.278: INFO: test-rolling-update-with-lb-56d9b65d4c-fppl4 started at 2023-01-12 06:35:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:42:21.278: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-nwxqm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.278: INFO: pod-0 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:42:21.278: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-js9bn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.278: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-q9c9s started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.278: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-9j6sw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.278: INFO: rand-non-local-gzghw started at 2023-01-12 06:35:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container c ready: false, restart count 0
Jan 12 06:42:21.278: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bvnhn started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.278: INFO: ebs-csi-node-bvknd started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:42:21.278: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:42:21.278: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:42:21.278: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kfdmq started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.278: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.468: INFO: 
Latency metrics for node i-01ebb116de9e964dc
Jan 12 06:42:21.468: INFO: 
Logging node info for node i-0b95e3cb438ca1933
Jan 12 06:42:21.499: INFO: Node Info: &Node{ObjectMeta:{i-0b95e3cb438ca1933    410c9a77-76a5-49fd-81d8-dcf127193ecf 19413 0 2023-01-12 06:26:25 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0b95e3cb438ca1933 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0b95e3cb438ca1933 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.43.177 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-6423":"i-0b95e3cb438ca1933","ebs.csi.aws.com":"i-0b95e3cb438ca1933"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kubelet Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:26:37 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:42:11 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-12 06:42:13 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0b95e3cb438ca1933,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:13 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:13 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:42:13 +0000 UTC,LastTransitionTime:2023-01-12 06:26:25 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:42:13 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.43.177,},NodeAddress{Type:ExternalIP,Address:99.79.51.51,},NodeAddress{Type:InternalDNS,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0b95e3cb438ca1933.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-51-51.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec23cc76a58199e94cb916e26a0dbdd4,SystemUUID:ec23cc76-a581-99e9-4cb9-16e26a0dbdd4,BootID:769bca70-45b1-4d4c-82b2-ff7e3a4f99ff,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-6423^3c4b8f7a-9244-11ed-9717-8632b2062acf kubernetes.io/csi/ebs.csi.aws.com^vol-01ff6cffc086b5535],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-01ff6cffc086b5535,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-mock-csi-mock-volumes-6423^3c4b8f7a-9244-11ed-9717-8632b2062acf,DevicePath:,},},Config:nil,},}
Jan 12 06:42:21.499: INFO: 
Logging kubelet events for node i-0b95e3cb438ca1933
Jan 12 06:42:21.533: INFO: 
Logging pods the kubelet thinks is on node i-0b95e3cb438ca1933
Jan 12 06:42:21.577: INFO: fail-once-non-local-p94zd started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container c ready: false, restart count 0
Jan 12 06:42:21.577: INFO: fail-once-non-local-h8qrp started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container c ready: false, restart count 0
Jan 12 06:42:21.577: INFO: pvc-volume-tester-gbnzs started at 2023-01-12 06:42:10 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container volume-tester ready: false, restart count 0
Jan 12 06:42:21.577: INFO: affinity-clusterip-timeout-9f8jh started at 2023-01-12 06:41:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container affinity-clusterip-timeout ready: false, restart count 0
Jan 12 06:42:21.577: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-7xqlb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.577: INFO: pod-1 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container donothing ready: false, restart count 0
Jan 12 06:42:21.577: INFO: hostexec-i-0b95e3cb438ca1933-sttpl started at 2023-01-12 06:40:58 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:42:21.577: INFO: pvc-tester-bddvl started at 2023-01-12 06:41:46 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container write-pod ready: true, restart count 0
Jan 12 06:42:21.577: INFO: csi-mockplugin-attacher-0 started at 2023-01-12 06:38:21 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container csi-attacher ready: true, restart count 0
Jan 12 06:42:21.577: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-2j6p9 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.577: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b6bbr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.577: INFO: pod-host-path-test started at 2023-01-12 06:40:45 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container test-container-1 ready: false, restart count 0
Jan 12 06:42:21.577: INFO: 	Container test-container-2 ready: false, restart count 0
Jan 12 06:42:21.577: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-gtbjw started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.577: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4sqlp started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:42:21.577: INFO: fail-once-non-local-l62nm started at 2023-01-12 06:35:21 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container c ready: false, restart count 0
Jan 12 06:42:21.577: INFO: ss2-0 started at 2023-01-12 06:42:09 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container webserver ready: false, restart count 0
Jan 12 06:42:21.577: INFO: fail-once-non-local-w64vm started at 2023-01-12 06:35:08 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container c ready: false, restart count 0
Jan 12 06:42:21.577: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dqrr9 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.577: INFO: pod-configmaps-085510c8-09ee-4f9d-a395-d462020dcfcf started at 2023-01-12 06:35:43 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 12 06:42:21.577: INFO: 	Container configmap-volume-binary-test ready: false, restart count 0
Jan 12 06:42:21.577: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:41:01 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 12 06:42:21.577: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:42:21.577: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 12 06:42:21.577: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 12 06:42:21.577: INFO: 	Container hostpath ready: false, restart count 0
Jan 12 06:42:21.577: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 12 06:42:21.577: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 12 06:42:21.577: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-wnxfm started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:42:21.577: INFO: pod-subpath-test-preprovisionedpv-48mj started at 2023-01-12 06:41:04 +0000 UTC (2+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Init container init-volume-preprovisionedpv-48mj ready: false, restart count 0
Jan 12 06:42:21.577: INFO: 	Init container test-init-volume-preprovisionedpv-48mj ready: false, restart count 0
Jan 12 06:42:21.577: INFO: 	Container test-container-subpath-preprovisionedpv-48mj ready: false, restart count 0
Jan 12 06:42:21.577: INFO: ebs-csi-node-x6qtj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:42:21.577: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:42:21.577: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:42:21.577: INFO: csi-mockplugin-0 started at 2023-01-12 06:38:21 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container csi-provisioner ready: true, restart count 0
Jan 12 06:42:21.577: INFO: 	Container driver-registrar ready: true, restart count 0
Jan 12 06:42:21.577: INFO: 	Container mock ready: true, restart count 0
Jan 12 06:42:21.577: INFO: test-rolling-update-with-lb-85b8b59c8c-rdnwt started at 2023-01-12 06:38:11 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:42:21.577: INFO: hairpin started at 2023-01-12 06:40:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.577: INFO: 	Container agnhost-container ready: false, restart count 0
Jan 12 06:42:21.582: INFO: alpine-nnp-true-294399b3-dd8d-444b-9d8b-4d6bc97dcba1 started at 2023-01-12 06:41:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.582: INFO: 	Container alpine-nnp-true-294399b3-dd8d-444b-9d8b-4d6bc97dcba1 ready: false, restart count 0
Jan 12 06:42:21.582: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vp5q6 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.582: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.582: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k9rkg started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.582: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.582: INFO: cilium-l6rqm started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:42:21.582: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:42:21.582: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:42:21.582: INFO: fail-once-non-local-vcv58 started at 2023-01-12 06:34:59 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.582: INFO: 	Container c ready: false, restart count 0
Jan 12 06:42:21.582: INFO: pod-subpath-test-inlinevolume-d8rd started at 2023-01-12 06:41:10 +0000 UTC (2+2 container statuses recorded)
Jan 12 06:42:21.582: INFO: 	Init container init-volume-inlinevolume-d8rd ready: false, restart count 0
Jan 12 06:42:21.582: INFO: 	Init container test-init-subpath-inlinevolume-d8rd ready: false, restart count 0
Jan 12 06:42:21.582: INFO: 	Container test-container-subpath-inlinevolume-d8rd ready: false, restart count 0
Jan 12 06:42:21.582: INFO: 	Container test-container-volume-inlinevolume-d8rd ready: false, restart count 0
Jan 12 06:42:21.582: INFO: security-context-db8fe60c-6582-4454-b4b6-941c9614ce8e started at 2023-01-12 06:41:10 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.582: INFO: 	Container test-container ready: false, restart count 0
Jan 12 06:42:21.582: INFO: pod-hostip-0806b4ac-73af-498b-a9ca-89d40796f256 started at 2023-01-12 06:41:44 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.582: INFO: 	Container test ready: false, restart count 0
Jan 12 06:42:21.582: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-27f6c started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.582: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.757: INFO: 
Latency metrics for node i-0b95e3cb438ca1933
Jan 12 06:42:21.757: INFO: 
Logging node info for node i-0bcea138229cdd410
Jan 12 06:42:21.788: INFO: Node Info: &Node{ObjectMeta:{i-0bcea138229cdd410    95f2bbd5-be1b-44e9-a59a-66f87015f9d2 18244 0 2023-01-12 06:26:24 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0bcea138229cdd410 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0bcea138229cdd410 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.32.113 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0bcea138229cdd410"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:25 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:40:34 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0bcea138229cdd410,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:24 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:40:34 +0000 UTC,LastTransitionTime:2023-01-12 06:26:37 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.32.113,},NodeAddress{Type:ExternalIP,Address:35.182.71.1,},NodeAddress{Type:InternalDNS,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0bcea138229cdd410.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-35-182-71-1.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec21ffd1efd1b61b9def5afc88b88dba,SystemUUID:ec21ffd1-efd1-b61b-9def-5afc88b88dba,BootID:65b83838-2717-4c2d-8957-6fdcb4152c24,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:42:21.788: INFO: 
Logging kubelet events for node i-0bcea138229cdd410
Jan 12 06:42:21.821: INFO: 
Logging pods the kubelet thinks is on node i-0bcea138229cdd410
Jan 12 06:42:21.861: INFO: ebs-csi-node-g2mwj started at 2023-01-12 06:26:25 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:42:21.861: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:42:21.861: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:42:21.861: INFO: hostexec-i-0bcea138229cdd410-hx972 started at 2023-01-12 06:40:53 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:42:21.861: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6blc8 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.861: INFO: pod-subpath-test-preprovisionedpv-xblf started at 2023-01-12 06:41:04 +0000 UTC (2+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Init container init-volume-preprovisionedpv-xblf ready: false, restart count 0
Jan 12 06:42:21.861: INFO: 	Init container test-init-volume-preprovisionedpv-xblf ready: false, restart count 0
Jan 12 06:42:21.861: INFO: 	Container test-container-subpath-preprovisionedpv-xblf ready: false, restart count 0
Jan 12 06:42:21.861: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-vxhrc started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.861: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6ngxj started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.861: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-kd57q started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.861: INFO: hostexec-i-0bcea138229cdd410-j7qft started at 2023-01-12 06:40:55 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container agnhost-container ready: true, restart count 0
Jan 12 06:42:21.861: INFO: cilium-q5hq4 started at 2023-01-12 06:26:25 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:42:21.861: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:42:21.861: INFO: coredns-autoscaler-7cb5c5b969-lzjqb started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container autoscaler ready: true, restart count 0
Jan 12 06:42:21.861: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-b9cmz started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.861: INFO: affinity-clusterip-timeout-xvt8w started at 2023-01-12 06:41:01 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container affinity-clusterip-timeout ready: false, restart count 0
Jan 12 06:42:21.861: INFO: pod-subpath-test-preprovisionedpv-vzj5 started at 2023-01-12 06:41:04 +0000 UTC (0+2 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container test-container-subpath-preprovisionedpv-vzj5 ready: false, restart count 0
Jan 12 06:42:21.861: INFO: 	Container test-container-volume-preprovisionedpv-vzj5 ready: false, restart count 0
Jan 12 06:42:21.861: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-dxzmh started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.861: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-6p5qk started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.861: INFO: coredns-559769c974-z5pf2 started at 2023-01-12 06:26:37 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:42:21.861: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-bg28w started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.861: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-h6kb8 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.861: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-8zhgf started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:42:21.861: INFO: csi-hostpathplugin-0 started at 2023-01-12 06:37:34 +0000 UTC (0+7 container statuses recorded)
Jan 12 06:42:21.861: INFO: 	Container csi-attacher ready: false, restart count 0
Jan 12 06:42:21.861: INFO: 	Container csi-provisioner ready: false, restart count 0
Jan 12 06:42:21.861: INFO: 	Container csi-resizer ready: false, restart count 0
Jan 12 06:42:21.861: INFO: 	Container csi-snapshotter ready: false, restart count 0
Jan 12 06:42:21.861: INFO: 	Container hostpath ready: false, restart count 0
Jan 12 06:42:21.861: INFO: 	Container liveness-probe ready: false, restart count 0
Jan 12 06:42:21.861: INFO: 	Container node-driver-registrar ready: false, restart count 0
Jan 12 06:42:22.049: INFO: 
Latency metrics for node i-0bcea138229cdd410
[DeferCleanup (Each)] [sig-cli] Kubectl client
  tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "kubectl-6584" for this suite. �[38;5;243m01/12/23 06:42:22.049�[0m

				Click to see stdout/stderrfrom junit_01.xml

Filter through log files | View test history on testgrid

Kubernetes e2e suite [It] [sig-network] DNS should support configurable pod DNS nameservers [Conformance] 5m1s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sDNS\sshould\ssupport\sconfigurable\spod\sDNS\snameservers\s\[Conformance\]$'

test/e2e/network/dns.go:431
k8s.io/kubernetes/test/e2e/network.glob..func2.10()
	test/e2e/network/dns.go:431 +0x485
				[BeforeEach] [sig-network] DNS
  set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/12/23 06:35:53.447�[0m
Jan 12 06:35:53.448: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename dns �[38;5;243m01/12/23 06:35:53.449�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/12/23 06:35:53.543�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/12/23 06:35:53.603�[0m
[BeforeEach] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:31
[It] should support configurable pod DNS nameservers [Conformance]
  test/e2e/network/dns.go:411
�[1mSTEP:�[0m Creating a pod with dnsPolicy=None and customized dnsConfig... �[38;5;243m01/12/23 06:35:53.664�[0m
Jan 12 06:35:53.708: INFO: Created pod &Pod{ObjectMeta:{test-dns-nameservers  dns-8824  0536e5ce-7468-4b21-8271-51ae7bbdc2d3 16708 0 2023-01-12 06:35:53 +0000 UTC <nil> <nil> map[] map[] [] [] [{e2e.test Update v1 2023-01-12 06:35:53 +0000 UTC FieldsV1 {"f:spec":{"f:containers":{"k:{\"name\":\"agnhost-container\"}":{".":{},"f:args":{},"f:image":{},"f:imagePullPolicy":{},"f:name":{},"f:resources":{},"f:securityContext":{},"f:terminationMessagePath":{},"f:terminationMessagePolicy":{}}},"f:dnsConfig":{".":{},"f:nameservers":{},"f:searches":{}},"f:dnsPolicy":{},"f:enableServiceLinks":{},"f:restartPolicy":{},"f:schedulerName":{},"f:securityContext":{},"f:terminationGracePeriodSeconds":{}}} }]},Spec:PodSpec{Volumes:[]Volume{Volume{Name:kube-api-access-62gg7,VolumeSource:VolumeSource{HostPath:nil,EmptyDir:nil,GCEPersistentDisk:nil,AWSElasticBlockStore:nil,GitRepo:nil,Secret:nil,NFS:nil,ISCSI:nil,Glusterfs:nil,PersistentVolumeClaim:nil,RBD:nil,FlexVolume:nil,Cinder:nil,CephFS:nil,Flocker:nil,DownwardAPI:nil,FC:nil,AzureFile:nil,ConfigMap:nil,VsphereVolume:nil,Quobyte:nil,AzureDisk:nil,PhotonPersistentDisk:nil,PortworxVolume:nil,ScaleIO:nil,Projected:&ProjectedVolumeSource{Sources:[]VolumeProjection{VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:nil,ServiceAccountToken:&ServiceAccountTokenProjection{Audience:,ExpirationSeconds:*3607,Path:token,},},VolumeProjection{Secret:nil,DownwardAPI:nil,ConfigMap:&ConfigMapProjection{LocalObjectReference:LocalObjectReference{Name:kube-root-ca.crt,},Items:[]KeyToPath{KeyToPath{Key:ca.crt,Path:ca.crt,Mode:nil,},},Optional:nil,},ServiceAccountToken:nil,},VolumeProjection{Secret:nil,DownwardAPI:&DownwardAPIProjection{Items:[]DownwardAPIVolumeFile{DownwardAPIVolumeFile{Path:namespace,FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:metadata.namespace,},ResourceFieldRef:nil,Mode:nil,},},},ConfigMap:nil,ServiceAccountToken:nil,},},DefaultMode:*420,},StorageOS:nil,CSI:nil,Ephemeral:nil,},},},Containers:[]Container{Container{Name:agnhost-container,Image:registry.k8s.io/e2e-test-images/agnhost:2.43,Command:[],Args:[pause],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:kube-api-access-62gg7,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,},},LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:nil,Privileged:nil,SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:nil,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,},},RestartPolicy:Always,TerminationGracePeriodSeconds:*0,ActiveDeadlineSeconds:nil,DNSPolicy:None,NodeSelector:map[string]string{},ServiceAccountName:default,DeprecatedServiceAccount:default,NodeName:,HostNetwork:false,HostPID:false,HostIPC:false,SecurityContext:&PodSecurityContext{SELinuxOptions:nil,RunAsUser:nil,RunAsNonRoot:nil,SupplementalGroups:[],FSGroup:nil,RunAsGroup:nil,Sysctls:[]Sysctl{},WindowsOptions:nil,FSGroupChangePolicy:nil,SeccompProfile:nil,},ImagePullSecrets:[]LocalObjectReference{},Hostname:,Subdomain:,Affinity:nil,SchedulerName:default-scheduler,InitContainers:[]Container{},AutomountServiceAccountToken:nil,Tolerations:[]Toleration{Toleration{Key:node.kubernetes.io/not-ready,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},Toleration{Key:node.kubernetes.io/unreachable,Operator:Exists,Value:,Effect:NoExecute,TolerationSeconds:*300,},},HostAliases:[]HostAlias{},PriorityClassName:,Priority:*0,DNSConfig:&PodDNSConfig{Nameservers:[1.1.1.1],Searches:[resolv.conf.local],Options:[]PodDNSConfigOption{},},ShareProcessNamespace:nil,ReadinessGates:[]PodReadinessGate{},RuntimeClassName:nil,EnableServiceLinks:*true,PreemptionPolicy:*PreemptLowerPriority,Overhead:ResourceList{},TopologySpreadConstraints:[]TopologySpreadConstraint{},EphemeralContainers:[]EphemeralContainer{},SetHostnameAsFQDN:nil,OS:nil,HostUsers:nil,SchedulingGates:[]PodSchedulingGate{},ResourceClaims:[]PodResourceClaim{},},Status:PodStatus{Phase:Pending,Conditions:[]PodCondition{},Message:,Reason:,HostIP:,PodIP:,StartTime:<nil>,ContainerStatuses:[]ContainerStatus{},QOSClass:BestEffort,InitContainerStatuses:[]ContainerStatus{},NominatedNodeName:,PodIPs:[]PodIP{},EphemeralContainerStatuses:[]ContainerStatus{},},}
Jan 12 06:35:53.709: INFO: Waiting up to 5m0s for pod "test-dns-nameservers" in namespace "dns-8824" to be "running and ready"
Jan 12 06:35:53.739: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 30.737838ms
Jan 12 06:35:53.739: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:35:55.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2.062444741s
Jan 12 06:35:55.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:35:57.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4.062186969s
Jan 12 06:35:57.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:35:59.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 6.06221305s
Jan 12 06:35:59.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:01.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 8.062207094s
Jan 12 06:36:01.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:03.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 10.062478967s
Jan 12 06:36:03.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:05.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 12.062511392s
Jan 12 06:36:05.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:07.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 14.062601302s
Jan 12 06:36:07.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:09.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 16.06196411s
Jan 12 06:36:09.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:11.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 18.061961539s
Jan 12 06:36:11.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:13.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 20.062535141s
Jan 12 06:36:13.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:15.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 22.062896357s
Jan 12 06:36:15.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:17.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 24.062072719s
Jan 12 06:36:17.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:19.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 26.062106274s
Jan 12 06:36:19.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:21.770: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 28.061684695s
Jan 12 06:36:21.770: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:23.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 30.062004851s
Jan 12 06:36:23.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:25.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 32.062129158s
Jan 12 06:36:25.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:27.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 34.062279134s
Jan 12 06:36:27.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:29.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 36.062381423s
Jan 12 06:36:29.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:31.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 38.06210504s
Jan 12 06:36:31.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:33.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 40.062866115s
Jan 12 06:36:33.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:35.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 42.062318366s
Jan 12 06:36:35.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:37.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 44.062277193s
Jan 12 06:36:37.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:39.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 46.062369887s
Jan 12 06:36:39.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:41.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 48.062242103s
Jan 12 06:36:41.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:43.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 50.062549102s
Jan 12 06:36:43.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:45.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 52.062256307s
Jan 12 06:36:45.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:47.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 54.06243993s
Jan 12 06:36:47.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:49.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 56.062125173s
Jan 12 06:36:49.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:51.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 58.062153364s
Jan 12 06:36:51.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:53.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.062506001s
Jan 12 06:36:53.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:55.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.062402728s
Jan 12 06:36:55.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:57.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.062058443s
Jan 12 06:36:57.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:36:59.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.062372955s
Jan 12 06:36:59.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:01.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.061884766s
Jan 12 06:37:01.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:03.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.062245796s
Jan 12 06:37:03.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:05.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.062406564s
Jan 12 06:37:05.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:07.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.062882879s
Jan 12 06:37:07.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:09.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.062263763s
Jan 12 06:37:09.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:11.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.062751918s
Jan 12 06:37:11.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:13.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.062331569s
Jan 12 06:37:13.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:15.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.062245857s
Jan 12 06:37:15.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:17.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.062045816s
Jan 12 06:37:17.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:19.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.062505279s
Jan 12 06:37:19.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:21.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.062036225s
Jan 12 06:37:21.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:23.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.062820069s
Jan 12 06:37:23.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:25.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.062808594s
Jan 12 06:37:25.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:27.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.062009885s
Jan 12 06:37:27.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:29.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.06249413s
Jan 12 06:37:29.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:31.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.062024761s
Jan 12 06:37:31.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:33.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.06217359s
Jan 12 06:37:33.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:35.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.062162869s
Jan 12 06:37:35.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:37.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.062637731s
Jan 12 06:37:37.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:39.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.062780697s
Jan 12 06:37:39.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:41.770: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.06177309s
Jan 12 06:37:41.770: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:43.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.062244133s
Jan 12 06:37:43.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:45.773: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.06417006s
Jan 12 06:37:45.773: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:47.770: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.06164004s
Jan 12 06:37:47.770: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:49.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.062873979s
Jan 12 06:37:49.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:51.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.062843463s
Jan 12 06:37:51.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:53.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.063031259s
Jan 12 06:37:53.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:55.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.06272265s
Jan 12 06:37:55.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:57.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.062692521s
Jan 12 06:37:57.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:37:59.770: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.061784728s
Jan 12 06:37:59.770: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:01.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.062406839s
Jan 12 06:38:01.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:03.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.063115736s
Jan 12 06:38:03.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:05.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.062231847s
Jan 12 06:38:05.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:07.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.062278201s
Jan 12 06:38:07.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:09.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.06250695s
Jan 12 06:38:09.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:11.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.062322803s
Jan 12 06:38:11.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:13.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.062573451s
Jan 12 06:38:13.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:15.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.062015701s
Jan 12 06:38:15.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:17.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.061837759s
Jan 12 06:38:17.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:19.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.062179735s
Jan 12 06:38:19.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:21.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.062659304s
Jan 12 06:38:21.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:23.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.062098737s
Jan 12 06:38:23.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:25.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.062439077s
Jan 12 06:38:25.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:27.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.06232338s
Jan 12 06:38:27.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:29.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.062606769s
Jan 12 06:38:29.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:31.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.062247867s
Jan 12 06:38:31.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:33.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.062867607s
Jan 12 06:38:33.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:35.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.062467741s
Jan 12 06:38:35.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:37.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.062158877s
Jan 12 06:38:37.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:39.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.062243574s
Jan 12 06:38:39.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:41.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.062049951s
Jan 12 06:38:41.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:43.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.062094386s
Jan 12 06:38:43.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:45.775: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.066212977s
Jan 12 06:38:45.775: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:47.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.062224536s
Jan 12 06:38:47.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:49.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.062363764s
Jan 12 06:38:49.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:51.775: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.066784751s
Jan 12 06:38:51.776: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:53.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.06195929s
Jan 12 06:38:53.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:55.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.062058913s
Jan 12 06:38:55.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:57.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.062285799s
Jan 12 06:38:57.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:38:59.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.062507015s
Jan 12 06:38:59.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:01.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.062618289s
Jan 12 06:39:01.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:03.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.062193214s
Jan 12 06:39:03.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:05.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.062192752s
Jan 12 06:39:05.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:07.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.062218597s
Jan 12 06:39:07.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:09.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.062331973s
Jan 12 06:39:09.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:11.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.063111313s
Jan 12 06:39:11.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:13.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.062235227s
Jan 12 06:39:13.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:15.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.062172659s
Jan 12 06:39:15.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:17.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.062210499s
Jan 12 06:39:17.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:19.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.062420848s
Jan 12 06:39:19.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:21.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.062418537s
Jan 12 06:39:21.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:23.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.062544361s
Jan 12 06:39:23.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:25.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.062290349s
Jan 12 06:39:25.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:27.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.062092532s
Jan 12 06:39:27.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:29.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.06240153s
Jan 12 06:39:29.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:31.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.062441697s
Jan 12 06:39:31.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:33.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.062635549s
Jan 12 06:39:33.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:35.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.062849527s
Jan 12 06:39:35.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:37.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.062328984s
Jan 12 06:39:37.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:39.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.063072727s
Jan 12 06:39:39.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:41.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.062678508s
Jan 12 06:39:41.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:43.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.062328183s
Jan 12 06:39:43.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:45.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.062273543s
Jan 12 06:39:45.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:47.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.062069477s
Jan 12 06:39:47.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:49.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.062329052s
Jan 12 06:39:49.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:51.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.062785388s
Jan 12 06:39:51.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:53.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.062019714s
Jan 12 06:39:53.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:55.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.062209755s
Jan 12 06:39:55.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:57.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.0623356s
Jan 12 06:39:57.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:39:59.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.062123952s
Jan 12 06:39:59.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:01.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.062761568s
Jan 12 06:40:01.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:03.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.062110205s
Jan 12 06:40:03.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:05.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.062137421s
Jan 12 06:40:05.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:07.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.062273288s
Jan 12 06:40:07.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:09.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.06222965s
Jan 12 06:40:09.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:11.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.06242018s
Jan 12 06:40:11.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:13.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.062187089s
Jan 12 06:40:13.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:15.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.062102667s
Jan 12 06:40:15.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:17.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.063071545s
Jan 12 06:40:17.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:19.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.061937138s
Jan 12 06:40:19.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:21.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.062240941s
Jan 12 06:40:21.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:23.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.062525267s
Jan 12 06:40:23.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:25.770: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.061681135s
Jan 12 06:40:25.770: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:27.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.062737923s
Jan 12 06:40:27.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:29.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.061882711s
Jan 12 06:40:29.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:31.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.062024069s
Jan 12 06:40:31.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:33.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.061909634s
Jan 12 06:40:33.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:35.772: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.062818044s
Jan 12 06:40:35.772: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:37.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.062265865s
Jan 12 06:40:37.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:39.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.062444721s
Jan 12 06:40:39.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:41.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.06240823s
Jan 12 06:40:41.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:43.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.062028158s
Jan 12 06:40:43.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:45.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.062348464s
Jan 12 06:40:45.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:47.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.06218361s
Jan 12 06:40:47.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:49.771: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.062219587s
Jan 12 06:40:49.771: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:51.770: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.061589383s
Jan 12 06:40:51.770: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:53.778: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.069465742s
Jan 12 06:40:53.778: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:53.809: INFO: Pod "test-dns-nameservers": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.100528146s
Jan 12 06:40:53.809: INFO: The phase of Pod test-dns-nameservers is Pending, waiting for it to be Running (with Ready = true)
Jan 12 06:40:53.811: INFO: Unexpected error: failed to wait for pod test-dns-nameservers to be running: 
    <*pod.timeoutError | 0xc003699ce0>: {
        msg: "timed out while waiting for pod dns-8824/test-dns-nameservers to be running and ready",
        observedObjects: [
            <*v1.Pod | 0xc000e8d680>{
                TypeMeta: {Kind: "", APIVersion: ""},
                ObjectMeta: {
                    Name: "test-dns-nameservers",
                    GenerateName: "",
                    Namespace: "dns-8824",
                    SelfLink: "",
                    UID: "0536e5ce-7468-4b21-8271-51ae7bbdc2d3",
                    ResourceVersion: "16714",
                    Generation: 0,
                    CreationTimestamp: {
                        Time: {
                            wall: 0,
                            ext: 63809102153,
                            loc: {
                                name: "Local",
                                zone: [
                                    {name: "UTC", offset: 0, isDST: false},
                                ],
                                tx: [
                                    {
                                        when: -576460752303423488,
                                        index: 0,
                                        isstd: false,
                                        isutc: false,
                                    },
                                ],
                                extend: "UTC0",
                                cacheStart: 9223372036854775807,
                                cacheEnd: 9223372036854775807,
                                cacheZone: {name: "UTC", offset: 0, isDST: false},
                            },
                        },
                    },
                    DeletionTimestamp: nil,
                    DeletionGracePeriodSeconds: nil,
                    Labels: nil,
                    Annotations: nil,
                    OwnerReferences: nil,
                    Finalizers: nil,
                    ManagedFields: [
                        {
                            Manager: "e2e.test",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63809102153,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:spec\":{\"f:containers\":{\"k:{\\\"name\\\":\\\"agnhost-container\\\"}\":{\".\":{},\"f:args\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:securityContext\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsConfig\":{\".\":{},\"f:nameservers\":{},\"f:searches\":{}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}",
                            },
                            Subresource: "",
                        },
                        {
                            Manager: "kubelet",
                            Operation: "Update",
                            APIVersion: "v1",
                            Time: {
                                Time: {
                                    wall: 0,
                                    ext: 63809102153,
                                    loc: {
                                        name: "Local",
                                        zone: [...],
                                        tx: [...],
                                        extend: "UTC0",
                                        cacheStart: 9223372036854775807,
                                        cacheEnd: 9223372036854775807,
                                        cacheZone: {name: ..., offset: ..., isDST: ...},
                                    },
                                },
                            },
                            FieldsType: "FieldsV1",
                            FieldsV1: {
                                Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}",
                            },
                            Subresource: "status",
                        },
                    ],
                },
                Spec: {
                    Volumes: [
                        {
                            Name: "kube-api-access-62gg7",
                            VolumeSource: {
                                HostPath: nil,
                                EmptyDir: nil,
                                GCEPersistentDisk: nil,
                                AWSElasticBlockStore: nil,
                                GitRepo: nil,
                                Secret: nil,
                                NFS: nil,
                                ISCSI: nil,
                                Glusterfs: nil,
                                PersistentVolumeClaim: nil,
                                RBD: nil,
                                FlexVolume: nil,
                                Cinder: nil,
                                CephFS: nil,
                                Flocker: nil,
                                DownwardAPI: nil,
                                FC: nil,
                                AzureFile: nil,
                                ConfigMap: nil,
                                VsphereVolume: nil,
                                Quobyte: nil,
                                AzureDisk: nil,
                                PhotonPersistentDisk: nil,
                                Projected: {
                                    Sources: [
                                        {
                                            Secret: ...,
                                            DownwardAPI: ...,
                                            ConfigMap: ...,
                                            ServiceAccountToken: ...,
                                        },
                                        {
                                            Secret: ...,
                                            DownwardAPI: ...,
                                            ConfigMap: ...,
                                            ServiceAccountToken: ...,
                                        },
                                        {
                                            Secret: ...,
                                            DownwardAPI: ...,
                                            ConfigMap: ...,
                                            ServiceAccountToken: ...,
                                        },
                                    ],
                                    DefaultMode: 420,
                                },
                                PortworxVolume: nil,
                       ...

Gomega truncated this representation as it exceeds 'format.MaxLength'.
Consider having the object provide a custom 'GomegaStringer' representation
or adjust the parameters in Gomega's 'format' package.

Learn more here: https://onsi.github.io/gomega/#adjusting-output

Jan 12 06:40:53.811: FAIL: failed to wait for pod test-dns-nameservers to be running: timed out while waiting for pod dns-8824/test-dns-nameservers to be running and ready

Full Stack Trace
k8s.io/kubernetes/test/e2e/network.glob..func2.10()
	test/e2e/network/dns.go:431 +0x485
Jan 12 06:40:53.811: INFO: Deleting pod test-dns-nameservers...
[AfterEach] [sig-network] DNS
  test/e2e/framework/node/init/init.go:32
Jan 12 06:40:53.850: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-network] DNS
  test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-network] DNS
  dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/12/23 06:40:53.883�[0m
�[1mSTEP:�[0m Collecting events from namespace "dns-8824". �[38;5;243m01/12/23 06:40:53.883�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/12/23 06:40:53.914�[0m
Jan 12 06:40:53.914: INFO: At 2023-01-12 06:35:53 +0000 UTC - event for test-dns-nameservers: {default-scheduler } Scheduled: Successfully assigned dns-8824/test-dns-nameservers to i-0b95e3cb438ca1933
Jan 12 06:40:53.914: INFO: At 2023-01-12 06:35:54 +0000 UTC - event for test-dns-nameservers: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "67c0598672c55c4c98cfe3d9bf216ed838d8c73e136cf7dc241cfb7555217633": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:53.914: INFO: At 2023-01-12 06:36:09 +0000 UTC - event for test-dns-nameservers: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5fb6b9583627d40aa5f1c9bc5896ec09e81ce15c009673c880b000fb4be7336c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:53.914: INFO: At 2023-01-12 06:36:23 +0000 UTC - event for test-dns-nameservers: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9fd3b8b0c1fd262b0c132c6002e3adfab1889aedddd9e3533f15b0ee617157c0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:53.914: INFO: At 2023-01-12 06:36:37 +0000 UTC - event for test-dns-nameservers: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "13b273318e082904f62d76f40bba0e7adc33092b5d6a999b9c694308c0409f33": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:53.914: INFO: At 2023-01-12 06:36:50 +0000 UTC - event for test-dns-nameservers: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6bfae3a2f7a84e888ec0f9a62e70a44ea5c07c99362427f1a99f26bba45661e8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:53.914: INFO: At 2023-01-12 06:37:04 +0000 UTC - event for test-dns-nameservers: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e11aba2fd01ad674057a80bc877397acf26ebf6d642dbd0bdac24a32c7ebedcf": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:53.914: INFO: At 2023-01-12 06:37:18 +0000 UTC - event for test-dns-nameservers: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1be050d999eb53ae5537a37ed1422c2601a15ead85700957990341785d63c2bd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:53.914: INFO: At 2023-01-12 06:37:29 +0000 UTC - event for test-dns-nameservers: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "247eb7f094be30c18241afbef1332ab5661aae4c332fab7fa72c07690b64bc66": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:53.914: INFO: At 2023-01-12 06:37:43 +0000 UTC - event for test-dns-nameservers: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5e6b9a36025bcdc55f9ba9fbee9687b5a6d1bd3110fcc2759cd4caaa2c791a1b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:53.914: INFO: At 2023-01-12 06:37:56 +0000 UTC - event for test-dns-nameservers: {kubelet i-0b95e3cb438ca1933} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e917cf5ead1acebea681b7ea650402bcaf6b64aeaa235594df2e204abfc5f3c7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure  No more IPs available
Jan 12 06:40:53.944: INFO: POD  NODE  PHASE  GRACE  CONDITIONS
Jan 12 06:40:53.944: INFO: 
Jan 12 06:40:53.978: INFO: 
Logging node info for node i-0029a94fa7f902ab5
Jan 12 06:40:54.009: INFO: Node Info: &Node{ObjectMeta:{i-0029a94fa7f902ab5    086bb9cc-b77b-48db-a8ae-537b7cbf6e36 18187 0 2023-01-12 06:26:29 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0029a94fa7f902ab5 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ca-central-1a topology.hostpath.csi/node:i-0029a94fa7f902ab5 topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.48.235 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0029a94fa7f902ab5"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kube-controller-manager Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-12 06:26:29 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-12 06:26:30 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {e2e.test Update v1 2023-01-12 06:35:12 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-12 06:40:25 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-0029a94fa7f902ab5,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051681280 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946823680 0} {<nil>}  BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:29 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:40:17 +0000 UTC,LastTransitionTime:2023-01-12 06:26:41 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.48.235,},NodeAddress{Type:ExternalIP,Address:15.222.254.31,},NodeAddress{Type:InternalDNS,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0029a94fa7f902ab5.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-222-254-31.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2680cab44fba5db711d741fbe294e7,SystemUUID:ec2680ca-b44f-ba5d-b711-d741fbe294e7,BootID:01f1463d-4c68-4aa0-8900-0499980b4f60,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 12 06:40:54.009: INFO: 
Logging kubelet events for node i-0029a94fa7f902ab5
Jan 12 06:40:54.042: INFO: 
Logging pods the kubelet thinks is on node i-0029a94fa7f902ab5
Jan 12 06:40:54.079: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-tm86v started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:54.079: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-krdq2 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:54.079: INFO: coredns-559769c974-p2fts started at 2023-01-12 06:27:03 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container coredns ready: true, restart count 0
Jan 12 06:40:54.079: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-4c699 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:54.079: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-jrdnf started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:54.079: INFO: netserver-0 started at 2023-01-12 06:35:50 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container webserver ready: false, restart count 0
Jan 12 06:40:54.079: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ccxfb started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:54.079: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-w5hzb started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:54.079: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-qdh5s started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:54.079: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-k5j26 started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:54.079: INFO: cilium-v2fq9 started at 2023-01-12 06:26:30 +0000 UTC (1+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Init container clean-cilium-state ready: true, restart count 0
Jan 12 06:40:54.079: INFO: 	Container cilium-agent ready: true, restart count 0
Jan 12 06:40:54.079: INFO: up-down-1-lvmbh started at 2023-01-12 06:35:00 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container up-down-1 ready: true, restart count 0
Jan 12 06:40:54.079: INFO: up-down-2-lw8c9 started at 2023-01-12 06:35:12 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container up-down-2 ready: true, restart count 0
Jan 12 06:40:54.079: INFO: ebs-csi-node-wfgs2 started at 2023-01-12 06:26:30 +0000 UTC (0+3 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container ebs-plugin ready: true, restart count 0
Jan 12 06:40:54.079: INFO: 	Container liveness-probe ready: true, restart count 0
Jan 12 06:40:54.079: INFO: 	Container node-driver-registrar ready: true, restart count 0
Jan 12 06:40:54.079: INFO: test-rolling-update-with-lb-56d9b65d4c-cgjx2 started at 2023-01-12 06:35:04 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container agnhost ready: true, restart count 0
Jan 12 06:40:54.079: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-ds9hr started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: true, restart count 0
Jan 12 06:40:54.079: INFO: cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a-798lx started at 2023-01-12 06:35:13 +0000 UTC (0+1 container statuses recorded)
Jan 12 06:40:54.079: INFO: 	Container cleanup40-cc220551-08b1-4432-a1bb-dd44c976ce7a ready: false, restart count 0
Jan 12 06:40:54.269: INFO: 
Latency metrics for node i-0029a94fa7f902ab5
Jan 12 06:40:54.269: INFO: 
Logging node info for node i-00a1700b2a4dc039f
Jan 12 06:40:54.299: INFO: Node Info: &Node{ObjectMeta:{i-00a1700b2a4dc039f    31b14f9e-702c-4bf4-8b4f-160f1e8d2e78 17128 0 2023-01-12 06:24:40 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ca-central-1 failure-domain.beta.kubernetes.io/zone:ca-central-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-00a1700b2a4dc039f kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ca-central-1a topology.kubernetes.io/region:ca-central-1 topology.kubernetes.io/zone:ca-central-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.55.107 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-00a1700b2a4dc039f"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-12 06:24:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-12 06:25:08 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-12 06:25:14 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-12 06:25:19 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-12 06:36:56 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ca-central-1a/i-00a1700b2a4dc039f,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>}  BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892301824 0} {<nil>} 3801076Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787444224 0} {<nil>} 3698676Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:24:37 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-12 06:36:56 +0000 UTC,LastTransitionTime:2023-01-12 06:25:14 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.55.107,},NodeAddress{Type:ExternalIP,Address:99.79.69.225,},NodeAddress{Type:InternalDNS,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-00a1700b2a4dc039f.ca-central-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-99-79-69-225.ca-central-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2aefdb0e1836236784b773a0de1726,SystemUUID:ec2aefdb-0e18-3623-6784-b773a0de1726,BootID:efa2d6a5-f933-4174-9d1e-f2c2ada73f29,KernelVersion:5.15.0-1026-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.0,KubeProxyVersion:v1.26.0,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.0],SizeBytes:135162323,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.0],SizeBytes:124991801,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.0],SizeBytes:67205320,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.0],SizeBytes:57657656,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43451206,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42803449,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4

Result	FAILURE
Tests	37 failed / 850 succeeded
Started	2023-01-12 06:20
Elapsed	44m7s
Revision	master