e2e-kops-grid-cilium-eni-u2004-k26 #1617044312707567616
Recent runs || View in Spyglass
| Result | FAILURE |
| Tests | 39 failed / 847 succeeded |
| Started | |
| Elapsed | 49m23s |
| Revision | master |
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\sfsgroupchangepolicy\s\(Always\)\[LinuxOnly\]\,\spod\screated\swith\san\sinitial\sfsgroup\,\snew\spod\sfsgroup\sapplied\sto\svolume\scontents$'
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0016bcf00, 0xc002f0de10, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/22/23 06:42:01.402�[0m
Jan 22 06:42:01.402: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename fsgroupchangepolicy �[38;5;243m01/22/23 06:42:01.403�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/22/23 06:42:02.105�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/22/23 06:42:02.567�[0m
[BeforeEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/metrics/init/init.go:31
[It] (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents
test/e2e/storage/testsuites/fsgroupchangepolicy.go:210
Jan 22 06:42:03.029: INFO: Creating resource for dynamic PV
Jan 22 06:42:03.029: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass fsgroupchangepolicy-169-e2e-schh6lz �[38;5;243m01/22/23 06:42:03.029�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/22/23 06:42:03.262�[0m
Jan 22 06:42:03.262: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating Pod in namespace fsgroupchangepolicy-169 with fsgroup 1000 �[38;5;243m01/22/23 06:42:03.73�[0m
Jan 22 06:42:03.963: INFO: Waiting up to 5m0s for pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd" in namespace "fsgroupchangepolicy-169" to be "running"
Jan 22 06:42:04.195: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 231.495863ms
Jan 22 06:42:06.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.463551449s
Jan 22 06:42:08.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.463174677s
Jan 22 06:42:10.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.463376845s
Jan 22 06:42:12.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.463504713s
Jan 22 06:42:14.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.463227665s
Jan 22 06:42:16.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.463705386s
Jan 22 06:42:18.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.463453025s
Jan 22 06:42:20.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.463649627s
Jan 22 06:42:22.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 18.463227074s
Jan 22 06:42:24.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 20.463401056s
Jan 22 06:42:26.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 22.463303001s
Jan 22 06:42:28.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 24.46323015s
Jan 22 06:42:30.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 26.463614701s
Jan 22 06:42:32.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 28.463584339s
Jan 22 06:42:34.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 30.464184127s
Jan 22 06:42:36.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 32.46413149s
Jan 22 06:42:38.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 34.463144762s
Jan 22 06:42:40.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 36.463537608s
Jan 22 06:42:42.429: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 38.465474591s
Jan 22 06:42:44.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 40.463388131s
Jan 22 06:42:46.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 42.463620777s
Jan 22 06:42:48.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 44.463302584s
Jan 22 06:42:50.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 46.463553926s
Jan 22 06:42:52.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 48.463240294s
Jan 22 06:42:54.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 50.464124355s
Jan 22 06:42:56.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 52.463797927s
Jan 22 06:42:58.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 54.464297047s
Jan 22 06:43:00.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 56.464225889s
Jan 22 06:43:02.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 58.463663917s
Jan 22 06:43:04.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.46452711s
Jan 22 06:43:06.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.463325331s
Jan 22 06:43:08.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.463180797s
Jan 22 06:43:10.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.463369002s
Jan 22 06:43:12.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.463957384s
Jan 22 06:43:14.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.464165689s
Jan 22 06:43:16.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.464289288s
Jan 22 06:43:18.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.463523051s
Jan 22 06:43:20.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.464474571s
Jan 22 06:43:22.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.463505678s
Jan 22 06:43:24.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.463533031s
Jan 22 06:43:26.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.464427737s
Jan 22 06:43:28.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.463456531s
Jan 22 06:43:30.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.463790904s
Jan 22 06:43:32.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.463279736s
Jan 22 06:43:34.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.463392s
Jan 22 06:43:36.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.463237014s
Jan 22 06:43:38.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.46354296s
Jan 22 06:43:40.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.464924936s
Jan 22 06:43:42.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.463411219s
Jan 22 06:43:44.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.463234118s
Jan 22 06:43:46.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.463265646s
Jan 22 06:43:48.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.46396703s
Jan 22 06:43:50.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.463702845s
Jan 22 06:43:52.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.464355157s
Jan 22 06:43:54.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.463246079s
Jan 22 06:43:56.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.463909835s
Jan 22 06:43:58.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.463160841s
Jan 22 06:44:00.429: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.46610085s
Jan 22 06:44:02.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.463457857s
Jan 22 06:44:04.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.463620826s
Jan 22 06:44:06.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.464530168s
Jan 22 06:44:08.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.463893661s
Jan 22 06:44:10.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.463491253s
Jan 22 06:44:12.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.463166795s
Jan 22 06:44:14.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.463347775s
Jan 22 06:44:16.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.464363569s
Jan 22 06:44:18.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.463318169s
Jan 22 06:44:20.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.464435143s
Jan 22 06:44:22.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.463441244s
Jan 22 06:44:24.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.463724327s
Jan 22 06:44:26.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.464640012s
Jan 22 06:44:28.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.463863465s
Jan 22 06:44:30.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.463349611s
Jan 22 06:44:32.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.463520093s
Jan 22 06:44:34.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.463339666s
Jan 22 06:44:36.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.463320071s
Jan 22 06:44:38.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.463556616s
Jan 22 06:44:40.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.464217848s
Jan 22 06:44:42.426: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.463198061s
Jan 22 06:44:44.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.463386063s
Jan 22 06:44:46.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.464261044s
Jan 22 06:44:48.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.463351142s
Jan 22 06:44:50.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.463670862s
Jan 22 06:44:52.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.463587908s
Jan 22 06:44:54.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.463978358s
Jan 22 06:44:56.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.463937716s
Jan 22 06:44:58.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.464490231s
Jan 22 06:45:00.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.464374214s
Jan 22 06:45:02.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.463549085s
Jan 22 06:45:04.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.464066989s
Jan 22 06:45:06.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.463865539s
Jan 22 06:45:08.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.464193264s
Jan 22 06:45:10.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.464097285s
Jan 22 06:45:12.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.464201999s
Jan 22 06:45:14.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.464290122s
Jan 22 06:45:16.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.46376711s
Jan 22 06:45:18.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.463845192s
Jan 22 06:45:20.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.463919009s
Jan 22 06:45:22.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.463457315s
Jan 22 06:45:24.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.463632946s
Jan 22 06:45:26.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.463459065s
Jan 22 06:45:28.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.463745934s
Jan 22 06:45:30.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.464699484s
Jan 22 06:45:32.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.463592661s
Jan 22 06:45:34.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.463457664s
Jan 22 06:45:36.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.464638768s
Jan 22 06:45:38.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.464266671s
Jan 22 06:45:40.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.464290448s
Jan 22 06:45:42.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.463855665s
Jan 22 06:45:44.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.464370353s
Jan 22 06:45:46.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.463538898s
Jan 22 06:45:48.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.463982015s
Jan 22 06:45:50.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.46392835s
Jan 22 06:45:52.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.463763222s
Jan 22 06:45:54.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.463588511s
Jan 22 06:45:56.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.464809643s
Jan 22 06:45:58.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.465213629s
Jan 22 06:46:00.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.464404744s
Jan 22 06:46:02.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.463714699s
Jan 22 06:46:04.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.463874155s
Jan 22 06:46:06.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.464555559s
Jan 22 06:46:08.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.463945782s
Jan 22 06:46:10.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.463917081s
Jan 22 06:46:12.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.463684562s
Jan 22 06:46:14.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.464083055s
Jan 22 06:46:16.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.464914541s
Jan 22 06:46:18.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.463800111s
Jan 22 06:46:20.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.4641463s
Jan 22 06:46:22.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.464011927s
Jan 22 06:46:24.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.463929111s
Jan 22 06:46:26.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.463646596s
Jan 22 06:46:28.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.463923171s
Jan 22 06:46:30.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.464268838s
Jan 22 06:46:32.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.464613808s
Jan 22 06:46:34.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.463835189s
Jan 22 06:46:36.429: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.465432211s
Jan 22 06:46:38.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.463873664s
Jan 22 06:46:40.428: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.464434314s
Jan 22 06:46:42.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.463485452s
Jan 22 06:46:44.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.463811883s
Jan 22 06:46:46.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.46381108s
Jan 22 06:46:48.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.463793169s
Jan 22 06:46:50.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.46400878s
Jan 22 06:46:52.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.463541082s
Jan 22 06:46:54.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.463943531s
Jan 22 06:46:56.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.463677343s
Jan 22 06:46:58.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.46396663s
Jan 22 06:47:00.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.463818071s
Jan 22 06:47:02.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.463636789s
Jan 22 06:47:04.427: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.463881425s
Jan 22 06:47:04.659: INFO: Pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.695895913s
Jan 22 06:47:04.659: INFO: Unexpected error:
<*errors.errorString | 0xc000a615a0>: {
s: "pod \"pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd\" is not Running: timed out while waiting for pod fsgroupchangepolicy-169/pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd to be running",
}
Jan 22 06:47:04.659: FAIL: pod "pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd" is not Running: timed out while waiting for pod fsgroupchangepolicy-169/pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd to be running
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0016bcf00, 0xc002f0de10, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/22/23 06:47:04.659�[0m
Jan 22 06:47:05.123: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comvhzcw"
Jan 22 06:47:05.357: INFO: Waiting up to 5m0s for PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b to get deleted
Jan 22 06:47:05.588: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (231.764325ms)
Jan 22 06:47:10.821: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (5.464635075s)
Jan 22 06:47:16.054: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (10.69706934s)
Jan 22 06:47:21.286: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (15.92909867s)
Jan 22 06:47:26.518: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (21.161715773s)
Jan 22 06:47:31.751: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (26.39435768s)
Jan 22 06:47:36.984: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (31.627550619s)
Jan 22 06:47:42.219: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (36.861878559s)
Jan 22 06:47:47.451: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (42.094663258s)
Jan 22 06:47:52.684: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (47.327805788s)
Jan 22 06:47:57.917: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (52.560732344s)
Jan 22 06:48:03.151: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (57.793999502s)
Jan 22 06:48:08.384: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (1m3.026900522s)
Jan 22 06:48:13.616: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (1m8.259826785s)
Jan 22 06:48:18.849: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (1m13.492424987s)
Jan 22 06:48:24.082: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (1m18.72547416s)
Jan 22 06:48:29.316: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (1m23.958883424s)
Jan 22 06:48:34.549: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (1m29.191901784s)
Jan 22 06:48:39.781: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (1m34.424723957s)
Jan 22 06:48:45.014: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (1m39.657527597s)
Jan 22 06:48:50.247: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (1m44.89062634s)
Jan 22 06:48:55.480: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (1m50.123640976s)
Jan 22 06:49:00.713: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (1m55.35601787s)
Jan 22 06:49:05.945: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m0.588674652s)
Jan 22 06:49:11.179: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m5.821895962s)
Jan 22 06:49:16.411: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m11.054684529s)
Jan 22 06:49:21.645: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m16.287942419s)
Jan 22 06:49:26.878: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m21.52140327s)
Jan 22 06:49:32.111: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m26.754335995s)
Jan 22 06:49:37.343: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m31.986745362s)
Jan 22 06:49:42.576: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m37.219696685s)
Jan 22 06:49:47.809: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m42.452795637s)
Jan 22 06:49:53.042: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m47.685716716s)
Jan 22 06:49:58.275: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m52.918813481s)
Jan 22 06:50:03.509: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (2m58.152001074s)
Jan 22 06:50:08.741: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (3m3.384785762s)
Jan 22 06:50:13.974: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (3m8.617869638s)
Jan 22 06:50:19.207: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (3m13.850728254s)
Jan 22 06:50:24.441: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (3m19.083906368s)
Jan 22 06:50:29.673: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (3m24.316769199s)
Jan 22 06:50:34.907: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (3m29.550368181s)
Jan 22 06:50:40.140: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (3m34.783760915s)
Jan 22 06:50:45.373: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (3m40.016305357s)
Jan 22 06:50:50.606: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (3m45.248957956s)
Jan 22 06:50:55.838: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (3m50.481361798s)
Jan 22 06:51:01.071: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (3m55.71467616s)
Jan 22 06:51:06.304: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m0.947407923s)
Jan 22 06:51:11.538: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m6.181081265s)
Jan 22 06:51:16.771: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m11.413952147s)
Jan 22 06:51:22.004: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m16.647603546s)
Jan 22 06:51:27.238: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m21.880951183s)
Jan 22 06:51:32.471: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m27.114476768s)
Jan 22 06:51:37.705: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m32.347934883s)
Jan 22 06:51:42.938: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m37.581044328s)
Jan 22 06:51:48.171: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m42.814041814s)
Jan 22 06:51:53.404: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m48.047024193s)
Jan 22 06:51:58.636: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m53.279585307s)
Jan 22 06:52:03.869: INFO: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b found and phase=Bound (4m58.512139475s)
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/22/23 06:52:08.869�[0m
Jan 22 06:52:09.104: INFO: Unexpected error: while cleanup resource:
<errors.aggregate | len:1, cap:1>: [
<errors.aggregate | len:1, cap:1>[
<*fmt.wrapError | 0xc000a32360>{
msg: "persistent Volume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b not deleted by dynamic provisioner: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b still exists within 5m0s",
err: <*errors.errorString | 0xc00123e710>{
s: "PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b still exists within 5m0s",
},
},
],
]
Jan 22 06:52:09.104: FAIL: while cleanup resource: persistent Volume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b not deleted by dynamic provisioner: PersistentVolume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b still exists within 5m0s
Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:128 +0x14e
panic({0x70efe60, 0xc000e14000})
/usr/local/go/src/runtime/panic.go:884 +0x212
k8s.io/kubernetes/test/e2e/framework.Fail({0xc003ac60b0, 0xad}, {0xc002c91c30?, 0xc003ac60b0?, 0xc002c91c58?})
test/e2e/framework/log.go:61 +0x145
k8s.io/kubernetes/test/e2e/framework.ExpectNoErrorWithOffset(0x1, {0x7fa8f20, 0xc000a615a0}, {0x0?, 0x2?, 0x7fda40fd1a68?})
test/e2e/framework/expect.go:76 +0x267
k8s.io/kubernetes/test/e2e/framework.ExpectNoError(...)
test/e2e/framework/expect.go:43
k8s.io/kubernetes/test/e2e/storage/testsuites.createPodAndVerifyContentGid(0xc0016bcf00, 0xc002f0de10, 0x1, {0x0, 0x0}, {0x0, 0x0})
test/e2e/storage/testsuites/fsgroupchangepolicy.go:258 +0x151
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func3()
test/e2e/storage/testsuites/fsgroupchangepolicy.go:229 +0x298
[AfterEach] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/node/init/init.go:32
Jan 22 06:52:09.105: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/22/23 06:52:09.338�[0m
�[1mSTEP:�[0m Collecting events from namespace "fsgroupchangepolicy-169". �[38;5;243m01/22/23 06:52:09.338�[0m
�[1mSTEP:�[0m Found 16 events. �[38;5;243m01/22/23 06:52:09.571�[0m
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:42:03 +0000 UTC - event for ebs.csi.aws.comvhzcw: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:42:03 +0000 UTC - event for ebs.csi.aws.comvhzcw: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:42:03 +0000 UTC - event for ebs.csi.aws.comvhzcw: {ebs.csi.aws.com_i-0784fefc7d59ccdae_5bf40027-f75b-48e1-bc3f-0cb40c666df3 } Provisioning: External provisioner is provisioning volume for claim "fsgroupchangepolicy-169/ebs.csi.aws.comvhzcw"
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:42:07 +0000 UTC - event for ebs.csi.aws.comvhzcw: {ebs.csi.aws.com_i-0784fefc7d59ccdae_5bf40027-f75b-48e1-bc3f-0cb40c666df3 } ProvisioningSucceeded: Successfully provisioned volume pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:42:07 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {default-scheduler } Scheduled: Successfully assigned fsgroupchangepolicy-169/pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd to i-08fe7e7767ef6cb6b
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:42:15 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-83a063b3-d2b2-4741-b0e6-da64eb928f7b"
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:42:19 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7acb8a14e5941d91538b09e0999cb4379a3bc38974534c5de3e5c5832505b398": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:42:34 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a20218aa0bfb12ab2b7a185d9a437b56c83f72d98fd2c5e03bc7846acd0d4102": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:42:49 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2bc3f43fc14da1b8f47a63dc8d7342bc556d1a4319a4ac37577e552ce7aa0e93": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:43:01 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fba3c5d576e06c1164c23ec96271a8a9b37261d1648118d45b5fab3deff711c0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:43:14 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "76b76d337ca822566ea5d7759753c9131e85817f09b1e9a3107b634f5c9e2f48": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:43:25 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "79b6d6a148256e3b77863ddf9b5240e9b73c614b99079379fd6820d04c77bb63": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:43:38 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "80863d45d817ca1df59ed3e738de2b1b299efe84b1abb49941556e16a9d2496f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:43:51 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "896c89a6a108bcd00eed128aea4fe835098b1131fc7d6edd664cbf5f3dadb1cc": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:44:05 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a006d2f643dbc993244baa31311016f57dd35cf966c0aaa109ed2baea7c3494b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:52:09.571: INFO: At 2023-01-22 06:44:19 +0000 UTC - event for pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "517e56f624aec1e5e6369798a2e87395a4631bd6809d6a0120c1b8568649bcb5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:52:09.803: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 22 06:52:09.803: INFO: pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd i-08fe7e7767ef6cb6b Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:42:07 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:42:07 +0000 UTC ContainersNotReady containers with unready status: [write-pod]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:42:07 +0000 UTC ContainersNotReady containers with unready status: [write-pod]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:42:07 +0000 UTC }]
Jan 22 06:52:09.803: INFO:
Jan 22 06:52:10.037: INFO: Unable to fetch fsgroupchangepolicy-169/pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd/write-pod logs: the server rejected our request for an unknown reason (get pods pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd)
Jan 22 06:52:10.270: INFO:
Logging node info for node i-0784fefc7d59ccdae
Jan 22 06:52:10.503: INFO: Node Info: &Node{ObjectMeta:{i-0784fefc7d59ccdae 578f4339-1faa-4298-ac96-27aed9bc236a 33107 0 2023-01-22 06:24:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0784fefc7d59ccdae kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.129 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0784fefc7d59ccdae"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-22 06:24:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-22 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:24:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-22 06:47:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0784fefc7d59ccdae,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892297728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787440128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.129,},NodeAddress{Type:ExternalIP,Address:43.205.229.145,},NodeAddress{Type:InternalDNS,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-205-229-145.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cca4041964650860029288f425941,SystemUUID:ec2cca40-4196-4650-8600-29288f425941,BootID:6d7bd66f-7345-4f07-a0a9-6dcf8a9b9a01,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643680,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841303,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965801,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 22 06:52:10.503: INFO:
Logging kubelet events for node i-0784fefc7d59ccdae
Jan 22 06:52:10.738: INFO:
Logging pods the kubelet thinks is on node i-0784fefc7d59ccdae
Jan 22 06:52:10.976: INFO: etcd-manager-main-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:10.976: INFO: Container etcd-manager ready: true, restart count 0
Jan 22 06:52:10.976: INFO: kube-scheduler-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:10.976: INFO: Container kube-scheduler ready: true, restart count 0
Jan 22 06:52:10.976: INFO: ebs-csi-node-2wncs started at 2023-01-22 06:24:40 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:52:10.976: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:52:10.976: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:52:10.976: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:52:10.976: INFO: cilium-dphgw started at 2023-01-22 06:24:40 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:52:10.976: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:52:10.976: INFO: Container cilium-agent ready: true, restart count 1
Jan 22 06:52:10.976: INFO: dns-controller-69987775c6-gdndv started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:10.976: INFO: Container dns-controller ready: true, restart count 0
Jan 22 06:52:10.976: INFO: ebs-csi-controller-5bd98b456f-xxxj2 started at 2023-01-22 06:24:41 +0000 UTC (0+5 container statuses recorded)
Jan 22 06:52:10.976: INFO: Container csi-attacher ready: true, restart count 0
Jan 22 06:52:10.976: INFO: Container csi-provisioner ready: true, restart count 0
Jan 22 06:52:10.976: INFO: Container csi-resizer ready: true, restart count 0
Jan 22 06:52:10.976: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:52:10.976: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:52:10.976: INFO: kube-apiserver-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+2 container statuses recorded)
Jan 22 06:52:10.976: INFO: Container healthcheck ready: true, restart count 0
Jan 22 06:52:10.976: INFO: Container kube-apiserver ready: true, restart count 1
Jan 22 06:52:10.976: INFO: kube-controller-manager-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:10.976: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 22 06:52:10.976: INFO: etcd-manager-events-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:10.976: INFO: Container etcd-manager ready: true, restart count 0
Jan 22 06:52:10.976: INFO: kops-controller-l7kst started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:10.976: INFO: Container kops-controller ready: true, restart count 0
Jan 22 06:52:10.976: INFO: aws-cloud-controller-manager-md9vc started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:10.976: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 22 06:52:10.976: INFO: cilium-operator-5dd44dc49f-2hpqt started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:10.976: INFO: Container cilium-operator ready: true, restart count 1
Jan 22 06:52:11.756: INFO:
Latency metrics for node i-0784fefc7d59ccdae
Jan 22 06:52:11.756: INFO:
Logging node info for node i-08fe7e7767ef6cb6b
Jan 22 06:52:11.989: INFO: Node Info: &Node{ObjectMeta:{i-08fe7e7767ef6cb6b 2145b9b6-87c4-4056-9d33-2bdbd91f3e25 34635 0 2023-01-22 06:25:50 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08fe7e7767ef6cb6b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-08fe7e7767ef6cb6b topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.140 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-6487":"i-08fe7e7767ef6cb6b","ebs.csi.aws.com":"i-08fe7e7767ef6cb6b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:49:10 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:49:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-08fe7e7767ef6cb6b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:10 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:10 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:10 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:49:10 +0000 UTC,LastTransitionTime:2023-01-22 06:26:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.140,},NodeAddress{Type:ExternalIP,Address:15.206.168.164,},NodeAddress{Type:InternalDNS,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-168-164.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec244e84b4a6ab10c46e08d94bf33aed,SystemUUID:ec244e84-b4a6-ab10-c46e-08d94bf33aed,BootID:d699615e-6b18-42f3-878b-638f85804381,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-6487^d59ef7b4-9a20-11ed-8c0b-9a4b66333a9e kubernetes.io/csi/ebs.csi.aws.com^vol-0319e775eeab878e5 kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0319e775eeab878e5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1,DevicePath:,},},Config:nil,},}
Jan 22 06:52:11.989: INFO:
Logging kubelet events for node i-08fe7e7767ef6cb6b
Jan 22 06:52:12.223: INFO:
Logging pods the kubelet thinks is on node i-08fe7e7767ef6cb6b
Jan 22 06:52:12.463: INFO: pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd started at 2023-01-22 06:42:07 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container write-pod ready: false, restart count 0
Jan 22 06:52:12.464: INFO: ss-1 started at 2023-01-22 06:42:43 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container webserver ready: true, restart count 0
Jan 22 06:52:12.464: INFO: netserver-0 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container webserver ready: false, restart count 0
Jan 22 06:52:12.464: INFO: ebs-csi-node-l5r6q started at 2023-01-22 06:25:51 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:52:12.464: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:52:12.464: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:52:12.464: INFO: nodeport-test-6dfdc started at 2023-01-22 06:49:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container nodeport-test ready: false, restart count 0
Jan 22 06:52:12.464: INFO: hostpath-symlink-prep-provisioning-3728 started at 2023-01-22 06:50:02 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container init-volume-provisioning-3728 ready: false, restart count 0
Jan 22 06:52:12.464: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wj87w started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:12.464: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-s7ksv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:12.464: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gpz5p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:12.464: INFO: csi-mockplugin-attacher-0 started at 2023-01-22 06:48:03 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:52:12.464: INFO: pod-secrets-8bddb517-320a-4b52-ada4-d992ad1e745c started at 2023-01-22 06:47:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container secret-volume-test ready: false, restart count 0
Jan 22 06:52:12.464: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wc9kg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:12.464: INFO: csi-mockplugin-0 started at 2023-01-22 06:48:03 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container csi-provisioner ready: true, restart count 0
Jan 22 06:52:12.464: INFO: Container driver-registrar ready: true, restart count 0
Jan 22 06:52:12.464: INFO: Container mock ready: true, restart count 0
Jan 22 06:52:12.464: INFO: pvc-volume-tester-274d7 started at 2023-01-22 06:48:54 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container volume-tester ready: false, restart count 0
Jan 22 06:52:12.464: INFO: termination-message-container962263c0-ea82-48ad-a838-91a02214c13e started at 2023-01-22 06:49:02 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container termination-message-container ready: false, restart count 0
Jan 22 06:52:12.464: INFO: test-rs-q8xtv started at 2023-01-22 06:49:58 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container httpd ready: false, restart count 0
Jan 22 06:52:12.464: INFO: cilium-dc97x started at 2023-01-22 06:25:51 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:52:12.464: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:52:12.464: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cfk97 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:12.464: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-b8jbr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:12.464: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-l8cqz started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:52:12.464: INFO: pod-server-1 started at 2023-01-22 06:47:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:52:12.464: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hgtwv started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:12.464: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6zw5t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:12.464: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hvhkb started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:12.464: INFO: pod-server-2 started at 2023-01-22 06:49:36 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:12.464: INFO: Container agnhost-container ready: false, restart count 0
Jan 22 06:52:13.349: INFO:
Latency metrics for node i-08fe7e7767ef6cb6b
Jan 22 06:52:13.349: INFO:
Logging node info for node i-0ae272b208fd17383
Jan 22 06:52:13.581: INFO: Node Info: &Node{ObjectMeta:{i-0ae272b208fd17383 8e603661-0a86-4442-9629-8fb60195f947 34469 0 2023-01-22 06:25:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ae272b208fd17383 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0ae272b208fd17383 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.122 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ae272b208fd17383"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:48:58 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:49:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0ae272b208fd17383,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:05 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:05 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:05 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:49:05 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.122,},NodeAddress{Type:ExternalIP,Address:13.233.206.115,},NodeAddress{Type:InternalDNS,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-206-115.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2696eee3a2748c57a2a7a5dcde49ea,SystemUUID:ec2696ee-e3a2-748c-57a2-a7a5dcde49ea,BootID:d7d392b7-67d7-4101-be08-ed3bfe242022,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c kubernetes.io/csi/ebs.csi.aws.com^vol-0a2e75d3fa837517a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0a2e75d3fa837517a,DevicePath:,},},Config:nil,},}
Jan 22 06:52:13.582: INFO:
Logging kubelet events for node i-0ae272b208fd17383
Jan 22 06:52:13.816: INFO:
Logging pods the kubelet thinks is on node i-0ae272b208fd17383
Jan 22 06:52:14.064: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-224vl started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:14.064: INFO: inline-volume-tester-cpf2m started at 2023-01-22 06:47:34 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 22 06:52:14.064: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gv8d9 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:14.064: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-jhxvf started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:52:14.064: INFO: ebs-csi-node-x6xfs started at 2023-01-22 06:25:56 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:52:14.064: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:52:14.064: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:52:14.064: INFO: svc-latency-rc-zqln2 started at 2023-01-22 06:48:14 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container svc-latency-rc ready: false, restart count 0
Jan 22 06:52:14.064: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-nqs66 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:14.064: INFO: ss-2 started at 2023-01-22 06:48:56 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container webserver ready: false, restart count 0
Jan 22 06:52:14.064: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-j8nx8 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:14.064: INFO: cilium-svdg2 started at 2023-01-22 06:25:56 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:52:14.064: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:52:14.064: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:49:03 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:52:14.064: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:52:14.064: INFO: Container csi-resizer ready: false, restart count 0
Jan 22 06:52:14.064: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 22 06:52:14.064: INFO: Container hostpath ready: false, restart count 0
Jan 22 06:52:14.064: INFO: Container liveness-probe ready: false, restart count 0
Jan 22 06:52:14.064: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 22 06:52:14.064: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2rgjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:14.064: INFO: netserver-1 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container webserver ready: true, restart count 0
Jan 22 06:52:14.064: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-89kjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:14.064: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-tgn4t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:14.064: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-94drq started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:14.064: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-5nknv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:14.064: INFO: coredns-559769c974-j8pxd started at 2023-01-22 06:26:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:14.064: INFO: Container coredns ready: true, restart count 0
Jan 22 06:52:14.871: INFO:
Latency metrics for node i-0ae272b208fd17383
Jan 22 06:52:14.871: INFO:
Logging node info for node i-0f0efd5c06406af22
Jan 22 06:52:15.103: INFO: Node Info: &Node{ObjectMeta:{i-0f0efd5c06406af22 d621d241-d0c1-4fcd-95f1-3043a1e318e5 34751 0 2023-01-22 06:25:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f0efd5c06406af22 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f0efd5c06406af22 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.247 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f0efd5c06406af22"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:31 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:49:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f0efd5c06406af22,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:13 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:13 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:13 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:49:13 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.247,},NodeAddress{Type:ExternalIP,Address:13.232.42.154,},NodeAddress{Type:InternalDNS,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-42-154.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27fd43a8a03a2384a7278d59d4ca0e,SystemUUID:ec27fd43-a8a0-3a23-84a7-278d59d4ca0e,BootID:5cf896d3-1ac6-483b-85fc-643267ffe608,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4,DevicePath:,},},Config:nil,},}
Jan 22 06:52:15.104: INFO:
Logging kubelet events for node i-0f0efd5c06406af22
Jan 22 06:52:15.338: INFO:
Logging pods the kubelet thinks is on node i-0f0efd5c06406af22
Jan 22 06:52:15.580: INFO: cilium-g9f7f started at 2023-01-22 06:25:55 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:52:15.580: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:52:15.580: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:52:15.580: INFO: csi-mockplugin-0 started at 2023-01-22 06:47:48 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:52:15.580: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:52:15.580: INFO: Container driver-registrar ready: false, restart count 0
Jan 22 06:52:15.580: INFO: Container mock ready: false, restart count 0
Jan 22 06:52:15.580: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:47:59 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:52:15.580: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:52:15.580: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:52:15.580: INFO: Container csi-resizer ready: false, restart count 0
Jan 22 06:52:15.580: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 22 06:52:15.580: INFO: Container hostpath ready: false, restart count 0
Jan 22 06:52:15.580: INFO: Container liveness-probe ready: false, restart count 0
Jan 22 06:52:15.580: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 22 06:52:15.580: INFO: hostexec-i-0f0efd5c06406af22-ztx2q started at 2023-01-22 06:47:36 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.580: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:52:15.580: INFO: httpd started at 2023-01-22 06:48:37 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.580: INFO: Container httpd ready: false, restart count 0
Jan 22 06:52:15.580: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8n6lz started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.580: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:15.580: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lm57z started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.580: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:15.580: INFO: hostexec-i-0f0efd5c06406af22-4wfcp started at 2023-01-22 06:48:04 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.580: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:52:15.580: INFO: pod-c969c034-86fd-4603-9b07-49c4d8c6f476 started at 2023-01-22 06:48:13 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.580: INFO: Container write-pod ready: false, restart count 0
Jan 22 06:52:15.580: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2k9d6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.580: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:15.580: INFO: test-rs-bvvpf started at 2023-01-22 06:50:30 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.580: INFO: Container httpd ready: false, restart count 0
Jan 22 06:52:15.580: INFO: netserver-2 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.580: INFO: Container webserver ready: true, restart count 0
Jan 22 06:52:15.580: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-pc777 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.581: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:15.581: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lms68 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.581: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:15.581: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-swsd5 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.581: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:15.581: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-d5vgg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.581: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:15.581: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-dvbvr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.581: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:15.581: INFO: ss-0 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.581: INFO: Container webserver ready: true, restart count 0
Jan 22 06:52:15.581: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-sdq2g started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.581: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:15.581: INFO: pod-subpath-test-preprovisionedpv-jrsm started at 2023-01-22 06:47:56 +0000 UTC (2+1 container statuses recorded)
Jan 22 06:52:15.581: INFO: Init container init-volume-preprovisionedpv-jrsm ready: false, restart count 0
Jan 22 06:52:15.581: INFO: Init container test-init-volume-preprovisionedpv-jrsm ready: false, restart count 0
Jan 22 06:52:15.581: INFO: Container test-container-subpath-preprovisionedpv-jrsm ready: false, restart count 0
Jan 22 06:52:15.581: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-kdjqj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.581: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:15.581: INFO: ebs-csi-node-nf6tg started at 2023-01-22 06:25:55 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:52:15.581: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:52:15.581: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:52:15.581: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:52:15.581: INFO: e2e-configmap-dns-server-f02b67dc-3110-446b-8668-2f483f3d9525 started at 2023-01-22 06:48:58 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.581: INFO: Container agnhost-container ready: false, restart count 0
Jan 22 06:52:15.581: INFO: nodeport-test-hrghh started at 2023-01-22 06:49:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:15.581: INFO: Container nodeport-test ready: false, restart count 0
Jan 22 06:52:16.467: INFO:
Latency metrics for node i-0f0efd5c06406af22
Jan 22 06:52:16.467: INFO:
Logging node info for node i-0f65ec97613c55060
Jan 22 06:52:16.700: INFO: Node Info: &Node{ObjectMeta:{i-0f65ec97613c55060 3b12d6e2-1a35-47ff-9dac-e4586b70e64b 33734 0 2023-01-22 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f65ec97613c55060 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f65ec97613c55060 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.23 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f65ec97613c55060"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:47:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f65ec97613c55060,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:26:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.23,},NodeAddress{Type:ExternalIP,Address:13.233.125.79,},NodeAddress{Type:InternalDNS,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-125-79.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec29271f6fcb1e589a5709b97d78e95d,SystemUUID:ec29271f-6fcb-1e58-9a57-09b97d78e95d,BootID:67de0a94-242d-47e1-96b0-5dc05022ee13,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-08f4126003dfe4110],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08f4126003dfe4110,DevicePath:,},},Config:nil,},}
Jan 22 06:52:16.700: INFO:
Logging kubelet events for node i-0f65ec97613c55060
Jan 22 06:52:16.935: INFO:
Logging pods the kubelet thinks is on node i-0f65ec97613c55060
Jan 22 06:52:17.176: INFO: pod-client started at 2023-01-22 06:43:18 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container pod-client ready: true, restart count 0
Jan 22 06:52:17.176: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cct9p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:17.176: INFO: netserver-3 started at 2023-01-22 06:47:29 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container webserver ready: false, restart count 0
Jan 22 06:52:17.176: INFO: inline-volume-tester2-5g7d4 started at 2023-01-22 06:47:51 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 22 06:52:17.176: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdhsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:17.176: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2zr97 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:52:17.176: INFO: ebs-csi-node-wnt99 started at 2023-01-22 06:25:52 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:52:17.176: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:52:17.176: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:52:17.176: INFO: hostpath-injector started at 2023-01-22 06:48:03 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container hostpath-injector ready: false, restart count 0
Jan 22 06:52:17.176: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:48:12 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container csi-resizer ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container hostpath ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container liveness-probe ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 22 06:52:17.176: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-n4scw started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:17.176: INFO: coredns-559769c974-s8kkg started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container coredns ready: true, restart count 0
Jan 22 06:52:17.176: INFO: busybox-readonly-true-2fe51bf6-e622-4739-b4d8-f2c74b6c4b49 started at 2023-01-22 06:47:49 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container busybox-readonly-true-2fe51bf6-e622-4739-b4d8-f2c74b6c4b49 ready: false, restart count 0
Jan 22 06:52:17.176: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdcz6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:17.176: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6wbqw started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:17.176: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8sv6x started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:17.176: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-52gsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:17.176: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6bwjg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:17.176: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8qsbj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:52:17.176: INFO: cilium-582c5 started at 2023-01-22 06:25:52 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:52:17.176: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:52:17.176: INFO: coredns-autoscaler-7cb5c5b969-jts8s started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container autoscaler ready: true, restart count 0
Jan 22 06:52:17.176: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:47:58 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:52:17.176: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container csi-resizer ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container hostpath ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container liveness-probe ready: false, restart count 0
Jan 22 06:52:17.176: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 22 06:52:17.985: INFO:
Latency metrics for node i-0f65ec97613c55060
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "fsgroupchangepolicy-169" for this suite. �[38;5;243m01/22/23 06:52:17.985�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\sExternal\sStorage\s\[Driver\:\sebs\.csi\.aws\.com\]\s\[Testpattern\:\sDynamic\sPV\s\(default\sfs\)\]\ssubPath\sshould\ssupport\sexisting\ssingle\sfile\s\[LinuxOnly\]$'
test/e2e/framework/pod/output/output.go:237
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc002322d80?, {0x75c4bbe?, 0x0?}, 0xc002322d80, 0x0, {0xc000551eb0, 0x1, 0x1}, 0x0?)
test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc00179b3b0, {0xc0049af9e0, 0x16}, 0xc002322d80, 0x0)
test/e2e/storage/testsuites/subpath.go:691 +0x15c
k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func5()
test/e2e/storage/testsuites/subpath.go:227 +0x1b8
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/22/23 06:42:22.534�[0m
Jan 22 06:42:22.534: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename provisioning �[38;5;243m01/22/23 06:42:22.535�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/22/23 06:42:23.244�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/22/23 06:42:23.708�[0m
[BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath
test/e2e/framework/metrics/init/init.go:31
[It] should support existing single file [LinuxOnly]
test/e2e/storage/testsuites/subpath.go:219
Jan 22 06:42:24.172: INFO: Creating resource for dynamic PV
Jan 22 06:42:24.173: INFO: Using claimSize:1Gi, test suite supported size:{ 1Mi}, driver(ebs.csi.aws.com) supported size:{ 1Mi}
�[1mSTEP:�[0m creating a StorageClass provisioning-1608-e2e-sc7zlfb �[38;5;243m01/22/23 06:42:24.173�[0m
�[1mSTEP:�[0m creating a claim �[38;5;243m01/22/23 06:42:24.407�[0m
Jan 22 06:42:24.407: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
�[1mSTEP:�[0m Creating pod pod-subpath-test-dynamicpv-fcn2 �[38;5;243m01/22/23 06:42:24.876�[0m
�[1mSTEP:�[0m Creating a pod to test subpath �[38;5;243m01/22/23 06:42:24.876�[0m
Jan 22 06:42:25.112: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-fcn2" in namespace "provisioning-1608" to be "Succeeded or Failed"
Jan 22 06:42:25.345: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 232.55228ms
Jan 22 06:42:27.581: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.468961477s
Jan 22 06:42:29.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.46673387s
Jan 22 06:42:31.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.465954397s
Jan 22 06:42:33.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.466107593s
Jan 22 06:42:35.580: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.467883916s
Jan 22 06:42:37.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 12.466088758s
Jan 22 06:42:39.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 14.466000575s
Jan 22 06:42:41.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 16.4659271s
Jan 22 06:42:43.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 18.465970601s
Jan 22 06:42:45.581: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 20.468791623s
Jan 22 06:42:47.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 22.466507019s
Jan 22 06:42:49.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 24.466640442s
Jan 22 06:42:51.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 26.466451842s
Jan 22 06:42:53.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 28.466562237s
Jan 22 06:42:55.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 30.466879915s
Jan 22 06:42:57.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 32.466492823s
Jan 22 06:42:59.583: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 34.470824044s
Jan 22 06:43:01.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 36.466241931s
Jan 22 06:43:03.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 38.466330255s
Jan 22 06:43:05.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 40.466176756s
Jan 22 06:43:07.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 42.466386891s
Jan 22 06:43:09.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 44.46580039s
Jan 22 06:43:11.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 46.466412123s
Jan 22 06:43:13.584: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 48.471592586s
Jan 22 06:43:15.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 50.465946837s
Jan 22 06:43:17.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 52.466059268s
Jan 22 06:43:19.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 54.465546039s
Jan 22 06:43:21.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 56.466305408s
Jan 22 06:43:23.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 58.466337921s
Jan 22 06:43:25.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.467291302s
Jan 22 06:43:27.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.465649859s
Jan 22 06:43:29.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.467038719s
Jan 22 06:43:31.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.466271619s
Jan 22 06:43:33.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.466268654s
Jan 22 06:43:35.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.467145753s
Jan 22 06:43:37.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.465775159s
Jan 22 06:43:39.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.465595772s
Jan 22 06:43:41.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.466750748s
Jan 22 06:43:43.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.465725231s
Jan 22 06:43:45.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.466215446s
Jan 22 06:43:47.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.466764488s
Jan 22 06:43:49.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.465433948s
Jan 22 06:43:51.577: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.46534685s
Jan 22 06:43:53.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.466352454s
Jan 22 06:43:55.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.465849475s
Jan 22 06:43:57.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.465918747s
Jan 22 06:43:59.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.46595325s
Jan 22 06:44:01.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.465843223s
Jan 22 06:44:03.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.465852927s
Jan 22 06:44:05.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.46654174s
Jan 22 06:44:07.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.465552084s
Jan 22 06:44:09.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.466160088s
Jan 22 06:44:11.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.466589695s
Jan 22 06:44:13.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.466303766s
Jan 22 06:44:15.581: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.468945196s
Jan 22 06:44:17.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.466442163s
Jan 22 06:44:19.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.466091289s
Jan 22 06:44:21.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.465931514s
Jan 22 06:44:23.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.46588114s
Jan 22 06:44:25.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.465667791s
Jan 22 06:44:27.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.466049122s
Jan 22 06:44:29.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.465890635s
Jan 22 06:44:31.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.465493589s
Jan 22 06:44:33.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.466402317s
Jan 22 06:44:35.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.466589008s
Jan 22 06:44:37.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.46638551s
Jan 22 06:44:39.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.466068405s
Jan 22 06:44:41.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.46583887s
Jan 22 06:44:43.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.465463241s
Jan 22 06:44:45.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.46592454s
Jan 22 06:44:47.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.465583761s
Jan 22 06:44:49.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.465887418s
Jan 22 06:44:51.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.46611536s
Jan 22 06:44:53.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.465912156s
Jan 22 06:44:55.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.465517333s
Jan 22 06:44:57.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.46557147s
Jan 22 06:44:59.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.465642593s
Jan 22 06:45:01.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.466432092s
Jan 22 06:45:03.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.46621214s
Jan 22 06:45:05.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.466026546s
Jan 22 06:45:07.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.466409878s
Jan 22 06:45:09.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.466394014s
Jan 22 06:45:11.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.465509396s
Jan 22 06:45:13.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.465575622s
Jan 22 06:45:15.581: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.469189555s
Jan 22 06:45:17.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.465935547s
Jan 22 06:45:19.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.466241861s
Jan 22 06:45:21.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.466134966s
Jan 22 06:45:23.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.466117728s
Jan 22 06:45:25.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.465994627s
Jan 22 06:45:27.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.466008629s
Jan 22 06:45:29.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.466190384s
Jan 22 06:45:31.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.465458885s
Jan 22 06:45:33.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.46564281s
Jan 22 06:45:35.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.46587209s
Jan 22 06:45:37.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.466132413s
Jan 22 06:45:39.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.46601531s
Jan 22 06:45:41.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.465877053s
Jan 22 06:45:43.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.466547991s
Jan 22 06:45:45.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.466231155s
Jan 22 06:45:47.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.465676441s
Jan 22 06:45:49.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.465536108s
Jan 22 06:45:51.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.466215443s
Jan 22 06:45:53.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.466617139s
Jan 22 06:45:55.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.46649819s
Jan 22 06:45:57.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.465736223s
Jan 22 06:45:59.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.465962135s
Jan 22 06:46:01.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.466137389s
Jan 22 06:46:03.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.466150855s
Jan 22 06:46:05.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.466119462s
Jan 22 06:46:07.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.466481062s
Jan 22 06:46:09.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.466361602s
Jan 22 06:46:11.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.466223957s
Jan 22 06:46:13.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.466535671s
Jan 22 06:46:15.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.466384508s
Jan 22 06:46:17.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.466076809s
Jan 22 06:46:19.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.466205788s
Jan 22 06:46:21.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.466445333s
Jan 22 06:46:23.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.466151378s
Jan 22 06:46:25.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.465783218s
Jan 22 06:46:27.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.465753455s
Jan 22 06:46:29.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.465509984s
Jan 22 06:46:31.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.466149971s
Jan 22 06:46:33.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.466267078s
Jan 22 06:46:35.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.465773342s
Jan 22 06:46:37.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.466053993s
Jan 22 06:46:39.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.465512347s
Jan 22 06:46:41.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.466248642s
Jan 22 06:46:43.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.466191907s
Jan 22 06:46:45.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.466175364s
Jan 22 06:46:47.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.465631636s
Jan 22 06:46:49.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.466281316s
Jan 22 06:46:51.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.466109983s
Jan 22 06:46:53.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.465500901s
Jan 22 06:46:55.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.466349356s
Jan 22 06:46:57.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.465530403s
Jan 22 06:46:59.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.466001341s
Jan 22 06:47:01.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.465577989s
Jan 22 06:47:03.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.466307758s
Jan 22 06:47:05.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.466479901s
Jan 22 06:47:07.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.465899944s
Jan 22 06:47:09.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.466057885s
Jan 22 06:47:11.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.466340595s
Jan 22 06:47:13.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.466222615s
Jan 22 06:47:15.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.466248743s
Jan 22 06:47:17.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.466553066s
Jan 22 06:47:19.577: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.465344567s
Jan 22 06:47:21.579: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.466522984s
Jan 22 06:47:23.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.465707204s
Jan 22 06:47:25.578: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.465447826s
Jan 22 06:47:25.811: INFO: Pod "pod-subpath-test-dynamicpv-fcn2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.698410538s
Jan 22 06:47:26.276: INFO: Failed to get logs from node "i-0f0efd5c06406af22" pod "pod-subpath-test-dynamicpv-fcn2" container "init-volume-dynamicpv-fcn2": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-fcn2)
Jan 22 06:47:26.510: INFO: Failed to get logs from node "i-0f0efd5c06406af22" pod "pod-subpath-test-dynamicpv-fcn2" container "test-container-subpath-dynamicpv-fcn2": the server rejected our request for an unknown reason (get pods pod-subpath-test-dynamicpv-fcn2)
�[1mSTEP:�[0m delete the pod �[38;5;243m01/22/23 06:47:26.51�[0m
Jan 22 06:47:26.746: INFO: Waiting for pod pod-subpath-test-dynamicpv-fcn2 to disappear
Jan 22 06:47:26.979: INFO: Pod pod-subpath-test-dynamicpv-fcn2 still exists
Jan 22 06:47:28.979: INFO: Waiting for pod pod-subpath-test-dynamicpv-fcn2 to disappear
Jan 22 06:47:29.216: INFO: Pod pod-subpath-test-dynamicpv-fcn2 no longer exists
Jan 22 06:47:29.216: INFO: Unexpected error:
<*errors.errorString | 0xc000dba8d0>: {
s: "expected pod \"pod-subpath-test-dynamicpv-fcn2\" success: timed out while waiting for pod provisioning-1608/pod-subpath-test-dynamicpv-fcn2 to be Succeeded or Failed",
}
Jan 22 06:47:29.216: FAIL: expected pod "pod-subpath-test-dynamicpv-fcn2" success: timed out while waiting for pod provisioning-1608/pod-subpath-test-dynamicpv-fcn2 to be Succeeded or Failed
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutputMatcher(0xc002322d80?, {0x75c4bbe?, 0x0?}, 0xc002322d80, 0x0, {0xc000551eb0, 0x1, 0x1}, 0x0?)
test/e2e/framework/pod/output/output.go:237 +0x176
k8s.io/kubernetes/test/e2e/framework/pod/output.TestContainerOutput(...)
test/e2e/framework/pod/output/output.go:214
k8s.io/kubernetes/test/e2e/storage/testsuites.testReadFile(0xc00179b3b0, {0xc0049af9e0, 0x16}, 0xc002322d80, 0x0)
test/e2e/storage/testsuites/subpath.go:691 +0x15c
k8s.io/kubernetes/test/e2e/storage/testsuites.(*subPathTestSuite).DefineTests.func5()
test/e2e/storage/testsuites/subpath.go:227 +0x1b8
�[1mSTEP:�[0m Deleting pod �[38;5;243m01/22/23 06:47:29.216�[0m
Jan 22 06:47:29.216: INFO: Deleting pod "pod-subpath-test-dynamicpv-fcn2" in namespace "provisioning-1608"
�[1mSTEP:�[0m Deleting pvc �[38;5;243m01/22/23 06:47:29.449�[0m
Jan 22 06:47:29.915: INFO: Deleting PersistentVolumeClaim "ebs.csi.aws.comp7sm5"
Jan 22 06:47:30.150: INFO: Waiting up to 5m0s for PersistentVolume pvc-b072ea3e-abe8-497b-8361-ea194ba0e2f8 to get deleted
Jan 22 06:47:30.383: INFO: PersistentVolume pvc-b072ea3e-abe8-497b-8361-ea194ba0e2f8 found and phase=Released (233.271931ms)
Jan 22 06:47:35.616: INFO: PersistentVolume pvc-b072ea3e-abe8-497b-8361-ea194ba0e2f8 found and phase=Released (5.466171496s)
Jan 22 06:47:40.849: INFO: PersistentVolume pvc-b072ea3e-abe8-497b-8361-ea194ba0e2f8 found and phase=Released (10.699545222s)
Jan 22 06:47:46.083: INFO: PersistentVolume pvc-b072ea3e-abe8-497b-8361-ea194ba0e2f8 was removed
�[1mSTEP:�[0m Deleting sc �[38;5;243m01/22/23 06:47:46.083�[0m
[AfterEach] [Testpattern: Dynamic PV (default fs)] subPath
test/e2e/framework/node/init/init.go:32
Jan 22 06:47:46.318: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/22/23 06:47:46.552�[0m
�[1mSTEP:�[0m Collecting events from namespace "provisioning-1608". �[38;5;243m01/22/23 06:47:46.552�[0m
�[1mSTEP:�[0m Found 16 events. �[38;5;243m01/22/23 06:47:46.785�[0m
Jan 22 06:47:46.785: INFO: At 2023-01-22 06:42:24 +0000 UTC - event for ebs.csi.aws.comp7sm5: {persistentvolume-controller } WaitForFirstConsumer: waiting for first consumer to be created before binding
Jan 22 06:47:46.785: INFO: At 2023-01-22 06:42:25 +0000 UTC - event for ebs.csi.aws.comp7sm5: {persistentvolume-controller } ExternalProvisioning: waiting for a volume to be created, either by external provisioner "ebs.csi.aws.com" or manually created by system administrator
Jan 22 06:47:46.785: INFO: At 2023-01-22 06:42:25 +0000 UTC - event for ebs.csi.aws.comp7sm5: {ebs.csi.aws.com_i-0784fefc7d59ccdae_5bf40027-f75b-48e1-bc3f-0cb40c666df3 } Provisioning: External provisioner is provisioning volume for claim "provisioning-1608/ebs.csi.aws.comp7sm5"
Jan 22 06:47:46.785: INFO: At 2023-01-22 06:42:28 +0000 UTC - event for ebs.csi.aws.comp7sm5: {ebs.csi.aws.com_i-0784fefc7d59ccdae_5bf40027-f75b-48e1-bc3f-0cb40c666df3 } ProvisioningSucceeded: Successfully provisioned volume pvc-b072ea3e-abe8-497b-8361-ea194ba0e2f8
Jan 22 06:47:46.785: INFO: At 2023-01-22 06:42:29 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {default-scheduler } Scheduled: Successfully assigned provisioning-1608/pod-subpath-test-dynamicpv-fcn2 to i-0f0efd5c06406af22
Jan 22 06:47:46.785: INFO: At 2023-01-22 06:42:30 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {attachdetach-controller } SuccessfulAttachVolume: AttachVolume.Attach succeeded for volume "pvc-b072ea3e-abe8-497b-8361-ea194ba0e2f8"
Jan 22 06:47:46.785: INFO: At 2023-01-22 06:42:35 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "652a89d2077a22237d1c3dbdc76c803761d7338284f12d67b9ec1014840aa4ae": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:47:46.785: INFO: At 2023-01-22 06:42:48 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "0f6e6dd70a2f6d71e79a39848556aabdff41e1775f4cffdfe809fff6d75ad48d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:47:46.785: INFO: At 2023-01-22 06:42:59 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6cde46e36213a8419be900a091bc2e5ee6f47dd99036e1ef9243cf2f674c1c5c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:47:46.785: INFO: At 2023-01-22 06:43:13 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "58dd163734ba0a8c09ce2c11779cf741dd2671c35e5dacdd4f0018aa0d48301b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:47:46.785: INFO: At 2023-01-22 06:43:25 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "da8272c44f3a12958e1d1172fd05c825d51e9290499e5007220b0a1ab59a142c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:47:46.786: INFO: At 2023-01-22 06:43:38 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "4933fa23a2ec9be3921b9ec71fe346f6477d071e78a502ccae7352407410f69b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:47:46.786: INFO: At 2023-01-22 06:43:51 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5aba979f914d8197e533c67a4a4030e933c91733c1a9c09a5a4adc61ed619d07": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:47:46.786: INFO: At 2023-01-22 06:44:06 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "f2c3e01f6cded4eb66455e758ad81f20c44a195066a5ccb7b9e03db206a5c301": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:47:46.786: INFO: At 2023-01-22 06:44:20 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "aa85fd4a73fbac3bc3830d2040e38f48a0a005ef1ec0edc38ca74d988533c466": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:47:46.786: INFO: At 2023-01-22 06:44:35 +0000 UTC - event for pod-subpath-test-dynamicpv-fcn2: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "79a76b6baec86251ca061e5543024331364992165850ebc5acf1fa098750fd25": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:47:47.018: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 22 06:47:47.018: INFO:
Jan 22 06:47:47.251: INFO:
Logging node info for node i-0784fefc7d59ccdae
Jan 22 06:47:47.484: INFO: Node Info: &Node{ObjectMeta:{i-0784fefc7d59ccdae 578f4339-1faa-4298-ac96-27aed9bc236a 33107 0 2023-01-22 06:24:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0784fefc7d59ccdae kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.129 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0784fefc7d59ccdae"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-22 06:24:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-22 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:24:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-22 06:47:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0784fefc7d59ccdae,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892297728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787440128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.129,},NodeAddress{Type:ExternalIP,Address:43.205.229.145,},NodeAddress{Type:InternalDNS,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-205-229-145.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cca4041964650860029288f425941,SystemUUID:ec2cca40-4196-4650-8600-29288f425941,BootID:6d7bd66f-7345-4f07-a0a9-6dcf8a9b9a01,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643680,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841303,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965801,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 22 06:47:47.484: INFO:
Logging kubelet events for node i-0784fefc7d59ccdae
Jan 22 06:47:47.719: INFO:
Logging pods the kubelet thinks is on node i-0784fefc7d59ccdae
Jan 22 06:47:47.966: INFO: kops-controller-l7kst started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:47.966: INFO: Container kops-controller ready: true, restart count 0
Jan 22 06:47:47.966: INFO: aws-cloud-controller-manager-md9vc started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:47.966: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 22 06:47:47.966: INFO: cilium-operator-5dd44dc49f-2hpqt started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:47.966: INFO: Container cilium-operator ready: true, restart count 1
Jan 22 06:47:47.966: INFO: kube-apiserver-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+2 container statuses recorded)
Jan 22 06:47:47.966: INFO: Container healthcheck ready: true, restart count 0
Jan 22 06:47:47.966: INFO: Container kube-apiserver ready: true, restart count 1
Jan 22 06:47:47.966: INFO: kube-controller-manager-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:47.966: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 22 06:47:47.966: INFO: etcd-manager-events-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:47.966: INFO: Container etcd-manager ready: true, restart count 0
Jan 22 06:47:47.966: INFO: cilium-dphgw started at 2023-01-22 06:24:40 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:47:47.966: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:47:47.966: INFO: Container cilium-agent ready: true, restart count 1
Jan 22 06:47:47.966: INFO: dns-controller-69987775c6-gdndv started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:47.966: INFO: Container dns-controller ready: true, restart count 0
Jan 22 06:47:47.966: INFO: ebs-csi-controller-5bd98b456f-xxxj2 started at 2023-01-22 06:24:41 +0000 UTC (0+5 container statuses recorded)
Jan 22 06:47:47.966: INFO: Container csi-attacher ready: true, restart count 0
Jan 22 06:47:47.966: INFO: Container csi-provisioner ready: true, restart count 0
Jan 22 06:47:47.966: INFO: Container csi-resizer ready: true, restart count 0
Jan 22 06:47:47.966: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:47:47.966: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:47:47.966: INFO: etcd-manager-main-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:47.966: INFO: Container etcd-manager ready: true, restart count 0
Jan 22 06:47:47.966: INFO: kube-scheduler-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:47.966: INFO: Container kube-scheduler ready: true, restart count 0
Jan 22 06:47:47.966: INFO: ebs-csi-node-2wncs started at 2023-01-22 06:24:40 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:47:47.966: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:47:47.966: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:47:47.966: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:47:48.737: INFO:
Latency metrics for node i-0784fefc7d59ccdae
Jan 22 06:47:48.737: INFO:
Logging node info for node i-08fe7e7767ef6cb6b
Jan 22 06:47:48.970: INFO: Node Info: &Node{ObjectMeta:{i-08fe7e7767ef6cb6b 2145b9b6-87c4-4056-9d33-2bdbd91f3e25 32389 0 2023-01-22 06:25:50 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08fe7e7767ef6cb6b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-08fe7e7767ef6cb6b topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.140 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6527":"i-08fe7e7767ef6cb6b","ebs.csi.aws.com":"i-08fe7e7767ef6cb6b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:43:56 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:44:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-08fe7e7767ef6cb6b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:44:04 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:44:04 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:44:04 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:44:04 +0000 UTC,LastTransitionTime:2023-01-22 06:26:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.140,},NodeAddress{Type:ExternalIP,Address:15.206.168.164,},NodeAddress{Type:InternalDNS,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-168-164.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec244e84b4a6ab10c46e08d94bf33aed,SystemUUID:ec244e84-b4a6-ab10-c46e-08d94bf33aed,BootID:d699615e-6b18-42f3-878b-638f85804381,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6527^23d61fad-9a20-11ed-9e74-2a6fb9be6585 kubernetes.io/csi/csi-hostpath-ephemeral-6527^e5ab0ab6-9a1f-11ed-9e74-2a6fb9be6585 kubernetes.io/csi/ebs.csi.aws.com^vol-0319e775eeab878e5 kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6527^e5ab0ab6-9a1f-11ed-9e74-2a6fb9be6585,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0319e775eeab878e5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6527^23d61fad-9a20-11ed-9e74-2a6fb9be6585,DevicePath:,},},Config:nil,},}
Jan 22 06:47:48.970: INFO:
Logging kubelet events for node i-08fe7e7767ef6cb6b
Jan 22 06:47:49.206: INFO:
Logging pods the kubelet thinks is on node i-08fe7e7767ef6cb6b
Jan 22 06:47:49.449: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wc9kg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:49.449: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:42:05 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container csi-attacher ready: true, restart count 0
Jan 22 06:47:49.449: INFO: Container csi-provisioner ready: true, restart count 0
Jan 22 06:47:49.449: INFO: Container csi-resizer ready: true, restart count 0
Jan 22 06:47:49.449: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 22 06:47:49.449: INFO: Container hostpath ready: true, restart count 0
Jan 22 06:47:49.449: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:47:49.449: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:47:49.449: INFO: inline-volume-tester-xj8gr started at 2023-01-22 06:42:13 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 22 06:47:49.449: INFO: security-context-7c4c6663-c573-4295-85c0-25082df8e8cc started at 2023-01-22 06:43:38 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container test-container ready: false, restart count 0
Jan 22 06:47:49.449: INFO: pod-subpath-test-preprovisionedpv-shw9 started at 2023-01-22 06:45:13 +0000 UTC (2+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Init container init-volume-preprovisionedpv-shw9 ready: false, restart count 0
Jan 22 06:47:49.449: INFO: Init container test-init-subpath-preprovisionedpv-shw9 ready: false, restart count 0
Jan 22 06:47:49.449: INFO: Container test-container-subpath-preprovisionedpv-shw9 ready: false, restart count 0
Jan 22 06:47:49.449: INFO: cilium-dc97x started at 2023-01-22 06:25:51 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:47:49.449: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:47:49.449: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cfk97 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:49.449: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-b8jbr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:47:49.449: INFO: pod-51d1d92b-6389-4de0-9afd-a591763fbab3 started at 2023-01-22 06:42:26 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container write-pod ready: true, restart count 0
Jan 22 06:47:49.449: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-l8cqz started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:47:49.449: INFO: pod-server-1 started at 2023-01-22 06:47:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container agnhost-container ready: false, restart count 0
Jan 22 06:47:49.449: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hgtwv started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:49.449: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6zw5t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:49.449: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hvhkb started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:49.449: INFO: hostexec-i-08fe7e7767ef6cb6b-b5hs4 started at 2023-01-22 06:42:10 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:47:49.449: INFO: pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd started at 2023-01-22 06:42:07 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container write-pod ready: false, restart count 0
Jan 22 06:47:49.449: INFO: pod-7b4fd2ad-817b-43ad-ac65-86d08b9d8d33 started at 2023-01-22 06:42:32 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container write-pod ready: false, restart count 0
Jan 22 06:47:49.449: INFO: ss-1 started at 2023-01-22 06:42:43 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container webserver ready: false, restart count 0
Jan 22 06:47:49.449: INFO: netserver-0 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container webserver ready: false, restart count 0
Jan 22 06:47:49.449: INFO: ebs-csi-node-l5r6q started at 2023-01-22 06:25:51 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:47:49.449: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:47:49.449: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:47:49.449: INFO: test-grpc-f3275850-1d27-4e1f-a5e5-359a5f91c9eb started at 2023-01-22 06:43:17 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container etcd ready: false, restart count 0
Jan 22 06:47:49.449: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wj87w started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:49.449: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-s7ksv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:49.449: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gpz5p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:49.449: INFO: csi-mockplugin-0 started at 2023-01-22 06:42:34 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:47:49.449: INFO: Container driver-registrar ready: false, restart count 0
Jan 22 06:47:49.449: INFO: Container mock ready: false, restart count 0
Jan 22 06:47:49.449: INFO: inline-volume-tester2-tx2n9 started at 2023-01-22 06:43:56 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 22 06:47:49.449: INFO: hostexec-i-08fe7e7767ef6cb6b-hvhc4 started at 2023-01-22 06:45:03 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:47:49.449: INFO: pod-secrets-8bddb517-320a-4b52-ada4-d992ad1e745c started at 2023-01-22 06:47:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container secret-volume-test ready: false, restart count 0
Jan 22 06:47:49.449: INFO: csi-mockplugin-attacher-0 started at 2023-01-22 06:42:34 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:49.449: INFO: Container csi-attacher ready: true, restart count 0
Jan 22 06:47:50.259: INFO:
Latency metrics for node i-08fe7e7767ef6cb6b
Jan 22 06:47:50.259: INFO:
Logging node info for node i-0ae272b208fd17383
Jan 22 06:47:50.492: INFO: Node Info: &Node{ObjectMeta:{i-0ae272b208fd17383 8e603661-0a86-4442-9629-8fb60195f947 33502 0 2023-01-22 06:25:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ae272b208fd17383 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0ae272b208fd17383 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.122 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ae272b208fd17383"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:47:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0ae272b208fd17383,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:44 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:44 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:44 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:44 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.122,},NodeAddress{Type:ExternalIP,Address:13.233.206.115,},NodeAddress{Type:InternalDNS,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-206-115.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2696eee3a2748c57a2a7a5dcde49ea,SystemUUID:ec2696ee-e3a2-748c-57a2-a7a5dcde49ea,BootID:d7d392b7-67d7-4101-be08-ed3bfe242022,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c,DevicePath:,},},Config:nil,},}
Jan 22 06:47:50.493: INFO:
Logging kubelet events for node i-0ae272b208fd17383
Jan 22 06:47:50.728: INFO:
Logging pods the kubelet thinks is on node i-0ae272b208fd17383
Jan 22 06:47:50.966: INFO: netserver-1 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container webserver ready: false, restart count 0
Jan 22 06:47:50.966: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-89kjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:50.966: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2rgjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:50.966: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-tgn4t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:50.966: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-94drq started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:50.966: INFO: run-test started at 2023-01-22 06:47:44 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container run-test ready: false, restart count 0
Jan 22 06:47:50.966: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-5nknv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:50.966: INFO: coredns-559769c974-j8pxd started at 2023-01-22 06:26:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container coredns ready: true, restart count 0
Jan 22 06:47:50.966: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-224vl started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:50.966: INFO: inline-volume-tester-cpf2m started at 2023-01-22 06:47:34 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 22 06:47:50.966: INFO: ebs-csi-node-x6xfs started at 2023-01-22 06:25:56 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:47:50.966: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:47:50.966: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:47:50.966: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gv8d9 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:50.966: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-jhxvf started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:47:50.966: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-nqs66 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:50.966: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-j8nx8 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:50.966: INFO: cilium-svdg2 started at 2023-01-22 06:25:56 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:47:50.966: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:47:50.966: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:47:51.802: INFO:
Latency metrics for node i-0ae272b208fd17383
Jan 22 06:47:51.802: INFO:
Logging node info for node i-0f0efd5c06406af22
Jan 22 06:47:52.035: INFO: Node Info: &Node{ObjectMeta:{i-0f0efd5c06406af22 d621d241-d0c1-4fcd-95f1-3043a1e318e5 33249 0 2023-01-22 06:25:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f0efd5c06406af22 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f0efd5c06406af22 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.247 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-8268":"i-0f0efd5c06406af22","ebs.csi.aws.com":"i-0f0efd5c06406af22"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:31 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:47:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f0efd5c06406af22,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.247,},NodeAddress{Type:ExternalIP,Address:13.232.42.154,},NodeAddress{Type:InternalDNS,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-42-154.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27fd43a8a03a2384a7278d59d4ca0e,SystemUUID:ec27fd43-a8a0-3a23-84a7-278d59d4ca0e,BootID:5cf896d3-1ac6-483b-85fc-643267ffe608,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-8268^f4777368-9a1f-11ed-8b17-62b0431a56d0 kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4,DevicePath:,},},Config:nil,},}
Jan 22 06:47:52.035: INFO:
Logging kubelet events for node i-0f0efd5c06406af22
Jan 22 06:47:52.270: INFO:
Logging pods the kubelet thinks is on node i-0f0efd5c06406af22
Jan 22 06:47:52.510: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-dvbvr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:52.510: INFO: ss-0 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container webserver ready: true, restart count 0
Jan 22 06:47:52.510: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-sdq2g started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:52.510: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-kdjqj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:52.510: INFO: ebs-csi-node-nf6tg started at 2023-01-22 06:25:55 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:47:52.510: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:47:52.510: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:47:52.510: INFO: pfpod started at 2023-01-22 06:43:50 +0000 UTC (0+2 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container portforwardtester ready: false, restart count 0
Jan 22 06:47:52.510: INFO: Container readiness ready: false, restart count 0
Jan 22 06:47:52.510: INFO: csi-mockplugin-0 started at 2023-01-22 06:42:06 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container csi-provisioner ready: true, restart count 0
Jan 22 06:47:52.510: INFO: Container driver-registrar ready: true, restart count 0
Jan 22 06:47:52.510: INFO: Container mock ready: true, restart count 0
Jan 22 06:47:52.510: INFO: csi-mockplugin-attacher-0 started at 2023-01-22 06:42:07 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:47:52.510: INFO: cilium-g9f7f started at 2023-01-22 06:25:55 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:47:52.510: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:47:52.510: INFO: csi-mockplugin-0 started at 2023-01-22 06:47:48 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:47:52.510: INFO: Container driver-registrar ready: false, restart count 0
Jan 22 06:47:52.510: INFO: Container mock ready: false, restart count 0
Jan 22 06:47:52.510: INFO: hostexec-i-0f0efd5c06406af22-ztx2q started at 2023-01-22 06:47:36 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:47:52.510: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8n6lz started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:52.510: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lm57z started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:52.510: INFO: pvc-volume-tester-jcq6v started at 2023-01-22 06:42:36 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container volume-tester ready: false, restart count 0
Jan 22 06:47:52.510: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2k9d6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:52.510: INFO: netserver-2 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container webserver ready: false, restart count 0
Jan 22 06:47:52.510: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-pc777 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:52.510: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lms68 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:52.510: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-swsd5 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:52.510: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-d5vgg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:47:52.510: INFO: httpd started at 2023-01-22 06:43:03 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:52.510: INFO: Container httpd ready: true, restart count 0
Jan 22 06:47:53.306: INFO:
Latency metrics for node i-0f0efd5c06406af22
Jan 22 06:47:53.306: INFO:
Logging node info for node i-0f65ec97613c55060
Jan 22 06:47:53.539: INFO: Node Info: &Node{ObjectMeta:{i-0f65ec97613c55060 3b12d6e2-1a35-47ff-9dac-e4586b70e64b 33170 0 2023-01-22 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f65ec97613c55060 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f65ec97613c55060 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.23 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f65ec97613c55060"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-22 06:47:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f65ec97613c55060,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:24 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:24 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:24 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:24 +0000 UTC,LastTransitionTime:2023-01-22 06:26:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.23,},NodeAddress{Type:ExternalIP,Address:13.233.125.79,},NodeAddress{Type:InternalDNS,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-125-79.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec29271f6fcb1e589a5709b97d78e95d,SystemUUID:ec29271f-6fcb-1e58-9a57-09b97d78e95d,BootID:67de0a94-242d-47e1-96b0-5dc05022ee13,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 22 06:47:53.540: INFO:
Logging kubelet events for node i-0f65ec97613c55060
Jan 22 06:47:53.775: INFO:
Logging pods the kubelet thinks is on node i-0f65ec97613c55060
Jan 22 06:47:54.014: INFO: cilium-582c5 started at 2023-01-22 06:25:52 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:47:54.014: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:47:54.014: INFO: coredns-autoscaler-7cb5c5b969-jts8s started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container autoscaler ready: true, restart count 0
Jan 22 06:47:54.014: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8qsbj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:47:54.014: INFO: pod-client started at 2023-01-22 06:43:18 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container pod-client ready: true, restart count 0
Jan 22 06:47:54.014: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cct9p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:54.014: INFO: netserver-3 started at 2023-01-22 06:47:29 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container webserver ready: false, restart count 0
Jan 22 06:47:54.014: INFO: inline-volume-tester2-5g7d4 started at 2023-01-22 06:47:51 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 22 06:47:54.014: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdhsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:54.014: INFO: ebs-csi-node-wnt99 started at 2023-01-22 06:25:52 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:47:54.014: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:47:54.014: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:47:54.014: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2zr97 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:47:54.014: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-n4scw started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:54.014: INFO: coredns-559769c974-s8kkg started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container coredns ready: true, restart count 0
Jan 22 06:47:54.014: INFO: busybox-readonly-true-2fe51bf6-e622-4739-b4d8-f2c74b6c4b49 started at 2023-01-22 06:47:49 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container busybox-readonly-true-2fe51bf6-e622-4739-b4d8-f2c74b6c4b49 ready: false, restart count 0
Jan 22 06:47:54.014: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6wbqw started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:54.014: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8sv6x started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:54.014: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-52gsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:54.014: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6bwjg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:54.014: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdcz6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:47:54.014: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:47:54.839: INFO:
Latency metrics for node i-0f65ec97613c55060
[DeferCleanup (Each)] [Testpattern: Dynamic PV (default fs)] subPath
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "provisioning-1608" for this suite. �[38;5;243m01/22/23 06:47:54.839�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-apps\]\sReplicaSet\sReplicaset\sshould\shave\sa\sworking\sscale\ssubresource\s\[Conformance\]$'
test/e2e/apps/replica_set.go:425 k8s.io/kubernetes/test/e2e/apps.testRSScaleSubresources(0xc0047a8c30?) test/e2e/apps/replica_set.go:425 +0x4cb k8s.io/kubernetes/test/e2e/apps.glob..func9.5() test/e2e/apps/replica_set.go:144 +0x1dfrom junit_01.xml
[BeforeEach] [sig-apps] ReplicaSet set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/22/23 06:49:56.981�[0m Jan 22 06:49:56.981: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename replicaset �[38;5;243m01/22/23 06:49:56.983�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/22/23 06:49:57.68�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/22/23 06:49:58.143�[0m [BeforeEach] [sig-apps] ReplicaSet test/e2e/framework/metrics/init/init.go:31 [It] Replicaset should have a working scale subresource [Conformance] test/e2e/apps/replica_set.go:143 �[1mSTEP:�[0m Creating replica set "test-rs" that asks for more than the allowed pod quota �[38;5;243m01/22/23 06:49:58.606�[0m Jan 22 06:49:59.072: INFO: Pod name sample-pod: Found 1 pods out of 1 �[1mSTEP:�[0m ensuring each pod is running �[38;5;243m01/22/23 06:49:59.072�[0m Jan 22 06:49:59.072: INFO: Waiting up to 5m0s for pod "test-rs-q8xtv" in namespace "replicaset-7784" to be "running" Jan 22 06:49:59.304: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 232.106111ms Jan 22 06:50:01.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.464729314s Jan 22 06:50:03.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.465314128s Jan 22 06:50:05.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.465415483s Jan 22 06:50:07.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 8.465149214s Jan 22 06:50:09.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 10.465387174s Jan 22 06:50:11.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 12.465774807s Jan 22 06:50:13.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 14.464835231s Jan 22 06:50:15.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 16.465201356s Jan 22 06:50:17.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 18.465073224s Jan 22 06:50:19.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 20.464878741s Jan 22 06:50:21.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 22.464622448s Jan 22 06:50:23.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 24.464794218s Jan 22 06:50:25.541: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 26.468413255s Jan 22 06:50:27.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 28.464458712s Jan 22 06:50:29.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 30.46489819s Jan 22 06:50:31.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 32.465159488s Jan 22 06:50:33.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 34.465035198s Jan 22 06:50:35.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 36.465198174s Jan 22 06:50:37.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 38.464840878s Jan 22 06:50:39.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 40.465174269s Jan 22 06:50:41.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 42.465214614s Jan 22 06:50:43.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 44.465314433s Jan 22 06:50:45.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 46.466249346s Jan 22 06:50:47.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 48.464834727s Jan 22 06:50:49.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 50.464792786s Jan 22 06:50:51.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 52.465494771s Jan 22 06:50:53.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 54.464977404s Jan 22 06:50:55.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 56.465233743s Jan 22 06:50:57.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 58.464922406s Jan 22 06:50:59.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.464936841s Jan 22 06:51:01.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.465407607s Jan 22 06:51:03.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.465219228s Jan 22 06:51:05.539: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.46726374s Jan 22 06:51:07.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.466244219s Jan 22 06:51:09.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.465879963s Jan 22 06:51:11.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.466139748s Jan 22 06:51:13.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.465108753s Jan 22 06:51:15.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.465177699s Jan 22 06:51:17.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.465342566s Jan 22 06:51:19.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.46582362s Jan 22 06:51:21.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.46532988s Jan 22 06:51:23.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.465092648s Jan 22 06:51:25.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.465070824s Jan 22 06:51:27.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.465190911s Jan 22 06:51:29.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.464988876s Jan 22 06:51:31.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.464790507s Jan 22 06:51:33.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.465259022s Jan 22 06:51:35.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.465297483s Jan 22 06:51:37.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.46548191s Jan 22 06:51:39.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.465384056s Jan 22 06:51:41.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.46515216s Jan 22 06:51:43.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.465398541s Jan 22 06:51:45.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.464731491s Jan 22 06:51:47.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.465057195s Jan 22 06:51:49.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.465407903s Jan 22 06:51:51.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.465306713s Jan 22 06:51:53.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.46572781s Jan 22 06:51:55.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.464953005s Jan 22 06:51:57.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.464415785s Jan 22 06:51:59.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.464996587s Jan 22 06:52:01.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.464705776s Jan 22 06:52:03.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.465249256s Jan 22 06:52:05.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.465176666s Jan 22 06:52:07.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.465194202s Jan 22 06:52:09.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.464777056s Jan 22 06:52:11.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.464770198s Jan 22 06:52:13.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.465056433s Jan 22 06:52:15.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.464704429s Jan 22 06:52:17.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.46538066s Jan 22 06:52:19.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.464899401s Jan 22 06:52:21.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.464968071s Jan 22 06:52:23.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.465206597s Jan 22 06:52:25.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.465072954s Jan 22 06:52:27.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.465159698s Jan 22 06:52:29.536: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.464122745s Jan 22 06:52:31.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.465206066s Jan 22 06:52:33.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.464532358s Jan 22 06:52:35.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.464949184s Jan 22 06:52:37.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.46540753s Jan 22 06:52:39.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.465204602s Jan 22 06:52:41.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.465171586s Jan 22 06:52:43.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.464925159s Jan 22 06:52:45.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.464717444s Jan 22 06:52:47.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.465100472s Jan 22 06:52:49.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.464570853s Jan 22 06:52:51.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.465600016s Jan 22 06:52:53.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.465084534s Jan 22 06:52:55.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.465292925s Jan 22 06:52:57.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.465079336s Jan 22 06:52:59.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.46484505s Jan 22 06:53:01.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.464768547s Jan 22 06:53:03.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.465482705s Jan 22 06:53:05.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.465230084s Jan 22 06:53:07.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.465048277s Jan 22 06:53:09.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.465548922s Jan 22 06:53:11.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.465140191s Jan 22 06:53:13.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.465215915s Jan 22 06:53:15.539: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.466511886s Jan 22 06:53:17.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.465094306s Jan 22 06:53:19.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.465325758s Jan 22 06:53:21.539: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.466381439s Jan 22 06:53:23.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.464862508s Jan 22 06:53:25.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.464970778s Jan 22 06:53:27.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.464610598s Jan 22 06:53:29.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.464628781s Jan 22 06:53:31.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.464586658s Jan 22 06:53:33.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.465212953s Jan 22 06:53:35.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.464811946s Jan 22 06:53:37.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.465156155s Jan 22 06:53:39.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.464861828s Jan 22 06:53:41.536: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.464262936s Jan 22 06:53:43.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.46450043s Jan 22 06:53:45.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.46437539s Jan 22 06:53:47.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.464700333s Jan 22 06:53:49.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.46549784s Jan 22 06:53:51.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.464956907s Jan 22 06:53:53.541: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.468936678s Jan 22 06:53:55.536: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.464058323s Jan 22 06:53:57.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.465097419s Jan 22 06:53:59.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.46468793s Jan 22 06:54:01.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.465163031s Jan 22 06:54:03.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.465603657s Jan 22 06:54:05.541: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.46832145s Jan 22 06:54:07.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.465024578s Jan 22 06:54:09.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.465059967s Jan 22 06:54:11.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.464829976s Jan 22 06:54:13.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.46526844s Jan 22 06:54:15.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.465625799s Jan 22 06:54:17.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.464893467s Jan 22 06:54:19.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.465567827s Jan 22 06:54:21.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.465114248s Jan 22 06:54:23.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.465471452s Jan 22 06:54:25.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.465342529s Jan 22 06:54:27.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.464961362s Jan 22 06:54:29.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.465152278s Jan 22 06:54:31.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.464923915s Jan 22 06:54:33.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.465232413s Jan 22 06:54:35.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.464803345s Jan 22 06:54:37.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.465009886s Jan 22 06:54:39.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.465140323s Jan 22 06:54:41.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.464723488s Jan 22 06:54:43.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.465091027s Jan 22 06:54:45.538: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.465363897s Jan 22 06:54:47.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.464686135s Jan 22 06:54:49.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.464997961s Jan 22 06:54:51.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.465104279s Jan 22 06:54:53.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.465015849s Jan 22 06:54:55.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.464776175s Jan 22 06:54:57.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.464899407s Jan 22 06:54:59.537: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.4649437s Jan 22 06:54:59.769: INFO: Pod "test-rs-q8xtv": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.697195663s Jan 22 06:54:59.769: INFO: Unexpected error: error in waiting for pods to come up: failed to wait for pods running: [timed out while waiting for pod replicaset-7784/test-rs-q8xtv to be running]: <*errors.errorString | 0xc0012df320>: { s: "failed to wait for pods running: [timed out while waiting for pod replicaset-7784/test-rs-q8xtv to be running]", } Jan 22 06:54:59.770: FAIL: error in waiting for pods to come up: failed to wait for pods running: [timed out while waiting for pod replicaset-7784/test-rs-q8xtv to be running]: failed to wait for pods running: [timed out while waiting for pod replicaset-7784/test-rs-q8xtv to be running] Full Stack Trace k8s.io/kubernetes/test/e2e/apps.testRSScaleSubresources(0xc0047a8c30?) test/e2e/apps/replica_set.go:425 +0x4cb k8s.io/kubernetes/test/e2e/apps.glob..func9.5() test/e2e/apps/replica_set.go:144 +0x1d [AfterEach] [sig-apps] ReplicaSet test/e2e/framework/node/init/init.go:32 Jan 22 06:54:59.770: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-apps] ReplicaSet test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-apps] ReplicaSet dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/22/23 06:55:00.003�[0m �[1mSTEP:�[0m Collecting events from namespace "replicaset-7784". �[38;5;243m01/22/23 06:55:00.003�[0m �[1mSTEP:�[0m Found 12 events. �[38;5;243m01/22/23 06:55:00.235�[0m Jan 22 06:55:00.236: INFO: At 2023-01-22 06:49:58 +0000 UTC - event for test-rs: {replicaset-controller } SuccessfulCreate: Created pod: test-rs-q8xtv Jan 22 06:55:00.236: INFO: At 2023-01-22 06:49:58 +0000 UTC - event for test-rs-q8xtv: {default-scheduler } Scheduled: Successfully assigned replicaset-7784/test-rs-q8xtv to i-08fe7e7767ef6cb6b Jan 22 06:55:00.236: INFO: At 2023-01-22 06:49:59 +0000 UTC - event for test-rs-q8xtv: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "26c1adea5116736509f771f875d41eee08b879bafdec27bbb4d715d5f1ba56e2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:55:00.236: INFO: At 2023-01-22 06:50:10 +0000 UTC - event for test-rs-q8xtv: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "373c063583eab59565bde2e3ad1c66e583bce05b8de66f0e2c549d91b4b8dca4": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:55:00.236: INFO: At 2023-01-22 06:50:23 +0000 UTC - event for test-rs-q8xtv: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5e07d954a5c056bb81add9ba1248aa8af290b4bfa6ceae4be844ec53e8ba231a": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:55:00.236: INFO: At 2023-01-22 06:50:38 +0000 UTC - event for test-rs-q8xtv: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "1ab009f53ea7a6639441851a3379d8bc919db66b1f8460a587e0a3ed07dcdace": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:55:00.236: INFO: At 2023-01-22 06:50:53 +0000 UTC - event for test-rs-q8xtv: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c59bac2d19da7d7c344b2261d8fe7d57e09e5edf6fc71b312684aa969856af75": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:55:00.236: INFO: At 2023-01-22 06:51:06 +0000 UTC - event for test-rs-q8xtv: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5fa175ece17873ff1b4a5944e507c11ac64fe460e5b1b9320dbdac6c91925ee3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:55:00.236: INFO: At 2023-01-22 06:51:21 +0000 UTC - event for test-rs-q8xtv: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6a56ed44e70e17c9f5f3fd13e6359571595e46b949cfe52b14e9e8f9d6a67382": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:55:00.236: INFO: At 2023-01-22 06:51:34 +0000 UTC - event for test-rs-q8xtv: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "37f4977dd5be54fcb30eff7d70e48a4fbd9b11a16186fee19068c0199de7bec5": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:55:00.236: INFO: At 2023-01-22 06:51:48 +0000 UTC - event for test-rs-q8xtv: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ff83279f54a0edced62c08c250e2db1aae2443617b2132f8d610cbaea53c62cd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:55:00.236: INFO: At 2023-01-22 06:51:59 +0000 UTC - event for test-rs-q8xtv: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "df5e595c1068ade2912ffd7202c9fc8680ea680830c697a0661843849bbfc1a3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:55:00.467: INFO: POD NODE PHASE GRACE CONDITIONS Jan 22 06:55:00.467: INFO: test-rs-q8xtv i-08fe7e7767ef6cb6b Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:49:58 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:49:58 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:49:58 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:49:58 +0000 UTC }] Jan 22 06:55:00.467: INFO: Jan 22 06:55:00.702: INFO: Unable to fetch replicaset-7784/test-rs-q8xtv/httpd logs: the server rejected our request for an unknown reason (get pods test-rs-q8xtv) Jan 22 06:55:00.935: INFO: Logging node info for node i-0784fefc7d59ccdae Jan 22 06:55:01.167: INFO: Node Info: &Node{ObjectMeta:{i-0784fefc7d59ccdae 578f4339-1faa-4298-ac96-27aed9bc236a 35489 0 2023-01-22 06:24:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0784fefc7d59ccdae kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.129 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0784fefc7d59ccdae"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-22 06:24:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-22 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:24:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-22 06:52:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0784fefc7d59ccdae,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892297728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787440128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:15 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:15 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:15 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:52:15 +0000 UTC,LastTransitionTime:2023-01-22 06:24:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.129,},NodeAddress{Type:ExternalIP,Address:43.205.229.145,},NodeAddress{Type:InternalDNS,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-205-229-145.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cca4041964650860029288f425941,SystemUUID:ec2cca40-4196-4650-8600-29288f425941,BootID:6d7bd66f-7345-4f07-a0a9-6dcf8a9b9a01,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643680,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841303,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965801,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 22 06:55:01.167: INFO: Logging kubelet events for node i-0784fefc7d59ccdae Jan 22 06:55:01.402: INFO: Logging pods the kubelet thinks is on node i-0784fefc7d59ccdae Jan 22 06:55:01.640: INFO: ebs-csi-controller-5bd98b456f-xxxj2 started at 2023-01-22 06:24:41 +0000 UTC (0+5 container statuses recorded) Jan 22 06:55:01.640: INFO: Container csi-attacher ready: true, restart count 0 Jan 22 06:55:01.640: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 06:55:01.640: INFO: Container csi-resizer ready: true, restart count 0 Jan 22 06:55:01.640: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:55:01.640: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:55:01.640: INFO: etcd-manager-main-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:01.640: INFO: Container etcd-manager ready: true, restart count 0 Jan 22 06:55:01.640: INFO: kube-scheduler-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:01.640: INFO: Container kube-scheduler ready: true, restart count 0 Jan 22 06:55:01.640: INFO: ebs-csi-node-2wncs started at 2023-01-22 06:24:40 +0000 UTC (0+3 container statuses recorded) Jan 22 06:55:01.640: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:55:01.640: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:55:01.640: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:55:01.640: INFO: cilium-dphgw started at 2023-01-22 06:24:40 +0000 UTC (1+1 container statuses recorded) Jan 22 06:55:01.640: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:55:01.640: INFO: Container cilium-agent ready: true, restart count 1 Jan 22 06:55:01.640: INFO: dns-controller-69987775c6-gdndv started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:01.640: INFO: Container dns-controller ready: true, restart count 0 Jan 22 06:55:01.640: INFO: cilium-operator-5dd44dc49f-2hpqt started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:01.640: INFO: Container cilium-operator ready: true, restart count 1 Jan 22 06:55:01.640: INFO: kube-apiserver-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+2 container statuses recorded) Jan 22 06:55:01.640: INFO: Container healthcheck ready: true, restart count 0 Jan 22 06:55:01.640: INFO: Container kube-apiserver ready: true, restart count 1 Jan 22 06:55:01.640: INFO: kube-controller-manager-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:01.640: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 22 06:55:01.640: INFO: etcd-manager-events-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:01.640: INFO: Container etcd-manager ready: true, restart count 0 Jan 22 06:55:01.640: INFO: kops-controller-l7kst started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:01.640: INFO: Container kops-controller ready: true, restart count 0 Jan 22 06:55:01.640: INFO: aws-cloud-controller-manager-md9vc started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:01.640: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 22 06:55:02.400: INFO: Latency metrics for node i-0784fefc7d59ccdae Jan 22 06:55:02.400: INFO: Logging node info for node i-08fe7e7767ef6cb6b Jan 22 06:55:02.633: INFO: Node Info: &Node{ObjectMeta:{i-08fe7e7767ef6cb6b 2145b9b6-87c4-4056-9d33-2bdbd91f3e25 36724 0 2023-01-22 06:25:50 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08fe7e7767ef6cb6b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-08fe7e7767ef6cb6b topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.140 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-6487":"i-08fe7e7767ef6cb6b","ebs.csi.aws.com":"i-08fe7e7767ef6cb6b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:54:26 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:54:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-08fe7e7767ef6cb6b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:54:27 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:54:27 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:54:27 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:54:27 +0000 UTC,LastTransitionTime:2023-01-22 06:26:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.140,},NodeAddress{Type:ExternalIP,Address:15.206.168.164,},NodeAddress{Type:InternalDNS,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-168-164.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec244e84b4a6ab10c46e08d94bf33aed,SystemUUID:ec244e84-b4a6-ab10-c46e-08d94bf33aed,BootID:d699615e-6b18-42f3-878b-638f85804381,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-6487^d59ef7b4-9a20-11ed-8c0b-9a4b66333a9e kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1 kubernetes.io/csi/ebs.csi.aws.com^vol-0f86ecd63c183933f],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0f86ecd63c183933f,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1,DevicePath:,},},Config:nil,},} Jan 22 06:55:02.633: INFO: Logging kubelet events for node i-08fe7e7767ef6cb6b Jan 22 06:55:02.868: INFO: Logging pods the kubelet thinks is on node i-08fe7e7767ef6cb6b Jan 22 06:55:03.131: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hgtwv started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:03.131: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6zw5t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:03.131: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hvhkb started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:03.131: INFO: ss-1 started at 2023-01-22 06:42:43 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container webserver ready: true, restart count 0 Jan 22 06:55:03.131: INFO: ebs-csi-node-l5r6q started at 2023-01-22 06:25:51 +0000 UTC (0+3 container statuses recorded) Jan 22 06:55:03.131: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:55:03.131: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:55:03.131: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:55:03.131: INFO: nodeport-test-6dfdc started at 2023-01-22 06:49:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container nodeport-test ready: false, restart count 0 Jan 22 06:55:03.131: INFO: hostpath-symlink-prep-provisioning-3728 started at 2023-01-22 06:50:02 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container init-volume-provisioning-3728 ready: false, restart count 0 Jan 22 06:55:03.131: INFO: httpd started at 2023-01-22 06:54:11 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container httpd ready: true, restart count 0 Jan 22 06:55:03.131: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wj87w started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:03.131: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-s7ksv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:03.131: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gpz5p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:03.131: INFO: csi-mockplugin-attacher-0 started at 2023-01-22 06:48:03 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:55:03.131: INFO: test-rs-xg558 started at 2023-01-22 06:52:48 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container httpd ready: false, restart count 0 Jan 22 06:55:03.131: INFO: pod-configmaps-ff2dafa2-f248-436c-af02-1f7e49c2a98c started at 2023-01-22 06:53:01 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container agnhost-container ready: false, restart count 0 Jan 22 06:55:03.131: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wc9kg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:03.131: INFO: pod-6b476aa3-d846-4f9c-939d-2491a5bc640e started at 2023-01-22 06:53:26 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container test-container ready: false, restart count 0 Jan 22 06:55:03.131: INFO: csi-mockplugin-0 started at 2023-01-22 06:48:03 +0000 UTC (0+3 container statuses recorded) Jan 22 06:55:03.131: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 06:55:03.131: INFO: Container driver-registrar ready: true, restart count 0 Jan 22 06:55:03.131: INFO: Container mock ready: true, restart count 0 Jan 22 06:55:03.131: INFO: pod-c37e8584-ca2e-4abf-9162-fb551b76095b started at 2023-01-22 06:54:24 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container write-pod ready: false, restart count 0 Jan 22 06:55:03.131: INFO: pvc-volume-tester-274d7 started at 2023-01-22 06:48:54 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container volume-tester ready: false, restart count 0 Jan 22 06:55:03.131: INFO: test-rs-q8xtv started at 2023-01-22 06:49:58 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container httpd ready: false, restart count 0 Jan 22 06:55:03.131: INFO: netserver-0 started at 2023-01-22 06:53:32 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container webserver ready: false, restart count 0 Jan 22 06:55:03.131: INFO: cilium-dc97x started at 2023-01-22 06:25:51 +0000 UTC (1+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:55:03.131: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:55:03.131: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cfk97 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:03.131: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-b8jbr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:03.131: INFO: pod-configmaps-4109893d-8a94-4e5e-936f-9ce494faed8a started at 2023-01-22 06:52:25 +0000 UTC (0+2 container statuses recorded) Jan 22 06:55:03.131: INFO: Container agnhost-container ready: false, restart count 0 Jan 22 06:55:03.131: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Jan 22 06:55:03.131: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-l8cqz started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:03.131: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:55:03.928: INFO: Latency metrics for node i-08fe7e7767ef6cb6b Jan 22 06:55:03.928: INFO: Logging node info for node i-0ae272b208fd17383 Jan 22 06:55:04.161: INFO: Node Info: &Node{ObjectMeta:{i-0ae272b208fd17383 8e603661-0a86-4442-9629-8fb60195f947 36727 0 2023-01-22 06:25:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ae272b208fd17383 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0ae272b208fd17383 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.122 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-863":"i-0ae272b208fd17383","ebs.csi.aws.com":"i-0ae272b208fd17383"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:52:49 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:52:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0ae272b208fd17383,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:50 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:50 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:50 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:52:50 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.122,},NodeAddress{Type:ExternalIP,Address:13.233.206.115,},NodeAddress{Type:InternalDNS,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-206-115.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2696eee3a2748c57a2a7a5dcde49ea,SystemUUID:ec2696ee-e3a2-748c-57a2-a7a5dcde49ea,BootID:d7d392b7-67d7-4101-be08-ed3bfe242022,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-863^61282dfc-9a21-11ed-a3bd-7e3891f1fe9c kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c kubernetes.io/csi/ebs.csi.aws.com^vol-0a2e75d3fa837517a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0a2e75d3fa837517a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-863^61282dfc-9a21-11ed-a3bd-7e3891f1fe9c,DevicePath:,},},Config:nil,},} Jan 22 06:55:04.161: INFO: Logging kubelet events for node i-0ae272b208fd17383 Jan 22 06:55:04.397: INFO: Logging pods the kubelet thinks is on node i-0ae272b208fd17383 Jan 22 06:55:04.638: INFO: coredns-559769c974-j8pxd started at 2023-01-22 06:26:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container coredns ready: true, restart count 0 Jan 22 06:55:04.638: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-224vl started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:04.638: INFO: inline-volume-tester-cpf2m started at 2023-01-22 06:47:34 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container csi-volume-tester ready: true, restart count 0 Jan 22 06:55:04.638: INFO: ebs-csi-node-x6xfs started at 2023-01-22 06:25:56 +0000 UTC (0+3 container statuses recorded) Jan 22 06:55:04.638: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:55:04.638: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:55:04.638: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:55:04.638: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gv8d9 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:04.638: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-jhxvf started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:55:04.638: INFO: pod-subpath-test-dynamicpv-9qxv started at 2023-01-22 06:52:48 +0000 UTC (0+2 container statuses recorded) Jan 22 06:55:04.638: INFO: Container test-container-subpath-dynamicpv-9qxv ready: false, restart count 0 Jan 22 06:55:04.638: INFO: Container test-container-volume-dynamicpv-9qxv ready: false, restart count 0 Jan 22 06:55:04.638: INFO: ss-2 started at 2023-01-22 06:48:56 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container webserver ready: false, restart count 0 Jan 22 06:55:04.638: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-nqs66 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:04.638: INFO: cilium-svdg2 started at 2023-01-22 06:25:56 +0000 UTC (1+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:55:04.638: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:55:04.638: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:49:03 +0000 UTC (0+7 container statuses recorded) Jan 22 06:55:04.638: INFO: Container csi-attacher ready: true, restart count 0 Jan 22 06:55:04.638: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 06:55:04.638: INFO: Container csi-resizer ready: true, restart count 0 Jan 22 06:55:04.638: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 22 06:55:04.638: INFO: Container hostpath ready: true, restart count 0 Jan 22 06:55:04.638: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:55:04.638: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:55:04.638: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-j8nx8 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:04.638: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-89kjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:04.638: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2rgjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:04.638: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-tgn4t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:04.638: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-94drq started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:04.638: INFO: netserver-1 started at 2023-01-22 06:53:33 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container webserver ready: false, restart count 0 Jan 22 06:55:04.638: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-5nknv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:04.638: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:05.645: INFO: Latency metrics for node i-0ae272b208fd17383 Jan 22 06:55:05.645: INFO: Logging node info for node i-0f0efd5c06406af22 Jan 22 06:55:05.877: INFO: Node Info: &Node{ObjectMeta:{i-0f0efd5c06406af22 d621d241-d0c1-4fcd-95f1-3043a1e318e5 36735 0 2023-01-22 06:25:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f0efd5c06406af22 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f0efd5c06406af22 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.247 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f0efd5c06406af22"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:53:25 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:53:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f0efd5c06406af22,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:28 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:28 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:28 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:53:28 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.247,},NodeAddress{Type:ExternalIP,Address:13.232.42.154,},NodeAddress{Type:InternalDNS,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-42-154.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27fd43a8a03a2384a7278d59d4ca0e,SystemUUID:ec27fd43-a8a0-3a23-84a7-278d59d4ca0e,BootID:5cf896d3-1ac6-483b-85fc-643267ffe608,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-045a7b4a2c61a4448 kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-045a7b4a2c61a4448,DevicePath:,},},Config:nil,},} Jan 22 06:55:05.878: INFO: Logging kubelet events for node i-0f0efd5c06406af22 Jan 22 06:55:06.113: INFO: Logging pods the kubelet thinks is on node i-0f0efd5c06406af22 Jan 22 06:55:06.352: INFO: agnhost started at 2023-01-22 06:54:05 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container agnhost ready: false, restart count 0 Jan 22 06:55:06.352: INFO: nodeport-test-hrghh started at 2023-01-22 06:49:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container nodeport-test ready: false, restart count 0 Jan 22 06:55:06.352: INFO: pod-4b746955-149c-496e-ba63-8e63c8e7b5cc started at 2023-01-22 06:53:17 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container test-container ready: false, restart count 0 Jan 22 06:55:06.352: INFO: ebs-csi-node-nf6tg started at 2023-01-22 06:25:55 +0000 UTC (0+3 container statuses recorded) Jan 22 06:55:06.352: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:55:06.352: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:55:06.352: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:55:06.352: INFO: hostexec-i-0f0efd5c06406af22-cfnh9 started at 2023-01-22 06:54:23 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container agnhost-container ready: true, restart count 0 Jan 22 06:55:06.352: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:47:59 +0000 UTC (0+7 container statuses recorded) Jan 22 06:55:06.352: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container csi-provisioner ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container csi-resizer ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container hostpath ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container liveness-probe ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 22 06:55:06.352: INFO: cilium-g9f7f started at 2023-01-22 06:25:55 +0000 UTC (1+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:55:06.352: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:55:06.352: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8n6lz started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:06.352: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lm57z started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:06.352: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:52:57 +0000 UTC (0+7 container statuses recorded) Jan 22 06:55:06.352: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container csi-provisioner ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container csi-resizer ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container hostpath ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container liveness-probe ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 22 06:55:06.352: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2k9d6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:06.352: INFO: test-rs-bvvpf started at 2023-01-22 06:50:30 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container httpd ready: true, restart count 0 Jan 22 06:55:06.352: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-pc777 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:06.352: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lms68 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:06.352: INFO: netserver-2 started at 2023-01-22 06:53:33 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container webserver ready: false, restart count 0 Jan 22 06:55:06.352: INFO: pod-subpath-test-preprovisionedpv-hgs2 started at 2023-01-22 06:54:41 +0000 UTC (2+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Init container init-volume-preprovisionedpv-hgs2 ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Init container test-init-subpath-preprovisionedpv-hgs2 ready: false, restart count 0 Jan 22 06:55:06.352: INFO: Container test-container-subpath-preprovisionedpv-hgs2 ready: false, restart count 0 Jan 22 06:55:06.352: INFO: pod-2249effe-eabc-49ee-a361-f1280a42a1bd started at 2023-01-22 06:53:22 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container write-pod ready: false, restart count 0 Jan 22 06:55:06.352: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-swsd5 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:06.352: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-d5vgg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:06.352: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-kdjqj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:06.352: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-dvbvr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.352: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:06.353: INFO: ss-0 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.353: INFO: Container webserver ready: true, restart count 0 Jan 22 06:55:06.353: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-sdq2g started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:06.353: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:07.135: INFO: Latency metrics for node i-0f0efd5c06406af22 Jan 22 06:55:07.135: INFO: Logging node info for node i-0f65ec97613c55060 Jan 22 06:55:07.367: INFO: Node Info: &Node{ObjectMeta:{i-0f65ec97613c55060 3b12d6e2-1a35-47ff-9dac-e4586b70e64b 36739 0 2023-01-22 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f65ec97613c55060 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f65ec97613c55060 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.23 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f65ec97613c55060"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:53:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f65ec97613c55060,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:02 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:02 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:02 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:53:02 +0000 UTC,LastTransitionTime:2023-01-22 06:26:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.23,},NodeAddress{Type:ExternalIP,Address:13.233.125.79,},NodeAddress{Type:InternalDNS,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-125-79.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec29271f6fcb1e589a5709b97d78e95d,SystemUUID:ec29271f-6fcb-1e58-9a57-09b97d78e95d,BootID:67de0a94-242d-47e1-96b0-5dc05022ee13,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-08f4126003dfe4110],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08f4126003dfe4110,DevicePath:,},},Config:nil,},} Jan 22 06:55:07.367: INFO: Logging kubelet events for node i-0f65ec97613c55060 Jan 22 06:55:07.602: INFO: Logging pods the kubelet thinks is on node i-0f65ec97613c55060 Jan 22 06:55:07.842: INFO: pod-e613b77a-70a2-44aa-a6ee-e2b9de8f86a6 started at 2023-01-22 06:53:08 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container write-pod ready: false, restart count 0 Jan 22 06:55:07.842: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6wbqw started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:07.842: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8sv6x started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:07.842: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-52gsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:07.842: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6bwjg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:07.842: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdcz6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:07.842: INFO: cilium-582c5 started at 2023-01-22 06:25:52 +0000 UTC (1+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:55:07.842: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:55:07.842: INFO: coredns-autoscaler-7cb5c5b969-jts8s started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container autoscaler ready: true, restart count 0 Jan 22 06:55:07.842: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:47:58 +0000 UTC (0+7 container statuses recorded) Jan 22 06:55:07.842: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container csi-provisioner ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container csi-resizer ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container hostpath ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container liveness-probe ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 22 06:55:07.842: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8qsbj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:07.842: INFO: hostexec-i-0f65ec97613c55060-4ldq2 started at 2023-01-22 06:54:53 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container agnhost-container ready: true, restart count 0 Jan 22 06:55:07.842: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cct9p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:07.842: INFO: inline-volume-tester2-5g7d4 started at 2023-01-22 06:47:51 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 22 06:55:07.842: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdhsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:07.842: INFO: ebs-csi-node-wnt99 started at 2023-01-22 06:25:52 +0000 UTC (0+3 container statuses recorded) Jan 22 06:55:07.842: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:55:07.842: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:55:07.842: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:55:07.842: INFO: hostexec-i-0f65ec97613c55060-vvr62 started at 2023-01-22 06:53:02 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container agnhost-container ready: true, restart count 0 Jan 22 06:55:07.842: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2zr97 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:55:07.842: INFO: netserver-3 started at 2023-01-22 06:53:33 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container webserver ready: false, restart count 0 Jan 22 06:55:07.842: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:48:12 +0000 UTC (0+7 container statuses recorded) Jan 22 06:55:07.842: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container csi-provisioner ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container csi-resizer ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container hostpath ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container liveness-probe ready: false, restart count 0 Jan 22 06:55:07.842: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 22 06:55:07.842: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-n4scw started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:55:07.842: INFO: test-rs-lbplk started at 2023-01-22 06:52:48 +0000 UTC (0+2 container statuses recorded) Jan 22 06:55:07.842: INFO: Container httpd ready: true, restart count 0 Jan 22 06:55:07.842: INFO: Container test-rs ready: true, restart count 0 Jan 22 06:55:07.842: INFO: coredns-559769c974-s8kkg started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded) Jan 22 06:55:07.842: INFO: Container coredns ready: true, restart count 0 Jan 22 06:55:08.667: INFO: Latency metrics for node i-0f65ec97613c55060 [DeferCleanup (Each)] [sig-apps] ReplicaSet tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "replicaset-7784" for this suite. �[38;5;243m01/22/23 06:55:08.667�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sPort\sforwarding\sWith\sa\sserver\slistening\son\s0\.0\.0\.0\sthat\sexpects\sa\sclient\srequest\sshould\ssupport\sa\sclient\sthat\sconnects\,\ssends\sDATA\,\sand\sdisconnects$'
test/e2e/kubectl/portforward.go:302
k8s.io/kubernetes/test/e2e/kubectl.doTestMustConnectSendDisconnect({0x75c24b2, 0x7}, 0xc000bfe4b0)
test/e2e/kubectl/portforward.go:302 +0x24c
k8s.io/kubernetes/test/e2e/kubectl.glob..func2.1.1.2()
test/e2e/kubectl/portforward.go:460 +0x29
[BeforeEach] [sig-cli] Kubectl Port forwarding
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/22/23 06:43:49.071�[0m
Jan 22 06:43:49.071: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename port-forwarding �[38;5;243m01/22/23 06:43:49.073�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/22/23 06:43:49.779�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/22/23 06:43:50.248�[0m
[BeforeEach] [sig-cli] Kubectl Port forwarding
test/e2e/framework/metrics/init/init.go:31
[It] should support a client that connects, sends DATA, and disconnects
test/e2e/kubectl/portforward.go:459
�[1mSTEP:�[0m Creating the target pod �[38;5;243m01/22/23 06:43:50.717�[0m
Jan 22 06:43:50.957: INFO: Waiting up to 5m0s for pod "pfpod" in namespace "port-forwarding-3639" to be "running and ready"
Jan 22 06:43:51.192: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 235.37846ms
Jan 22 06:43:51.192: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:43:53.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2.471724342s
Jan 22 06:43:53.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:43:55.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4.471576346s
Jan 22 06:43:55.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:43:57.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 6.47108945s
Jan 22 06:43:57.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:43:59.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 8.470871404s
Jan 22 06:43:59.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:01.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 10.471460261s
Jan 22 06:44:01.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:03.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 12.471537291s
Jan 22 06:44:03.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:05.446: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 14.489265399s
Jan 22 06:44:05.446: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:07.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 16.470715008s
Jan 22 06:44:07.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:09.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 18.471593322s
Jan 22 06:44:09.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:11.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 20.471097059s
Jan 22 06:44:11.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:13.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 22.471332454s
Jan 22 06:44:13.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:15.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 24.471472434s
Jan 22 06:44:15.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:17.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 26.471550532s
Jan 22 06:44:17.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:19.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 28.47108394s
Jan 22 06:44:19.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:21.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 30.471277017s
Jan 22 06:44:21.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:23.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 32.47136512s
Jan 22 06:44:23.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:25.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 34.471082957s
Jan 22 06:44:25.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:27.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 36.471185077s
Jan 22 06:44:27.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:29.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 38.470864388s
Jan 22 06:44:29.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:31.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 40.471164061s
Jan 22 06:44:31.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:33.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 42.471375199s
Jan 22 06:44:33.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:35.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 44.471145017s
Jan 22 06:44:35.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:37.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 46.471074331s
Jan 22 06:44:37.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:39.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 48.471421655s
Jan 22 06:44:39.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:41.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 50.471349997s
Jan 22 06:44:41.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:43.432: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 52.47554692s
Jan 22 06:44:43.432: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:45.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 54.471110044s
Jan 22 06:44:45.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:47.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 56.470917265s
Jan 22 06:44:47.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:49.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 58.471185427s
Jan 22 06:44:49.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:51.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.471270199s
Jan 22 06:44:51.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:53.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.4713717s
Jan 22 06:44:53.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:55.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.471172897s
Jan 22 06:44:55.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:57.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.471257462s
Jan 22 06:44:57.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:44:59.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.470705159s
Jan 22 06:44:59.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:01.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.470914839s
Jan 22 06:45:01.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:03.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.471609359s
Jan 22 06:45:03.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:05.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.471669479s
Jan 22 06:45:05.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:07.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.471037961s
Jan 22 06:45:07.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:09.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.471431972s
Jan 22 06:45:09.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:11.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.471263351s
Jan 22 06:45:11.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:13.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.471204784s
Jan 22 06:45:13.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:15.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.471473212s
Jan 22 06:45:15.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:17.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.471670248s
Jan 22 06:45:17.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:19.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.470957788s
Jan 22 06:45:19.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:21.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.471692737s
Jan 22 06:45:21.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:23.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.471106265s
Jan 22 06:45:23.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:25.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.471306416s
Jan 22 06:45:25.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:27.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.471228664s
Jan 22 06:45:27.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:29.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.470828466s
Jan 22 06:45:29.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:31.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.471734245s
Jan 22 06:45:31.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:33.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.471196176s
Jan 22 06:45:33.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:35.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.471556603s
Jan 22 06:45:35.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:37.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.470864575s
Jan 22 06:45:37.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:39.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.470574946s
Jan 22 06:45:39.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:41.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.471472464s
Jan 22 06:45:41.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:43.429: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.471951151s
Jan 22 06:45:43.429: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:45.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.471382937s
Jan 22 06:45:45.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:47.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.471280926s
Jan 22 06:45:47.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:49.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.47169505s
Jan 22 06:45:49.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:51.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.471361781s
Jan 22 06:45:51.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:53.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.470792269s
Jan 22 06:45:53.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:55.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.471500812s
Jan 22 06:45:55.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:57.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.47147087s
Jan 22 06:45:57.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:45:59.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.470842164s
Jan 22 06:45:59.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:01.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.471295876s
Jan 22 06:46:01.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:03.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.471770945s
Jan 22 06:46:03.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:05.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.470664262s
Jan 22 06:46:05.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:07.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.471761703s
Jan 22 06:46:07.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:09.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.47063212s
Jan 22 06:46:09.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:11.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.471724614s
Jan 22 06:46:11.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:13.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.471693504s
Jan 22 06:46:13.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:15.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.471101249s
Jan 22 06:46:15.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:17.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.471629655s
Jan 22 06:46:17.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:19.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.470757176s
Jan 22 06:46:19.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:21.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.470940089s
Jan 22 06:46:21.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:23.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.471074848s
Jan 22 06:46:23.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:25.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.471219386s
Jan 22 06:46:25.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:27.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.471224285s
Jan 22 06:46:27.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:29.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.471716013s
Jan 22 06:46:29.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:31.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.471425673s
Jan 22 06:46:31.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:33.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.471134414s
Jan 22 06:46:33.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:35.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.471516986s
Jan 22 06:46:35.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:37.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.471317928s
Jan 22 06:46:37.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:39.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.470674773s
Jan 22 06:46:39.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:41.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.471476434s
Jan 22 06:46:41.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:43.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.470645226s
Jan 22 06:46:43.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:45.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.470995467s
Jan 22 06:46:45.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:47.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.471545419s
Jan 22 06:46:47.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:49.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.471231303s
Jan 22 06:46:49.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:51.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.471163583s
Jan 22 06:46:51.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:53.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.471335562s
Jan 22 06:46:53.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:55.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.471453898s
Jan 22 06:46:55.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:57.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.470536018s
Jan 22 06:46:57.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:46:59.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.470785942s
Jan 22 06:46:59.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:01.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.471317249s
Jan 22 06:47:01.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:03.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.471485229s
Jan 22 06:47:03.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:05.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.471680529s
Jan 22 06:47:05.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:07.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.47053359s
Jan 22 06:47:07.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:09.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.471571038s
Jan 22 06:47:09.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:11.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.47116711s
Jan 22 06:47:11.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:13.429: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.472276496s
Jan 22 06:47:13.429: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:15.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.471151703s
Jan 22 06:47:15.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:17.429: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.471813123s
Jan 22 06:47:17.429: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:19.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.471695972s
Jan 22 06:47:19.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:21.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.470857709s
Jan 22 06:47:21.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:23.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.471416708s
Jan 22 06:47:23.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:25.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.471079179s
Jan 22 06:47:25.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:27.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.47177713s
Jan 22 06:47:27.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:29.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.471057791s
Jan 22 06:47:29.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:31.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.470499195s
Jan 22 06:47:31.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:33.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.471244375s
Jan 22 06:47:33.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:35.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.470361799s
Jan 22 06:47:35.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:37.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.470824013s
Jan 22 06:47:37.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:39.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.471567297s
Jan 22 06:47:39.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:41.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.470809944s
Jan 22 06:47:41.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:43.429: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.472551635s
Jan 22 06:47:43.429: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:45.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.471185385s
Jan 22 06:47:45.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:47.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.470974413s
Jan 22 06:47:47.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:49.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.471483742s
Jan 22 06:47:49.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:51.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.470966716s
Jan 22 06:47:51.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:53.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.471356887s
Jan 22 06:47:53.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:55.432: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.475606481s
Jan 22 06:47:55.432: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:57.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.471201782s
Jan 22 06:47:57.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:47:59.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.470976182s
Jan 22 06:47:59.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:01.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.470843252s
Jan 22 06:48:01.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:03.429: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.472534549s
Jan 22 06:48:03.429: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:05.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.471499667s
Jan 22 06:48:05.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:07.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.47147473s
Jan 22 06:48:07.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:09.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.471344468s
Jan 22 06:48:09.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:11.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.471351004s
Jan 22 06:48:11.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:13.429: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.471947108s
Jan 22 06:48:13.429: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:15.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.471267281s
Jan 22 06:48:15.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:17.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.470918934s
Jan 22 06:48:17.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:19.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.471166822s
Jan 22 06:48:19.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:21.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.471556601s
Jan 22 06:48:21.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:23.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.47135637s
Jan 22 06:48:23.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:25.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.471418469s
Jan 22 06:48:25.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:27.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.471321257s
Jan 22 06:48:27.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:29.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.471395928s
Jan 22 06:48:29.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:31.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.471255005s
Jan 22 06:48:31.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:33.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.470756893s
Jan 22 06:48:33.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:35.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.470762354s
Jan 22 06:48:35.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:37.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.471167031s
Jan 22 06:48:37.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:39.427: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.470503923s
Jan 22 06:48:39.427: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:41.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.471423265s
Jan 22 06:48:41.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:43.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.471601837s
Jan 22 06:48:43.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:45.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.471379804s
Jan 22 06:48:45.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:47.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.471349178s
Jan 22 06:48:47.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:49.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.471185062s
Jan 22 06:48:49.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:51.428: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.471261118s
Jan 22 06:48:51.428: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:51.663: INFO: Pod "pfpod": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.706057488s
Jan 22 06:48:51.663: INFO: The phase of Pod pfpod is Pending, waiting for it to be Running (with Ready = true)
Jan 22 06:48:51.663: FAIL: Pod did not start running: timed out while waiting for pod port-forwarding-3639/pfpod to be running and ready
Full Stack Trace
k8s.io/kubernetes/test/e2e/kubectl.doTestMustConnectSendDisconnect({0x75c24b2, 0x7}, 0xc000bfe4b0)
test/e2e/kubectl/portforward.go:302 +0x24c
k8s.io/kubernetes/test/e2e/kubectl.glob..func2.1.1.2()
test/e2e/kubectl/portforward.go:460 +0x29
[AfterEach] [sig-cli] Kubectl Port forwarding
test/e2e/framework/node/init/init.go:32
Jan 22 06:48:51.663: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/22/23 06:48:51.899�[0m
�[1mSTEP:�[0m Collecting events from namespace "port-forwarding-3639". �[38;5;243m01/22/23 06:48:51.899�[0m
�[1mSTEP:�[0m Found 11 events. �[38;5;243m01/22/23 06:48:52.134�[0m
Jan 22 06:48:52.134: INFO: At 2023-01-22 06:43:50 +0000 UTC - event for pfpod: {default-scheduler } Scheduled: Successfully assigned port-forwarding-3639/pfpod to i-0f0efd5c06406af22
Jan 22 06:48:52.134: INFO: At 2023-01-22 06:43:51 +0000 UTC - event for pfpod: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "67c423d381aa9fae459e004f71cf88823571113f0fddcddb85b05602e5ae368d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:48:52.134: INFO: At 2023-01-22 06:44:02 +0000 UTC - event for pfpod: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c1c439db01ff2f7de7d650658beb1eb4f409b2f086346ac537cdee376347a26d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:48:52.134: INFO: At 2023-01-22 06:44:13 +0000 UTC - event for pfpod: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e344d9d1939a780d7e85b9f9790ffa4d3900ef2b96d7ff39785ef4423f5f000c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:48:52.134: INFO: At 2023-01-22 06:44:25 +0000 UTC - event for pfpod: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "7a2e8ac1c3833b882f6e7f0104a72cf4d4363f3223fe539f5a39fdeda5be9989": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:48:52.134: INFO: At 2023-01-22 06:44:40 +0000 UTC - event for pfpod: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3d966c1232fdc51e7191f4a081b5b273e4025af45d66030638ee3e93144c79ed": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:48:52.134: INFO: At 2023-01-22 06:44:53 +0000 UTC - event for pfpod: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6e3aa43e19d0e8b956913bb78251889fe482cdae03ffdbf2cc865735bc9371e6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:48:52.134: INFO: At 2023-01-22 06:45:07 +0000 UTC - event for pfpod: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d50f80adbfccd0df93693e71b0b39e2b2f8d75959ef1fe4669d3bf8d340d66e6": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:48:52.134: INFO: At 2023-01-22 06:45:22 +0000 UTC - event for pfpod: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ff220a7525443ce350c80e0270fb08a0d44608579161fae116efab2c5bbde47e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:48:52.134: INFO: At 2023-01-22 06:45:34 +0000 UTC - event for pfpod: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3d4e6a726513411eda59545f411f7144ce01f0bd8569d3d23b7924b1b62c854d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:48:52.134: INFO: At 2023-01-22 06:45:45 +0000 UTC - event for pfpod: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a100e70f9af068d7c102df30616da753bef4afd137092979d200b44c2cfce8be": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:48:52.370: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 22 06:48:52.370: INFO: pfpod i-0f0efd5c06406af22 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:50 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:50 +0000 UTC ContainersNotReady containers with unready status: [readiness portforwardtester]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:50 +0000 UTC ContainersNotReady containers with unready status: [readiness portforwardtester]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:50 +0000 UTC }]
Jan 22 06:48:52.370: INFO:
Jan 22 06:48:52.606: INFO: Unable to fetch port-forwarding-3639/pfpod/readiness logs: the server rejected our request for an unknown reason (get pods pfpod)
Jan 22 06:48:52.842: INFO: Unable to fetch port-forwarding-3639/pfpod/portforwardtester logs: the server rejected our request for an unknown reason (get pods pfpod)
Jan 22 06:48:53.078: INFO:
Logging node info for node i-0784fefc7d59ccdae
Jan 22 06:48:53.313: INFO: Node Info: &Node{ObjectMeta:{i-0784fefc7d59ccdae 578f4339-1faa-4298-ac96-27aed9bc236a 33107 0 2023-01-22 06:24:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0784fefc7d59ccdae kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.129 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0784fefc7d59ccdae"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-22 06:24:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-22 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:24:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-22 06:47:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0784fefc7d59ccdae,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892297728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787440128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.129,},NodeAddress{Type:ExternalIP,Address:43.205.229.145,},NodeAddress{Type:InternalDNS,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-205-229-145.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cca4041964650860029288f425941,SystemUUID:ec2cca40-4196-4650-8600-29288f425941,BootID:6d7bd66f-7345-4f07-a0a9-6dcf8a9b9a01,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643680,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841303,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965801,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 22 06:48:53.314: INFO:
Logging kubelet events for node i-0784fefc7d59ccdae
Jan 22 06:48:53.551: INFO:
Logging pods the kubelet thinks is on node i-0784fefc7d59ccdae
Jan 22 06:48:53.792: INFO: kube-controller-manager-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:53.792: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 22 06:48:53.792: INFO: etcd-manager-events-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:53.792: INFO: Container etcd-manager ready: true, restart count 0
Jan 22 06:48:53.792: INFO: kops-controller-l7kst started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:53.792: INFO: Container kops-controller ready: true, restart count 0
Jan 22 06:48:53.792: INFO: aws-cloud-controller-manager-md9vc started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:53.792: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 22 06:48:53.792: INFO: cilium-operator-5dd44dc49f-2hpqt started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:53.792: INFO: Container cilium-operator ready: true, restart count 1
Jan 22 06:48:53.792: INFO: kube-apiserver-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+2 container statuses recorded)
Jan 22 06:48:53.792: INFO: Container healthcheck ready: true, restart count 0
Jan 22 06:48:53.792: INFO: Container kube-apiserver ready: true, restart count 1
Jan 22 06:48:53.792: INFO: kube-scheduler-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:53.792: INFO: Container kube-scheduler ready: true, restart count 0
Jan 22 06:48:53.792: INFO: ebs-csi-node-2wncs started at 2023-01-22 06:24:40 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:48:53.792: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:48:53.792: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:48:53.792: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:48:53.792: INFO: cilium-dphgw started at 2023-01-22 06:24:40 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:48:53.792: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:48:53.792: INFO: Container cilium-agent ready: true, restart count 1
Jan 22 06:48:53.792: INFO: dns-controller-69987775c6-gdndv started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:53.792: INFO: Container dns-controller ready: true, restart count 0
Jan 22 06:48:53.792: INFO: ebs-csi-controller-5bd98b456f-xxxj2 started at 2023-01-22 06:24:41 +0000 UTC (0+5 container statuses recorded)
Jan 22 06:48:53.792: INFO: Container csi-attacher ready: true, restart count 0
Jan 22 06:48:53.792: INFO: Container csi-provisioner ready: true, restart count 0
Jan 22 06:48:53.792: INFO: Container csi-resizer ready: true, restart count 0
Jan 22 06:48:53.792: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:48:53.792: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:48:53.792: INFO: etcd-manager-main-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:53.792: INFO: Container etcd-manager ready: true, restart count 0
Jan 22 06:48:54.559: INFO:
Latency metrics for node i-0784fefc7d59ccdae
Jan 22 06:48:54.559: INFO:
Logging node info for node i-08fe7e7767ef6cb6b
Jan 22 06:48:54.794: INFO: Node Info: &Node{ObjectMeta:{i-08fe7e7767ef6cb6b 2145b9b6-87c4-4056-9d33-2bdbd91f3e25 34235 0 2023-01-22 06:25:50 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08fe7e7767ef6cb6b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-08fe7e7767ef6cb6b topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.140 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6527":"i-08fe7e7767ef6cb6b","csi-mock-csi-mock-volumes-6487":"i-08fe7e7767ef6cb6b","ebs.csi.aws.com":"i-08fe7e7767ef6cb6b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:48:39 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:48:39 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-08fe7e7767ef6cb6b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:48:39 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:48:39 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:48:39 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:48:39 +0000 UTC,LastTransitionTime:2023-01-22 06:26:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.140,},NodeAddress{Type:ExternalIP,Address:15.206.168.164,},NodeAddress{Type:InternalDNS,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-168-164.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec244e84b4a6ab10c46e08d94bf33aed,SystemUUID:ec244e84-b4a6-ab10-c46e-08d94bf33aed,BootID:d699615e-6b18-42f3-878b-638f85804381,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6527^e5ab0ab6-9a1f-11ed-9e74-2a6fb9be6585 kubernetes.io/csi/ebs.csi.aws.com^vol-0319e775eeab878e5 kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6527^e5ab0ab6-9a1f-11ed-9e74-2a6fb9be6585,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0319e775eeab878e5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1,DevicePath:,},},Config:nil,},}
Jan 22 06:48:54.794: INFO:
Logging kubelet events for node i-08fe7e7767ef6cb6b
Jan 22 06:48:55.032: INFO:
Logging pods the kubelet thinks is on node i-08fe7e7767ef6cb6b
Jan 22 06:48:55.274: INFO: ss-1 started at 2023-01-22 06:42:43 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container webserver ready: true, restart count 0
Jan 22 06:48:55.275: INFO: netserver-0 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container webserver ready: false, restart count 0
Jan 22 06:48:55.275: INFO: pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd started at 2023-01-22 06:42:07 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container write-pod ready: false, restart count 0
Jan 22 06:48:55.275: INFO: ebs-csi-node-l5r6q started at 2023-01-22 06:25:51 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:48:55.275: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:48:55.275: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:48:55.275: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gpz5p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:55.275: INFO: csi-mockplugin-attacher-0 started at 2023-01-22 06:48:03 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:48:55.275: INFO: hostexec-i-08fe7e7767ef6cb6b-hvhc4 started at 2023-01-22 06:45:03 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:48:55.275: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wj87w started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:55.275: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-s7ksv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:55.275: INFO: pod-secrets-8bddb517-320a-4b52-ada4-d992ad1e745c started at 2023-01-22 06:47:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container secret-volume-test ready: false, restart count 0
Jan 22 06:48:55.275: INFO: csi-mockplugin-0 started at 2023-01-22 06:48:03 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container csi-provisioner ready: true, restart count 0
Jan 22 06:48:55.275: INFO: Container driver-registrar ready: true, restart count 0
Jan 22 06:48:55.275: INFO: Container mock ready: true, restart count 0
Jan 22 06:48:55.275: INFO: inline-volume-tester-xj8gr started at 2023-01-22 06:42:13 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 22 06:48:55.275: INFO: pvc-volume-tester-274d7 started at 2023-01-22 06:48:54 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container volume-tester ready: false, restart count 0
Jan 22 06:48:55.275: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wc9kg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:55.275: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:42:05 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container csi-attacher ready: true, restart count 0
Jan 22 06:48:55.275: INFO: Container csi-provisioner ready: true, restart count 0
Jan 22 06:48:55.275: INFO: Container csi-resizer ready: true, restart count 0
Jan 22 06:48:55.275: INFO: Container csi-snapshotter ready: true, restart count 0
Jan 22 06:48:55.275: INFO: Container hostpath ready: true, restart count 0
Jan 22 06:48:55.275: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:48:55.275: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:48:55.275: INFO: pod-subpath-test-preprovisionedpv-shw9 started at 2023-01-22 06:45:13 +0000 UTC (2+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Init container init-volume-preprovisionedpv-shw9 ready: false, restart count 0
Jan 22 06:48:55.275: INFO: Init container test-init-subpath-preprovisionedpv-shw9 ready: false, restart count 0
Jan 22 06:48:55.275: INFO: Container test-container-subpath-preprovisionedpv-shw9 ready: false, restart count 0
Jan 22 06:48:55.275: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-b8jbr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:48:55.275: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-l8cqz started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:48:55.275: INFO: pod-server-1 started at 2023-01-22 06:47:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container agnhost-container ready: false, restart count 0
Jan 22 06:48:55.275: INFO: cilium-dc97x started at 2023-01-22 06:25:51 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:48:55.275: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:48:55.275: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cfk97 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:55.275: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hvhkb started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:55.275: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hgtwv started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:55.275: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6zw5t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:55.275: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:56.148: INFO:
Latency metrics for node i-08fe7e7767ef6cb6b
Jan 22 06:48:56.148: INFO:
Logging node info for node i-0ae272b208fd17383
Jan 22 06:48:56.383: INFO: Node Info: &Node{ObjectMeta:{i-0ae272b208fd17383 8e603661-0a86-4442-9629-8fb60195f947 33502 0 2023-01-22 06:25:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ae272b208fd17383 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0ae272b208fd17383 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.122 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ae272b208fd17383"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:47:44 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0ae272b208fd17383,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:44 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:44 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:44 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:44 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.122,},NodeAddress{Type:ExternalIP,Address:13.233.206.115,},NodeAddress{Type:InternalDNS,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-206-115.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2696eee3a2748c57a2a7a5dcde49ea,SystemUUID:ec2696ee-e3a2-748c-57a2-a7a5dcde49ea,BootID:d7d392b7-67d7-4101-be08-ed3bfe242022,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c,DevicePath:,},},Config:nil,},}
Jan 22 06:48:56.383: INFO:
Logging kubelet events for node i-0ae272b208fd17383
Jan 22 06:48:56.621: INFO:
Logging pods the kubelet thinks is on node i-0ae272b208fd17383
Jan 22 06:48:56.862: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-224vl started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:56.862: INFO: inline-volume-tester-cpf2m started at 2023-01-22 06:47:34 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 22 06:48:56.862: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gv8d9 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:56.862: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-jhxvf started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:48:56.862: INFO: ebs-csi-node-x6xfs started at 2023-01-22 06:25:56 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:48:56.862: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:48:56.862: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:48:56.862: INFO: svc-latency-rc-zqln2 started at 2023-01-22 06:48:14 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container svc-latency-rc ready: false, restart count 0
Jan 22 06:48:56.862: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-nqs66 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:56.862: INFO: ss-2 started at 2023-01-22 06:48:56 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container webserver ready: false, restart count 0
Jan 22 06:48:56.862: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-j8nx8 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:56.862: INFO: cilium-svdg2 started at 2023-01-22 06:25:56 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:48:56.862: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:48:56.862: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2rgjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:56.862: INFO: netserver-1 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container webserver ready: true, restart count 0
Jan 22 06:48:56.862: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-89kjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:56.862: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-tgn4t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:56.862: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-94drq started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:56.862: INFO: run-test started at 2023-01-22 06:47:44 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container run-test ready: false, restart count 0
Jan 22 06:48:56.862: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-5nknv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:56.862: INFO: coredns-559769c974-j8pxd started at 2023-01-22 06:26:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:56.862: INFO: Container coredns ready: true, restart count 0
Jan 22 06:48:57.701: INFO:
Latency metrics for node i-0ae272b208fd17383
Jan 22 06:48:57.701: INFO:
Logging node info for node i-0f0efd5c06406af22
Jan 22 06:48:57.936: INFO: Node Info: &Node{ObjectMeta:{i-0f0efd5c06406af22 d621d241-d0c1-4fcd-95f1-3043a1e318e5 33249 0 2023-01-22 06:25:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f0efd5c06406af22 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f0efd5c06406af22 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.247 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-8268":"i-0f0efd5c06406af22","ebs.csi.aws.com":"i-0f0efd5c06406af22"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:31 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:47:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f0efd5c06406af22,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.247,},NodeAddress{Type:ExternalIP,Address:13.232.42.154,},NodeAddress{Type:InternalDNS,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-42-154.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27fd43a8a03a2384a7278d59d4ca0e,SystemUUID:ec27fd43-a8a0-3a23-84a7-278d59d4ca0e,BootID:5cf896d3-1ac6-483b-85fc-643267ffe608,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-8268^f4777368-9a1f-11ed-8b17-62b0431a56d0 kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4,DevicePath:,},},Config:nil,},}
Jan 22 06:48:57.936: INFO:
Logging kubelet events for node i-0f0efd5c06406af22
Jan 22 06:48:58.173: INFO:
Logging pods the kubelet thinks is on node i-0f0efd5c06406af22
Jan 22 06:48:58.418: INFO: ebs-csi-node-nf6tg started at 2023-01-22 06:25:55 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:48:58.418: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:48:58.418: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:48:58.418: INFO: pfpod started at 2023-01-22 06:43:50 +0000 UTC (0+2 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container portforwardtester ready: false, restart count 0
Jan 22 06:48:58.418: INFO: Container readiness ready: false, restart count 0
Jan 22 06:48:58.418: INFO: csi-mockplugin-0 started at 2023-01-22 06:42:06 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container csi-provisioner ready: true, restart count 0
Jan 22 06:48:58.418: INFO: Container driver-registrar ready: true, restart count 0
Jan 22 06:48:58.418: INFO: Container mock ready: true, restart count 0
Jan 22 06:48:58.418: INFO: csi-mockplugin-attacher-0 started at 2023-01-22 06:42:07 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:48:58.418: INFO: cilium-g9f7f started at 2023-01-22 06:25:55 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:48:58.418: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:48:58.418: INFO: csi-mockplugin-0 started at 2023-01-22 06:47:48 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:48:58.418: INFO: Container driver-registrar ready: false, restart count 0
Jan 22 06:48:58.418: INFO: Container mock ready: false, restart count 0
Jan 22 06:48:58.418: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:47:59 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:48:58.418: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:48:58.418: INFO: Container csi-resizer ready: false, restart count 0
Jan 22 06:48:58.418: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 22 06:48:58.418: INFO: Container hostpath ready: false, restart count 0
Jan 22 06:48:58.418: INFO: Container liveness-probe ready: false, restart count 0
Jan 22 06:48:58.418: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 22 06:48:58.418: INFO: httpd started at 2023-01-22 06:48:37 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container httpd ready: false, restart count 0
Jan 22 06:48:58.418: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8n6lz started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:58.418: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lm57z started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:58.418: INFO: pvc-volume-tester-jcq6v started at 2023-01-22 06:42:36 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container volume-tester ready: false, restart count 0
Jan 22 06:48:58.418: INFO: hostexec-i-0f0efd5c06406af22-ztx2q started at 2023-01-22 06:47:36 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:48:58.418: INFO: hostexec-i-0f0efd5c06406af22-4wfcp started at 2023-01-22 06:48:04 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:48:58.418: INFO: pod-c969c034-86fd-4603-9b07-49c4d8c6f476 started at 2023-01-22 06:48:13 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container write-pod ready: false, restart count 0
Jan 22 06:48:58.418: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2k9d6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:58.418: INFO: netserver-2 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container webserver ready: false, restart count 0
Jan 22 06:48:58.418: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-pc777 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:58.418: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lms68 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:58.418: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-swsd5 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:58.418: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-d5vgg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:48:58.418: INFO: httpd started at 2023-01-22 06:43:03 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container httpd ready: true, restart count 0
Jan 22 06:48:58.418: INFO: pod-subpath-test-preprovisionedpv-jrsm started at 2023-01-22 06:47:56 +0000 UTC (2+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Init container init-volume-preprovisionedpv-jrsm ready: false, restart count 0
Jan 22 06:48:58.418: INFO: Init container test-init-volume-preprovisionedpv-jrsm ready: false, restart count 0
Jan 22 06:48:58.418: INFO: Container test-container-subpath-preprovisionedpv-jrsm ready: false, restart count 0
Jan 22 06:48:58.418: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-kdjqj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:58.418: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-dvbvr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:58.418: INFO: ss-0 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container webserver ready: true, restart count 0
Jan 22 06:48:58.418: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-sdq2g started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:58.418: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:59.251: INFO:
Latency metrics for node i-0f0efd5c06406af22
Jan 22 06:48:59.251: INFO:
Logging node info for node i-0f65ec97613c55060
Jan 22 06:48:59.486: INFO: Node Info: &Node{ObjectMeta:{i-0f65ec97613c55060 3b12d6e2-1a35-47ff-9dac-e4586b70e64b 33734 0 2023-01-22 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f65ec97613c55060 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f65ec97613c55060 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.23 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f65ec97613c55060"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:47:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f65ec97613c55060,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:26:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.23,},NodeAddress{Type:ExternalIP,Address:13.233.125.79,},NodeAddress{Type:InternalDNS,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-125-79.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec29271f6fcb1e589a5709b97d78e95d,SystemUUID:ec29271f-6fcb-1e58-9a57-09b97d78e95d,BootID:67de0a94-242d-47e1-96b0-5dc05022ee13,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-08f4126003dfe4110],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08f4126003dfe4110,DevicePath:,},},Config:nil,},}
Jan 22 06:48:59.487: INFO:
Logging kubelet events for node i-0f65ec97613c55060
Jan 22 06:48:59.724: INFO:
Logging pods the kubelet thinks is on node i-0f65ec97613c55060
Jan 22 06:48:59.968: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8qsbj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:59.968: INFO: cilium-582c5 started at 2023-01-22 06:25:52 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:48:59.968: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:48:59.968: INFO: coredns-autoscaler-7cb5c5b969-jts8s started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container autoscaler ready: true, restart count 0
Jan 22 06:48:59.968: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:47:58 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container csi-resizer ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container hostpath ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container liveness-probe ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 22 06:48:59.968: INFO: pod-client started at 2023-01-22 06:43:18 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container pod-client ready: true, restart count 0
Jan 22 06:48:59.968: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cct9p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:59.968: INFO: netserver-3 started at 2023-01-22 06:47:29 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container webserver ready: false, restart count 0
Jan 22 06:48:59.968: INFO: inline-volume-tester2-5g7d4 started at 2023-01-22 06:47:51 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 22 06:48:59.968: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdhsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:59.968: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2zr97 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:48:59.968: INFO: ebs-csi-node-wnt99 started at 2023-01-22 06:25:52 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:48:59.968: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:48:59.968: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:48:59.968: INFO: hostpath-injector started at 2023-01-22 06:48:03 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container hostpath-injector ready: false, restart count 0
Jan 22 06:48:59.968: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:48:12 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container csi-resizer ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container hostpath ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container liveness-probe ready: false, restart count 0
Jan 22 06:48:59.968: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 22 06:48:59.968: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-n4scw started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:59.968: INFO: coredns-559769c974-s8kkg started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container coredns ready: true, restart count 0
Jan 22 06:48:59.968: INFO: busybox-readonly-true-2fe51bf6-e622-4739-b4d8-f2c74b6c4b49 started at 2023-01-22 06:47:49 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container busybox-readonly-true-2fe51bf6-e622-4739-b4d8-f2c74b6c4b49 ready: false, restart count 0
Jan 22 06:48:59.968: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdcz6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:59.968: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6wbqw started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:59.968: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8sv6x started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:59.968: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-52gsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:48:59.968: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6bwjg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:48:59.968: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:00.797: INFO:
Latency metrics for node i-0f65ec97613c55060
[DeferCleanup (Each)] [sig-cli] Kubectl Port forwarding
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "port-forwarding-3639" for this suite. �[38;5;243m01/22/23 06:49:00.797�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\ssupport\sexec\sthrough\san\sHTTP\sproxy$'
test/e2e/kubectl/kubectl.go:415 k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.1() test/e2e/kubectl/kubectl.go:415 +0x245from junit_01.xml
[BeforeEach] [sig-cli] Kubectl client set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/22/23 06:42:29.287�[0m Jan 22 06:42:29.287: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/22/23 06:42:29.288�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/22/23 06:42:29.992�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/22/23 06:42:30.459�[0m [BeforeEach] [sig-cli] Kubectl client test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-cli] Kubectl client test/e2e/kubectl/kubectl.go:274 [BeforeEach] Simple pod test/e2e/kubectl/kubectl.go:411 �[1mSTEP:�[0m creating the pod from �[38;5;243m01/22/23 06:42:30.926�[0m Jan 22 06:42:30.927: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5853 create -f -' Jan 22 06:42:32.137: INFO: stderr: "" Jan 22 06:42:32.137: INFO: stdout: "pod/httpd created\n" Jan 22 06:42:32.137: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd] Jan 22 06:42:32.137: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-5853" to be "running and ready" Jan 22 06:42:32.373: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 235.668749ms Jan 22 06:42:32.373: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:34.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.471246354s Jan 22 06:42:34.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:36.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.470547623s Jan 22 06:42:36.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:38.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.46980567s Jan 22 06:42:38.607: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:40.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.47120772s Jan 22 06:42:40.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:42.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.470217824s Jan 22 06:42:42.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:44.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.470936344s Jan 22 06:42:44.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:46.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.470964873s Jan 22 06:42:46.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:48.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.47114786s Jan 22 06:42:48.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:50.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 18.471376518s Jan 22 06:42:50.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:52.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 20.470454434s Jan 22 06:42:52.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:54.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 22.470509139s Jan 22 06:42:54.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:56.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 24.471330077s Jan 22 06:42:56.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:42:58.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 26.471020897s Jan 22 06:42:58.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:00.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 28.470248362s Jan 22 06:43:00.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:02.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 30.471083001s Jan 22 06:43:02.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:04.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 32.470890627s Jan 22 06:43:04.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:06.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 34.471237799s Jan 22 06:43:06.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:08.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 36.470678687s Jan 22 06:43:08.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:10.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 38.471124746s Jan 22 06:43:10.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:12.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 40.470953534s Jan 22 06:43:12.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:14.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 42.471278727s Jan 22 06:43:14.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:16.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 44.470443328s Jan 22 06:43:16.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:18.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 46.470783059s Jan 22 06:43:18.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:20.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 48.470450526s Jan 22 06:43:20.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:22.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 50.470860155s Jan 22 06:43:22.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:24.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 52.470526152s Jan 22 06:43:24.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:26.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 54.471109085s Jan 22 06:43:26.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:28.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 56.470938908s Jan 22 06:43:28.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:30.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 58.470270172s Jan 22 06:43:30.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:32.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.470830733s Jan 22 06:43:32.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:34.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.470768108s Jan 22 06:43:34.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:36.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.470758579s Jan 22 06:43:36.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:38.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.471066219s Jan 22 06:43:38.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:40.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.47003406s Jan 22 06:43:40.607: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:42.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.470644413s Jan 22 06:43:42.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:44.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.470035294s Jan 22 06:43:44.607: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:46.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.470767586s Jan 22 06:43:46.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:48.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.47002397s Jan 22 06:43:48.607: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:50.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.470157303s Jan 22 06:43:50.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:52.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.470535357s Jan 22 06:43:52.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:54.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.471434728s Jan 22 06:43:54.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:56.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.469895639s Jan 22 06:43:56.607: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:43:58.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.470008319s Jan 22 06:43:58.607: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:00.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.470154868s Jan 22 06:44:00.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:02.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.47086616s Jan 22 06:44:02.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:04.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.471414433s Jan 22 06:44:04.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:06.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.471199691s Jan 22 06:44:06.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:08.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.470983735s Jan 22 06:44:08.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:10.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.4701074s Jan 22 06:44:10.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:12.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.470128918s Jan 22 06:44:12.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:14.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.47075623s Jan 22 06:44:14.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:16.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.471067893s Jan 22 06:44:16.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:18.616: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.478812497s Jan 22 06:44:18.616: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:20.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.470744716s Jan 22 06:44:20.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:22.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.470153735s Jan 22 06:44:22.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:24.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.470632599s Jan 22 06:44:24.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:26.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.470634741s Jan 22 06:44:26.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:28.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.471031517s Jan 22 06:44:28.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:30.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.470432566s Jan 22 06:44:30.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:32.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.470892528s Jan 22 06:44:32.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:34.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.471589172s Jan 22 06:44:34.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:36.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.470712628s Jan 22 06:44:36.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:38.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.47045952s Jan 22 06:44:38.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:40.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.470807563s Jan 22 06:44:40.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:42.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.47037116s Jan 22 06:44:42.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:44.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.471059028s Jan 22 06:44:44.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:46.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.470625829s Jan 22 06:44:46.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:48.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.470303424s Jan 22 06:44:48.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:50.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.470443357s Jan 22 06:44:50.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:52.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.47110249s Jan 22 06:44:52.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:54.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.470938012s Jan 22 06:44:54.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:56.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.470465975s Jan 22 06:44:56.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:44:58.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.470212138s Jan 22 06:44:58.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:00.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.470835301s Jan 22 06:45:00.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:02.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.470668463s Jan 22 06:45:02.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:04.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.471061217s Jan 22 06:45:04.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:06.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.470627933s Jan 22 06:45:06.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:08.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.469983724s Jan 22 06:45:08.607: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:10.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.470127202s Jan 22 06:45:10.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:12.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.470976019s Jan 22 06:45:12.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:14.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.470932159s Jan 22 06:45:14.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:16.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.470648435s Jan 22 06:45:16.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:18.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.470301663s Jan 22 06:45:18.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:20.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.470453786s Jan 22 06:45:20.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:22.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.470206031s Jan 22 06:45:22.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:24.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.470720632s Jan 22 06:45:24.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:26.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.470590664s Jan 22 06:45:26.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:28.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.470125953s Jan 22 06:45:28.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:30.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.470564795s Jan 22 06:45:30.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:32.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.470920244s Jan 22 06:45:32.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:34.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.470825427s Jan 22 06:45:34.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:36.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.470863008s Jan 22 06:45:36.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:38.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.4700908s Jan 22 06:45:38.607: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:40.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.471077877s Jan 22 06:45:40.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:42.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.470175852s Jan 22 06:45:42.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:44.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.47124056s Jan 22 06:45:44.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:46.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.471408401s Jan 22 06:45:46.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:48.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.471080966s Jan 22 06:45:48.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:50.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.47021548s Jan 22 06:45:50.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:52.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.471010972s Jan 22 06:45:52.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:54.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.470882445s Jan 22 06:45:54.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:56.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.470221236s Jan 22 06:45:56.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:45:58.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.470169308s Jan 22 06:45:58.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:00.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.469993855s Jan 22 06:46:00.607: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:02.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.470846329s Jan 22 06:46:02.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:04.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.470734943s Jan 22 06:46:04.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:06.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.470959231s Jan 22 06:46:06.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:08.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.471262582s Jan 22 06:46:08.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:10.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.470859466s Jan 22 06:46:10.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:12.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.471256636s Jan 22 06:46:12.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:14.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.47134485s Jan 22 06:46:14.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:16.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.471130562s Jan 22 06:46:16.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:18.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.470619134s Jan 22 06:46:18.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:20.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.470145918s Jan 22 06:46:20.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:22.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.471101547s Jan 22 06:46:22.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:24.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.470089575s Jan 22 06:46:24.607: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:26.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.470973445s Jan 22 06:46:26.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:28.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.470120253s Jan 22 06:46:28.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:30.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.470268847s Jan 22 06:46:30.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:32.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.471561862s Jan 22 06:46:32.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:34.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.470495268s Jan 22 06:46:34.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:36.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.471299609s Jan 22 06:46:36.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:38.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.471094921s Jan 22 06:46:38.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:40.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.47127894s Jan 22 06:46:40.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:42.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.47037936s Jan 22 06:46:42.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:44.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.471055526s Jan 22 06:46:44.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:46.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.471006223s Jan 22 06:46:46.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:48.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.471109456s Jan 22 06:46:48.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:50.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.470341415s Jan 22 06:46:50.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:52.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.470172549s Jan 22 06:46:52.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:54.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.470922713s Jan 22 06:46:54.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:56.607: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.470009933s Jan 22 06:46:56.607: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:46:58.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.47101487s Jan 22 06:46:58.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:00.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.470719423s Jan 22 06:47:00.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:02.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.470306937s Jan 22 06:47:02.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:04.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.470224789s Jan 22 06:47:04.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:06.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.470250806s Jan 22 06:47:06.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:08.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.470627242s Jan 22 06:47:08.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:10.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.470862259s Jan 22 06:47:10.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:12.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.470793857s Jan 22 06:47:12.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:14.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.471441616s Jan 22 06:47:14.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:16.609: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.471138822s Jan 22 06:47:16.609: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:18.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.47101174s Jan 22 06:47:18.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:20.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.470627904s Jan 22 06:47:20.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:22.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.470356284s Jan 22 06:47:22.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:24.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.471016879s Jan 22 06:47:24.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:26.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.47072424s Jan 22 06:47:26.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:28.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.470295069s Jan 22 06:47:28.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:30.608: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.470922774s Jan 22 06:47:30.608: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:32.611: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.473821225s Jan 22 06:47:32.611: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:32.845: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.707742772s Jan 22 06:47:32.845: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-08fe7e7767ef6cb6b' to be 'Running' but was 'Pending' Jan 22 06:47:32.845: INFO: Pod httpd failed to be running and ready. Jan 22 06:47:32.845: INFO: Wanted all 1 pods to be running and ready. Result: false. Pods: [httpd] Jan 22 06:47:32.845: FAIL: Expected <bool>: false to equal <bool>: true Full Stack Trace k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.1() test/e2e/kubectl/kubectl.go:415 +0x245 [AfterEach] Simple pod test/e2e/kubectl/kubectl.go:417 �[1mSTEP:�[0m using delete to clean up resources �[38;5;243m01/22/23 06:47:32.846�[0m Jan 22 06:47:32.846: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5853 delete --grace-period=0 --force -f -' Jan 22 06:47:33.901: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Jan 22 06:47:33.901: INFO: stdout: "pod \"httpd\" force deleted\n" Jan 22 06:47:33.902: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5853 get rc,svc -l name=httpd --no-headers' Jan 22 06:47:34.947: INFO: stderr: "No resources found in kubectl-5853 namespace.\n" Jan 22 06:47:34.947: INFO: stdout: "" Jan 22 06:47:34.947: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-5853 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Jan 22 06:47:35.744: INFO: stderr: "" Jan 22 06:47:35.745: INFO: stdout: "" [AfterEach] [sig-cli] Kubectl client test/e2e/framework/node/init/init.go:32 Jan 22 06:47:35.745: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-cli] Kubectl client test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-cli] Kubectl client dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/22/23 06:47:35.98�[0m �[1mSTEP:�[0m Collecting events from namespace "kubectl-5853". �[38;5;243m01/22/23 06:47:35.98�[0m �[1mSTEP:�[0m Found 11 events. �[38;5;243m01/22/23 06:47:36.214�[0m Jan 22 06:47:36.214: INFO: At 2023-01-22 06:42:32 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-5853/httpd to i-08fe7e7767ef6cb6b Jan 22 06:47:36.214: INFO: At 2023-01-22 06:42:32 +0000 UTC - event for httpd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a8bca65b49df23d5c0a5a748ac793605f15c52d9d2a3eb0577df1f6d1947eb92": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:47:36.214: INFO: At 2023-01-22 06:42:44 +0000 UTC - event for httpd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "fa3467008efe9251426f80eda650589040ee00b261c20da27f842e819393a399": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:47:36.214: INFO: At 2023-01-22 06:42:55 +0000 UTC - event for httpd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "69261303fbe7c4a5b7c315990fdb34ecd46f75eb784bbf24605719ce9c60f38f": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:47:36.214: INFO: At 2023-01-22 06:43:06 +0000 UTC - event for httpd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "909656ed278bc99fbdd4ff617947a16ae9603504916383ae8236f7a07cf9cb2c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:47:36.214: INFO: At 2023-01-22 06:43:21 +0000 UTC - event for httpd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "18257dbf697d5c136b0f105db626799768f1bc0f95f7591959709caa2db7816c": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:47:36.214: INFO: At 2023-01-22 06:43:36 +0000 UTC - event for httpd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d88e05c68ed58e11716acf8de0b300fc7d3bf2cba1464a3db3384be646c57fee": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:47:36.214: INFO: At 2023-01-22 06:43:49 +0000 UTC - event for httpd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3e9a53d90a592d83b98d2f574abd166f275edc58547b492150aad3ed8c0322c8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:47:36.214: INFO: At 2023-01-22 06:44:02 +0000 UTC - event for httpd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8ca087fe7bef37a2a53678165abace3e8c0252dad351003eeeb4d4804262efa0": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:47:36.214: INFO: At 2023-01-22 06:44:16 +0000 UTC - event for httpd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "822a76224609511bb829af1bac0996cf2c0630c71f2ad174467c7cdf6901abbd": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:47:36.214: INFO: At 2023-01-22 06:44:30 +0000 UTC - event for httpd: {kubelet i-08fe7e7767ef6cb6b} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e828a839c8b1592749348aaec2fe4eb1d8d3a1171b52e5e620dd76015fed8cae": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:47:36.452: INFO: POD NODE PHASE GRACE CONDITIONS Jan 22 06:47:36.452: INFO: Jan 22 06:47:36.687: INFO: Logging node info for node i-0784fefc7d59ccdae Jan 22 06:47:36.921: INFO: Node Info: &Node{ObjectMeta:{i-0784fefc7d59ccdae 578f4339-1faa-4298-ac96-27aed9bc236a 33107 0 2023-01-22 06:24:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0784fefc7d59ccdae kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.129 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0784fefc7d59ccdae"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-22 06:24:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-22 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:24:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-22 06:47:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0784fefc7d59ccdae,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892297728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787440128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.129,},NodeAddress{Type:ExternalIP,Address:43.205.229.145,},NodeAddress{Type:InternalDNS,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-205-229-145.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cca4041964650860029288f425941,SystemUUID:ec2cca40-4196-4650-8600-29288f425941,BootID:6d7bd66f-7345-4f07-a0a9-6dcf8a9b9a01,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643680,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841303,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965801,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 22 06:47:36.922: INFO: Logging kubelet events for node i-0784fefc7d59ccdae Jan 22 06:47:37.160: INFO: Logging pods the kubelet thinks is on node i-0784fefc7d59ccdae Jan 22 06:47:37.403: INFO: cilium-operator-5dd44dc49f-2hpqt started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:37.403: INFO: Container cilium-operator ready: true, restart count 1 Jan 22 06:47:37.403: INFO: kube-apiserver-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+2 container statuses recorded) Jan 22 06:47:37.403: INFO: Container healthcheck ready: true, restart count 0 Jan 22 06:47:37.403: INFO: Container kube-apiserver ready: true, restart count 1 Jan 22 06:47:37.403: INFO: kube-controller-manager-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:37.403: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 22 06:47:37.403: INFO: etcd-manager-events-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:37.403: INFO: Container etcd-manager ready: true, restart count 0 Jan 22 06:47:37.403: INFO: kops-controller-l7kst started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:37.403: INFO: Container kops-controller ready: true, restart count 0 Jan 22 06:47:37.403: INFO: aws-cloud-controller-manager-md9vc started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:37.403: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 22 06:47:37.403: INFO: ebs-csi-controller-5bd98b456f-xxxj2 started at 2023-01-22 06:24:41 +0000 UTC (0+5 container statuses recorded) Jan 22 06:47:37.403: INFO: Container csi-attacher ready: true, restart count 0 Jan 22 06:47:37.403: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 06:47:37.403: INFO: Container csi-resizer ready: true, restart count 0 Jan 22 06:47:37.403: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:47:37.403: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:47:37.403: INFO: etcd-manager-main-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:37.403: INFO: Container etcd-manager ready: true, restart count 0 Jan 22 06:47:37.403: INFO: kube-scheduler-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:37.403: INFO: Container kube-scheduler ready: true, restart count 0 Jan 22 06:47:37.403: INFO: ebs-csi-node-2wncs started at 2023-01-22 06:24:40 +0000 UTC (0+3 container statuses recorded) Jan 22 06:47:37.403: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:47:37.403: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:47:37.403: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:47:37.403: INFO: cilium-dphgw started at 2023-01-22 06:24:40 +0000 UTC (1+1 container statuses recorded) Jan 22 06:47:37.403: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:47:37.403: INFO: Container cilium-agent ready: true, restart count 1 Jan 22 06:47:37.403: INFO: dns-controller-69987775c6-gdndv started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:37.403: INFO: Container dns-controller ready: true, restart count 0 Jan 22 06:47:38.179: INFO: Latency metrics for node i-0784fefc7d59ccdae Jan 22 06:47:38.179: INFO: Logging node info for node i-08fe7e7767ef6cb6b Jan 22 06:47:38.414: INFO: Node Info: &Node{ObjectMeta:{i-08fe7e7767ef6cb6b 2145b9b6-87c4-4056-9d33-2bdbd91f3e25 32389 0 2023-01-22 06:25:50 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08fe7e7767ef6cb6b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-08fe7e7767ef6cb6b topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.140 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-ephemeral-6527":"i-08fe7e7767ef6cb6b","ebs.csi.aws.com":"i-08fe7e7767ef6cb6b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:43:56 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:44:04 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-08fe7e7767ef6cb6b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:44:04 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:44:04 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:44:04 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:44:04 +0000 UTC,LastTransitionTime:2023-01-22 06:26:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.140,},NodeAddress{Type:ExternalIP,Address:15.206.168.164,},NodeAddress{Type:InternalDNS,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-168-164.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec244e84b4a6ab10c46e08d94bf33aed,SystemUUID:ec244e84-b4a6-ab10-c46e-08d94bf33aed,BootID:d699615e-6b18-42f3-878b-638f85804381,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-ephemeral-6527^23d61fad-9a20-11ed-9e74-2a6fb9be6585 kubernetes.io/csi/csi-hostpath-ephemeral-6527^e5ab0ab6-9a1f-11ed-9e74-2a6fb9be6585 kubernetes.io/csi/ebs.csi.aws.com^vol-0319e775eeab878e5 kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6527^e5ab0ab6-9a1f-11ed-9e74-2a6fb9be6585,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0319e775eeab878e5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-ephemeral-6527^23d61fad-9a20-11ed-9e74-2a6fb9be6585,DevicePath:,},},Config:nil,},} Jan 22 06:47:38.414: INFO: Logging kubelet events for node i-08fe7e7767ef6cb6b Jan 22 06:47:38.650: INFO: Logging pods the kubelet thinks is on node i-08fe7e7767ef6cb6b Jan 22 06:47:38.903: INFO: test-grpc-f3275850-1d27-4e1f-a5e5-359a5f91c9eb started at 2023-01-22 06:43:17 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container etcd ready: false, restart count 0 Jan 22 06:47:38.903: INFO: pod-subpath-test-inlinevolume-7r97 started at 2023-01-22 06:42:44 +0000 UTC (0+2 container statuses recorded) Jan 22 06:47:38.903: INFO: Container test-container-subpath-inlinevolume-7r97 ready: false, restart count 0 Jan 22 06:47:38.903: INFO: Container test-container-volume-inlinevolume-7r97 ready: false, restart count 0 Jan 22 06:47:38.903: INFO: netserver-0 started at 2023-01-22 06:41:53 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container webserver ready: true, restart count 0 Jan 22 06:47:38.903: INFO: ebs-csi-node-l5r6q started at 2023-01-22 06:25:51 +0000 UTC (0+3 container statuses recorded) Jan 22 06:47:38.903: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:47:38.903: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:47:38.903: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:47:38.903: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-s7ksv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:38.903: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gpz5p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:38.903: INFO: csi-mockplugin-0 started at 2023-01-22 06:42:34 +0000 UTC (0+3 container statuses recorded) Jan 22 06:47:38.903: INFO: Container csi-provisioner ready: false, restart count 0 Jan 22 06:47:38.903: INFO: Container driver-registrar ready: false, restart count 0 Jan 22 06:47:38.903: INFO: Container mock ready: false, restart count 0 Jan 22 06:47:38.903: INFO: inline-volume-tester2-tx2n9 started at 2023-01-22 06:43:56 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 22 06:47:38.903: INFO: hostexec-i-08fe7e7767ef6cb6b-hvhc4 started at 2023-01-22 06:45:03 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container agnhost-container ready: true, restart count 0 Jan 22 06:47:38.903: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wj87w started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:38.903: INFO: csi-mockplugin-attacher-0 started at 2023-01-22 06:42:34 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:47:38.903: INFO: pod-secrets-8bddb517-320a-4b52-ada4-d992ad1e745c started at 2023-01-22 06:47:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container secret-volume-test ready: false, restart count 0 Jan 22 06:47:38.903: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:42:05 +0000 UTC (0+7 container statuses recorded) Jan 22 06:47:38.903: INFO: Container csi-attacher ready: true, restart count 0 Jan 22 06:47:38.903: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 06:47:38.903: INFO: Container csi-resizer ready: true, restart count 0 Jan 22 06:47:38.903: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 22 06:47:38.903: INFO: Container hostpath ready: true, restart count 0 Jan 22 06:47:38.903: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:47:38.903: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:47:38.903: INFO: inline-volume-tester-xj8gr started at 2023-01-22 06:42:13 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container csi-volume-tester ready: true, restart count 0 Jan 22 06:47:38.903: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wc9kg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:38.903: INFO: security-context-7c4c6663-c573-4295-85c0-25082df8e8cc started at 2023-01-22 06:43:38 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container test-container ready: false, restart count 0 Jan 22 06:47:38.903: INFO: pod-subpath-test-preprovisionedpv-shw9 started at 2023-01-22 06:45:13 +0000 UTC (2+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Init container init-volume-preprovisionedpv-shw9 ready: false, restart count 0 Jan 22 06:47:38.903: INFO: Init container test-init-subpath-preprovisionedpv-shw9 ready: false, restart count 0 Jan 22 06:47:38.903: INFO: Container test-container-subpath-preprovisionedpv-shw9 ready: false, restart count 0 Jan 22 06:47:38.903: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cfk97 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:38.903: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-b8jbr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:47:38.903: INFO: pod-51d1d92b-6389-4de0-9afd-a591763fbab3 started at 2023-01-22 06:42:26 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container write-pod ready: true, restart count 0 Jan 22 06:47:38.903: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-l8cqz started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:47:38.903: INFO: cilium-dc97x started at 2023-01-22 06:25:51 +0000 UTC (1+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:47:38.903: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:47:38.903: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6zw5t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:47:38.903: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hvhkb started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:38.903: INFO: hostexec-i-08fe7e7767ef6cb6b-b5hs4 started at 2023-01-22 06:42:10 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container agnhost-container ready: true, restart count 0 Jan 22 06:47:38.903: INFO: test-container-pod started at 2023-01-22 06:42:22 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container webserver ready: false, restart count 0 Jan 22 06:47:38.903: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hgtwv started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:38.903: INFO: pod-7b4fd2ad-817b-43ad-ac65-86d08b9d8d33 started at 2023-01-22 06:42:32 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container write-pod ready: false, restart count 0 Jan 22 06:47:38.903: INFO: busybox-ce7ffde5-8743-49cf-8c76-c81d66dffa19 started at 2023-01-22 06:42:42 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container busybox ready: false, restart count 0 Jan 22 06:47:38.903: INFO: ss-1 started at 2023-01-22 06:42:43 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container webserver ready: false, restart count 0 Jan 22 06:47:38.903: INFO: netserver-0 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container webserver ready: false, restart count 0 Jan 22 06:47:38.903: INFO: pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd started at 2023-01-22 06:42:07 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:38.903: INFO: Container write-pod ready: false, restart count 0 Jan 22 06:47:39.751: INFO: Latency metrics for node i-08fe7e7767ef6cb6b Jan 22 06:47:39.751: INFO: Logging node info for node i-0ae272b208fd17383 Jan 22 06:47:39.986: INFO: Node Info: &Node{ObjectMeta:{i-0ae272b208fd17383 8e603661-0a86-4442-9629-8fb60195f947 33321 0 2023-01-22 06:25:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ae272b208fd17383 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0ae272b208fd17383 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.122 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ae272b208fd17383"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-22 06:45:52 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status} {kube-controller-manager Update v1 2023-01-22 06:47:36 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0ae272b208fd17383,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:45:52 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:45:52 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:45:52 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:45:52 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.122,},NodeAddress{Type:ExternalIP,Address:13.233.206.115,},NodeAddress{Type:InternalDNS,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-206-115.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2696eee3a2748c57a2a7a5dcde49ea,SystemUUID:ec2696ee-e3a2-748c-57a2-a7a5dcde49ea,BootID:d7d392b7-67d7-4101-be08-ed3bfe242022,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c,DevicePath:,},},Config:nil,},} Jan 22 06:47:39.986: INFO: Logging kubelet events for node i-0ae272b208fd17383 Jan 22 06:47:40.223: INFO: Logging pods the kubelet thinks is on node i-0ae272b208fd17383 Jan 22 06:47:40.465: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-224vl started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:40.465: INFO: inline-volume-tester-cpf2m started at 2023-01-22 06:47:34 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 22 06:47:40.465: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gv8d9 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:40.465: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-jhxvf started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:47:40.465: INFO: ebs-csi-node-x6xfs started at 2023-01-22 06:25:56 +0000 UTC (0+3 container statuses recorded) Jan 22 06:47:40.465: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:47:40.465: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:47:40.465: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:47:40.465: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-nqs66 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:40.465: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-j8nx8 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:40.465: INFO: cilium-svdg2 started at 2023-01-22 06:25:56 +0000 UTC (1+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:47:40.465: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:47:40.465: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2rgjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:40.465: INFO: netserver-1 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container webserver ready: false, restart count 0 Jan 22 06:47:40.465: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-89kjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:40.465: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-tgn4t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:40.465: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-94drq started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:40.465: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-5nknv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:40.465: INFO: coredns-559769c974-j8pxd started at 2023-01-22 06:26:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:40.465: INFO: Container coredns ready: true, restart count 0 Jan 22 06:47:41.376: INFO: Latency metrics for node i-0ae272b208fd17383 Jan 22 06:47:41.376: INFO: Logging node info for node i-0f0efd5c06406af22 Jan 22 06:47:41.610: INFO: Node Info: &Node{ObjectMeta:{i-0f0efd5c06406af22 d621d241-d0c1-4fcd-95f1-3043a1e318e5 33249 0 2023-01-22 06:25:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f0efd5c06406af22 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f0efd5c06406af22 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.247 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-8268":"i-0f0efd5c06406af22","ebs.csi.aws.com":"i-0f0efd5c06406af22"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:31 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:47:31 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f0efd5c06406af22,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:31 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.247,},NodeAddress{Type:ExternalIP,Address:13.232.42.154,},NodeAddress{Type:InternalDNS,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-42-154.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27fd43a8a03a2384a7278d59d4ca0e,SystemUUID:ec27fd43-a8a0-3a23-84a7-278d59d4ca0e,BootID:5cf896d3-1ac6-483b-85fc-643267ffe608,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-8268^f4777368-9a1f-11ed-8b17-62b0431a56d0 kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4,DevicePath:,},},Config:nil,},} Jan 22 06:47:41.610: INFO: Logging kubelet events for node i-0f0efd5c06406af22 Jan 22 06:47:41.851: INFO: Logging pods the kubelet thinks is on node i-0f0efd5c06406af22 Jan 22 06:47:42.093: INFO: netserver-2 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container webserver ready: false, restart count 0 Jan 22 06:47:42.093: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-pc777 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:42.093: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lms68 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:42.093: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-swsd5 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:42.093: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-d5vgg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:47:42.093: INFO: httpd started at 2023-01-22 06:43:03 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container httpd ready: false, restart count 0 Jan 22 06:47:42.093: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-kdjqj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:47:42.093: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-dvbvr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:42.093: INFO: ss-0 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container webserver ready: true, restart count 0 Jan 22 06:47:42.093: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-sdq2g started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:42.093: INFO: ebs-csi-node-nf6tg started at 2023-01-22 06:25:55 +0000 UTC (0+3 container statuses recorded) Jan 22 06:47:42.093: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:47:42.093: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:47:42.093: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:47:42.093: INFO: pfpod started at 2023-01-22 06:43:50 +0000 UTC (0+2 container statuses recorded) Jan 22 06:47:42.093: INFO: Container portforwardtester ready: false, restart count 0 Jan 22 06:47:42.093: INFO: Container readiness ready: false, restart count 0 Jan 22 06:47:42.093: INFO: csi-mockplugin-0 started at 2023-01-22 06:42:06 +0000 UTC (0+3 container statuses recorded) Jan 22 06:47:42.093: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 06:47:42.093: INFO: Container driver-registrar ready: true, restart count 0 Jan 22 06:47:42.093: INFO: Container mock ready: true, restart count 0 Jan 22 06:47:42.093: INFO: csi-mockplugin-attacher-0 started at 2023-01-22 06:42:07 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:47:42.093: INFO: downwardapi-volume-ad80ce62-8877-4944-8efe-0eee99655f9a started at 2023-01-22 06:42:48 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container client-container ready: false, restart count 0 Jan 22 06:47:42.093: INFO: cilium-g9f7f started at 2023-01-22 06:25:55 +0000 UTC (1+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:47:42.093: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:47:42.093: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8n6lz started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:42.093: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lm57z started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:42.093: INFO: pvc-volume-tester-jcq6v started at 2023-01-22 06:42:36 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container volume-tester ready: false, restart count 0 Jan 22 06:47:42.093: INFO: metadata-volume-eb3302a6-5573-44f3-8d7b-e35190aad509 started at 2023-01-22 06:42:49 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container client-container ready: false, restart count 0 Jan 22 06:47:42.093: INFO: hostexec-i-0f0efd5c06406af22-ztx2q started at 2023-01-22 06:47:36 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container agnhost-container ready: true, restart count 0 Jan 22 06:47:42.093: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2k9d6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:42.093: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:42.895: INFO: Latency metrics for node i-0f0efd5c06406af22 Jan 22 06:47:42.895: INFO: Logging node info for node i-0f65ec97613c55060 Jan 22 06:47:43.129: INFO: Node Info: &Node{ObjectMeta:{i-0f65ec97613c55060 3b12d6e2-1a35-47ff-9dac-e4586b70e64b 33170 0 2023-01-22 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f65ec97613c55060 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f65ec97613c55060 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.23 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f65ec97613c55060"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kubelet Update v1 2023-01-22 06:47:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f65ec97613c55060,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:24 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:24 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:24 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:24 +0000 UTC,LastTransitionTime:2023-01-22 06:26:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.23,},NodeAddress{Type:ExternalIP,Address:13.233.125.79,},NodeAddress{Type:InternalDNS,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-125-79.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec29271f6fcb1e589a5709b97d78e95d,SystemUUID:ec29271f-6fcb-1e58-9a57-09b97d78e95d,BootID:67de0a94-242d-47e1-96b0-5dc05022ee13,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 22 06:47:43.130: INFO: Logging kubelet events for node i-0f65ec97613c55060 Jan 22 06:47:43.366: INFO: Logging pods the kubelet thinks is on node i-0f65ec97613c55060 Jan 22 06:47:43.605: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8qsbj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.605: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:47:43.605: INFO: cilium-582c5 started at 2023-01-22 06:25:52 +0000 UTC (1+1 container statuses recorded) Jan 22 06:47:43.605: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:47:43.605: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:47:43.605: INFO: coredns-autoscaler-7cb5c5b969-jts8s started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.605: INFO: Container autoscaler ready: true, restart count 0 Jan 22 06:47:43.605: INFO: pod-client started at 2023-01-22 06:43:18 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.605: INFO: Container pod-client ready: true, restart count 0 Jan 22 06:47:43.605: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cct9p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.605: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:43.605: INFO: netserver-3 started at 2023-01-22 06:47:29 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.605: INFO: Container webserver ready: false, restart count 0 Jan 22 06:47:43.605: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdhsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.605: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:43.605: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2zr97 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.605: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:47:43.605: INFO: ebs-csi-node-wnt99 started at 2023-01-22 06:25:52 +0000 UTC (0+3 container statuses recorded) Jan 22 06:47:43.605: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:47:43.605: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:47:43.605: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:47:43.605: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-n4scw started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.605: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:43.605: INFO: coredns-559769c974-s8kkg started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.605: INFO: Container coredns ready: true, restart count 0 Jan 22 06:47:43.606: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdcz6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.606: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:43.606: INFO: test-rs-qpmdk started at 2023-01-22 06:47:41 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.606: INFO: Container httpd ready: true, restart count 0 Jan 22 06:47:43.606: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6wbqw started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.606: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:43.606: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8sv6x started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.606: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:43.606: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-52gsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.606: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:43.606: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6bwjg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:47:43.606: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:47:44.671: INFO: Latency metrics for node i-0f65ec97613c55060 [DeferCleanup (Each)] [sig-cli] Kubectl client tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "kubectl-5853" for this suite. �[38;5;243m01/22/23 06:47:44.671�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\ssupport\sexec\susing\sresource\/name$'
test/e2e/kubectl/kubectl.go:415 k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.1() test/e2e/kubectl/kubectl.go:415 +0x245from junit_01.xml
[BeforeEach] [sig-cli] Kubectl client set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/22/23 06:48:34.501�[0m Jan 22 06:48:34.501: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/22/23 06:48:34.502�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/22/23 06:48:35.213�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/22/23 06:48:35.684�[0m [BeforeEach] [sig-cli] Kubectl client test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-cli] Kubectl client test/e2e/kubectl/kubectl.go:274 [BeforeEach] Simple pod test/e2e/kubectl/kubectl.go:411 �[1mSTEP:�[0m creating the pod from �[38;5;243m01/22/23 06:48:36.154�[0m Jan 22 06:48:36.155: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3554 create -f -' Jan 22 06:48:37.359: INFO: stderr: "" Jan 22 06:48:37.359: INFO: stdout: "pod/httpd created\n" Jan 22 06:48:37.359: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd] Jan 22 06:48:37.359: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-3554" to be "running and ready" Jan 22 06:48:37.595: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 235.775004ms Jan 22 06:48:37.595: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:48:39.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.471934344s Jan 22 06:48:39.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:48:41.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.472169429s Jan 22 06:48:41.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:48:43.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.472182774s Jan 22 06:48:43.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:48:45.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.472249573s Jan 22 06:48:45.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:48:47.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.471629446s Jan 22 06:48:47.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:48:49.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.471998208s Jan 22 06:48:49.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:48:51.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.472464203s Jan 22 06:48:51.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:48:53.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.472261544s Jan 22 06:48:53.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:48:55.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 18.472099096s Jan 22 06:48:55.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:48:57.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 20.472207996s Jan 22 06:48:57.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:48:59.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 22.472120065s Jan 22 06:48:59.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:01.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 24.472705728s Jan 22 06:49:01.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:03.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 26.472632849s Jan 22 06:49:03.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:05.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 28.472146952s Jan 22 06:49:05.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:07.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 30.472129973s Jan 22 06:49:07.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:09.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 32.47253249s Jan 22 06:49:09.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:11.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 34.471879097s Jan 22 06:49:11.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:13.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 36.471886308s Jan 22 06:49:13.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:15.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 38.472177724s Jan 22 06:49:15.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:17.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 40.472347377s Jan 22 06:49:17.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:19.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 42.472169981s Jan 22 06:49:19.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:21.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 44.472705295s Jan 22 06:49:21.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:23.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 46.472245495s Jan 22 06:49:23.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:25.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 48.472025232s Jan 22 06:49:25.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:27.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 50.472065313s Jan 22 06:49:27.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:29.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 52.472157867s Jan 22 06:49:29.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:31.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 54.471831515s Jan 22 06:49:31.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:33.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 56.472421798s Jan 22 06:49:33.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:35.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 58.472238091s Jan 22 06:49:35.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:37.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.471946841s Jan 22 06:49:37.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:39.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.472144305s Jan 22 06:49:39.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:41.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.472033529s Jan 22 06:49:41.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:43.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.472211338s Jan 22 06:49:43.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:45.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.472243461s Jan 22 06:49:45.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:47.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.471936604s Jan 22 06:49:47.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:49.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.472197904s Jan 22 06:49:49.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:51.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.472423681s Jan 22 06:49:51.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:53.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.472736674s Jan 22 06:49:53.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:55.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.471822752s Jan 22 06:49:55.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:57.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.472311749s Jan 22 06:49:57.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:49:59.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.472416872s Jan 22 06:49:59.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:01.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.472198208s Jan 22 06:50:01.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:03.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.472439856s Jan 22 06:50:03.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:05.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.472358369s Jan 22 06:50:05.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:07.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.472403943s Jan 22 06:50:07.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:09.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.472779716s Jan 22 06:50:09.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:11.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.472762838s Jan 22 06:50:11.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:13.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.472335923s Jan 22 06:50:13.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:15.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.472825783s Jan 22 06:50:15.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:17.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.472841561s Jan 22 06:50:17.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:19.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.472260535s Jan 22 06:50:19.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:21.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.472442199s Jan 22 06:50:21.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:23.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.472217198s Jan 22 06:50:23.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:25.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.472701838s Jan 22 06:50:25.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:27.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.472314429s Jan 22 06:50:27.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:29.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.472943962s Jan 22 06:50:29.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:31.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.47297878s Jan 22 06:50:31.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:33.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.472442135s Jan 22 06:50:33.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:35.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.472396053s Jan 22 06:50:35.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:37.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.472921057s Jan 22 06:50:37.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:39.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.472890863s Jan 22 06:50:39.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:41.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.472943s Jan 22 06:50:41.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:43.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.472628633s Jan 22 06:50:43.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:45.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.472934705s Jan 22 06:50:45.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:47.833: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.473886406s Jan 22 06:50:47.833: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:49.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.472546588s Jan 22 06:50:49.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:51.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.472970427s Jan 22 06:50:51.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:53.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.472734927s Jan 22 06:50:53.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:55.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.472938647s Jan 22 06:50:55.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:57.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.472674341s Jan 22 06:50:57.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:50:59.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.472330235s Jan 22 06:50:59.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:01.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.473232004s Jan 22 06:51:01.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:03.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.472955883s Jan 22 06:51:03.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:05.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.472727006s Jan 22 06:51:05.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:07.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.473046941s Jan 22 06:51:07.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:09.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.472798315s Jan 22 06:51:09.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:11.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.47328399s Jan 22 06:51:11.833: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:13.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.473194103s Jan 22 06:51:13.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:15.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.472935498s Jan 22 06:51:15.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:17.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.472871416s Jan 22 06:51:17.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:19.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.472972696s Jan 22 06:51:19.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:21.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.473010484s Jan 22 06:51:21.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:23.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.472763738s Jan 22 06:51:23.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:25.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.472420209s Jan 22 06:51:25.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:27.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.472782151s Jan 22 06:51:27.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:29.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.472604116s Jan 22 06:51:29.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:31.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.472882426s Jan 22 06:51:31.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:33.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.472486416s Jan 22 06:51:33.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:35.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.472620461s Jan 22 06:51:35.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:37.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.472864386s Jan 22 06:51:37.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:39.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.47277216s Jan 22 06:51:39.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:41.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.472820435s Jan 22 06:51:41.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:43.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.472560071s Jan 22 06:51:43.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:45.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.473031599s Jan 22 06:51:45.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:47.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.472940602s Jan 22 06:51:47.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:49.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.472618067s Jan 22 06:51:49.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:51.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.473178912s Jan 22 06:51:51.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:53.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.473005824s Jan 22 06:51:53.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:55.833: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.473881166s Jan 22 06:51:55.833: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:57.833: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.473360245s Jan 22 06:51:57.833: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:51:59.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.472793877s Jan 22 06:51:59.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:01.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.473270411s Jan 22 06:52:01.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:03.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.473148002s Jan 22 06:52:03.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:05.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.472605261s Jan 22 06:52:05.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:07.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.473054613s Jan 22 06:52:07.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:09.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.472381041s Jan 22 06:52:09.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:11.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.473209353s Jan 22 06:52:11.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:13.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.473242741s Jan 22 06:52:13.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:15.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.473189923s Jan 22 06:52:15.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:17.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.473029597s Jan 22 06:52:17.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:19.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.472835518s Jan 22 06:52:19.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:21.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.472801484s Jan 22 06:52:21.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:23.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.472237632s Jan 22 06:52:23.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:25.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.472860685s Jan 22 06:52:25.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:27.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.472814527s Jan 22 06:52:27.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:29.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.472641394s Jan 22 06:52:29.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:31.833: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.473518962s Jan 22 06:52:31.833: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:33.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.472412496s Jan 22 06:52:33.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:35.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.473106532s Jan 22 06:52:35.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:37.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.473246375s Jan 22 06:52:37.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:39.833: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.473494035s Jan 22 06:52:39.833: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:41.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.4728316s Jan 22 06:52:41.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:43.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.472640899s Jan 22 06:52:43.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:45.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.472205164s Jan 22 06:52:45.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:47.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.472814216s Jan 22 06:52:47.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:49.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.472376458s Jan 22 06:52:49.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:51.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.473132937s Jan 22 06:52:51.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:53.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.47270641s Jan 22 06:52:53.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:55.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.47314899s Jan 22 06:52:55.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:57.831: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.472200565s Jan 22 06:52:57.831: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:52:59.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.472495474s Jan 22 06:52:59.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:01.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.473100991s Jan 22 06:53:01.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:03.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.472799506s Jan 22 06:53:03.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:05.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.472548921s Jan 22 06:53:05.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:07.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.472952755s Jan 22 06:53:07.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:09.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.472831207s Jan 22 06:53:09.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:11.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.472649693s Jan 22 06:53:11.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:13.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.47304013s Jan 22 06:53:13.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:15.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.472756851s Jan 22 06:53:15.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:17.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.472630393s Jan 22 06:53:17.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:19.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.473059148s Jan 22 06:53:19.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:21.833: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.473414945s Jan 22 06:53:21.833: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:23.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.472751193s Jan 22 06:53:23.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:25.833: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.473383564s Jan 22 06:53:25.833: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:27.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.472993775s Jan 22 06:53:27.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:29.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.47239234s Jan 22 06:53:29.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:31.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.472994319s Jan 22 06:53:31.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:33.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.472712489s Jan 22 06:53:33.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:35.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.47255318s Jan 22 06:53:35.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:37.832: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.472972151s Jan 22 06:53:37.832: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:38.068: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.709238197s Jan 22 06:53:38.068: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending' Jan 22 06:53:38.068: INFO: Pod httpd failed to be running and ready. Jan 22 06:53:38.068: INFO: Wanted all 1 pods to be running and ready. Result: false. Pods: [httpd] Jan 22 06:53:38.069: FAIL: Expected <bool>: false to equal <bool>: true Full Stack Trace k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.1() test/e2e/kubectl/kubectl.go:415 +0x245 [AfterEach] Simple pod test/e2e/kubectl/kubectl.go:417 �[1mSTEP:�[0m using delete to clean up resources �[38;5;243m01/22/23 06:53:38.069�[0m Jan 22 06:53:38.069: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3554 delete --grace-period=0 --force -f -' Jan 22 06:53:39.125: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n" Jan 22 06:53:39.125: INFO: stdout: "pod \"httpd\" force deleted\n" Jan 22 06:53:39.125: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3554 get rc,svc -l name=httpd --no-headers' Jan 22 06:53:40.183: INFO: stderr: "No resources found in kubectl-3554 namespace.\n" Jan 22 06:53:40.183: INFO: stdout: "" Jan 22 06:53:40.183: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-3554 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}' Jan 22 06:53:40.971: INFO: stderr: "" Jan 22 06:53:40.971: INFO: stdout: "" [AfterEach] [sig-cli] Kubectl client test/e2e/framework/node/init/init.go:32 Jan 22 06:53:40.971: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready [DeferCleanup (Each)] [sig-cli] Kubectl client test/e2e/framework/metrics/init/init.go:33 [DeferCleanup (Each)] [sig-cli] Kubectl client dump namespaces | framework.go:196 �[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/22/23 06:53:41.209�[0m �[1mSTEP:�[0m Collecting events from namespace "kubectl-3554". �[38;5;243m01/22/23 06:53:41.209�[0m �[1mSTEP:�[0m Found 11 events. �[38;5;243m01/22/23 06:53:41.446�[0m Jan 22 06:53:41.446: INFO: At 2023-01-22 06:48:37 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-3554/httpd to i-0f0efd5c06406af22 Jan 22 06:53:41.446: INFO: At 2023-01-22 06:48:37 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c064ab1ffe0a233003f45b44f402ab997d5b0896ba7f4d1c987982e1870ce810": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:53:41.446: INFO: At 2023-01-22 06:48:50 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d96ec916081350ebfb4deba03be99a74c948a35fc6f63fa2ed3966f716061261": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:53:41.446: INFO: At 2023-01-22 06:49:05 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3ec0a9631063b49232ce501d625574b5b5af6912833db265e5e3acfafa67ff21": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:53:41.446: INFO: At 2023-01-22 06:49:16 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "75760be8db16559b91bf1d93e9552a03b4480481104d32d341cd7879c4aeaf6b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:53:41.446: INFO: At 2023-01-22 06:49:28 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a12547ab3c5e3c6ad9885ce9fcb65d61aff51a832ada75578531fc068b2c11a2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:53:41.446: INFO: At 2023-01-22 06:49:43 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "65340a3aec5d04cf140997ec0763370d63df0fb35a0ae0295c84ce6c402a7924": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:53:41.446: INFO: At 2023-01-22 06:49:58 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2e74637d561dc5dbd672ffb6f3fe705858578f1a886c77c9d8810df597ea2552": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:53:41.446: INFO: At 2023-01-22 06:50:11 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "6d06ccf64dcfb6ea6e7c9a2983524c150b27ee05e7430ac03faa59db6137075e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:53:41.446: INFO: At 2023-01-22 06:50:22 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "3d2374cd65f5f78dd4e029e2f9a4fc26418a31bb877f8645511510e85a2f8ca7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:53:41.446: INFO: At 2023-01-22 06:50:34 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e2929ab148b7642839133aced78449979ce185c858fc77ad1ba9e25031468760": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available Jan 22 06:53:41.682: INFO: POD NODE PHASE GRACE CONDITIONS Jan 22 06:53:41.682: INFO: Jan 22 06:53:41.919: INFO: Logging node info for node i-0784fefc7d59ccdae Jan 22 06:53:42.155: INFO: Node Info: &Node{ObjectMeta:{i-0784fefc7d59ccdae 578f4339-1faa-4298-ac96-27aed9bc236a 35489 0 2023-01-22 06:24:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0784fefc7d59ccdae kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.129 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0784fefc7d59ccdae"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-22 06:24:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-22 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:24:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-22 06:52:15 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0784fefc7d59ccdae,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892297728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787440128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:15 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:15 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:15 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:52:15 +0000 UTC,LastTransitionTime:2023-01-22 06:24:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.129,},NodeAddress{Type:ExternalIP,Address:43.205.229.145,},NodeAddress{Type:InternalDNS,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-205-229-145.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cca4041964650860029288f425941,SystemUUID:ec2cca40-4196-4650-8600-29288f425941,BootID:6d7bd66f-7345-4f07-a0a9-6dcf8a9b9a01,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643680,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841303,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965801,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},} Jan 22 06:53:42.155: INFO: Logging kubelet events for node i-0784fefc7d59ccdae Jan 22 06:53:42.394: INFO: Logging pods the kubelet thinks is on node i-0784fefc7d59ccdae Jan 22 06:53:42.636: INFO: ebs-csi-node-2wncs started at 2023-01-22 06:24:40 +0000 UTC (0+3 container statuses recorded) Jan 22 06:53:42.636: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:53:42.636: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:53:42.636: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:53:42.636: INFO: cilium-dphgw started at 2023-01-22 06:24:40 +0000 UTC (1+1 container statuses recorded) Jan 22 06:53:42.636: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:53:42.636: INFO: Container cilium-agent ready: true, restart count 1 Jan 22 06:53:42.636: INFO: dns-controller-69987775c6-gdndv started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:42.636: INFO: Container dns-controller ready: true, restart count 0 Jan 22 06:53:42.636: INFO: ebs-csi-controller-5bd98b456f-xxxj2 started at 2023-01-22 06:24:41 +0000 UTC (0+5 container statuses recorded) Jan 22 06:53:42.636: INFO: Container csi-attacher ready: true, restart count 0 Jan 22 06:53:42.636: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 06:53:42.636: INFO: Container csi-resizer ready: true, restart count 0 Jan 22 06:53:42.636: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:53:42.636: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:53:42.636: INFO: etcd-manager-main-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:42.636: INFO: Container etcd-manager ready: true, restart count 0 Jan 22 06:53:42.636: INFO: kube-scheduler-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:42.636: INFO: Container kube-scheduler ready: true, restart count 0 Jan 22 06:53:42.636: INFO: etcd-manager-events-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:42.636: INFO: Container etcd-manager ready: true, restart count 0 Jan 22 06:53:42.636: INFO: kops-controller-l7kst started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:42.636: INFO: Container kops-controller ready: true, restart count 0 Jan 22 06:53:42.636: INFO: aws-cloud-controller-manager-md9vc started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:42.636: INFO: Container aws-cloud-controller-manager ready: true, restart count 0 Jan 22 06:53:42.636: INFO: cilium-operator-5dd44dc49f-2hpqt started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:42.636: INFO: Container cilium-operator ready: true, restart count 1 Jan 22 06:53:42.636: INFO: kube-apiserver-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+2 container statuses recorded) Jan 22 06:53:42.636: INFO: Container healthcheck ready: true, restart count 0 Jan 22 06:53:42.636: INFO: Container kube-apiserver ready: true, restart count 1 Jan 22 06:53:42.636: INFO: kube-controller-manager-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:42.636: INFO: Container kube-controller-manager ready: true, restart count 2 Jan 22 06:53:43.483: INFO: Latency metrics for node i-0784fefc7d59ccdae Jan 22 06:53:43.483: INFO: Logging node info for node i-08fe7e7767ef6cb6b Jan 22 06:53:43.719: INFO: Node Info: &Node{ObjectMeta:{i-08fe7e7767ef6cb6b 2145b9b6-87c4-4056-9d33-2bdbd91f3e25 35548 0 2023-01-22 06:25:50 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08fe7e7767ef6cb6b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-08fe7e7767ef6cb6b topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.140 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-6487":"i-08fe7e7767ef6cb6b","ebs.csi.aws.com":"i-08fe7e7767ef6cb6b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:52:24 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:52:24 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-08fe7e7767ef6cb6b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:24 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:24 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:24 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:52:24 +0000 UTC,LastTransitionTime:2023-01-22 06:26:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.140,},NodeAddress{Type:ExternalIP,Address:15.206.168.164,},NodeAddress{Type:InternalDNS,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-168-164.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec244e84b4a6ab10c46e08d94bf33aed,SystemUUID:ec244e84-b4a6-ab10-c46e-08d94bf33aed,BootID:d699615e-6b18-42f3-878b-638f85804381,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-6487^d59ef7b4-9a20-11ed-8c0b-9a4b66333a9e kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1,DevicePath:,},},Config:nil,},} Jan 22 06:53:43.720: INFO: Logging kubelet events for node i-08fe7e7767ef6cb6b Jan 22 06:53:43.958: INFO: Logging pods the kubelet thinks is on node i-08fe7e7767ef6cb6b Jan 22 06:53:44.202: INFO: ss-1 started at 2023-01-22 06:42:43 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container webserver ready: true, restart count 0 Jan 22 06:53:44.202: INFO: hostpath-symlink-prep-provisioning-3728 started at 2023-01-22 06:50:02 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container init-volume-provisioning-3728 ready: false, restart count 0 Jan 22 06:53:44.202: INFO: ebs-csi-node-l5r6q started at 2023-01-22 06:25:51 +0000 UTC (0+3 container statuses recorded) Jan 22 06:53:44.202: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:53:44.202: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:53:44.202: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:53:44.202: INFO: nodeport-test-6dfdc started at 2023-01-22 06:49:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container nodeport-test ready: false, restart count 0 Jan 22 06:53:44.202: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gpz5p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:44.202: INFO: csi-mockplugin-attacher-0 started at 2023-01-22 06:48:03 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:53:44.202: INFO: test-rs-xg558 started at 2023-01-22 06:52:48 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container httpd ready: false, restart count 0 Jan 22 06:53:44.202: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wj87w started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:44.202: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-s7ksv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:44.202: INFO: pod-configmaps-ff2dafa2-f248-436c-af02-1f7e49c2a98c started at 2023-01-22 06:53:01 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container agnhost-container ready: false, restart count 0 Jan 22 06:53:44.202: INFO: csi-mockplugin-0 started at 2023-01-22 06:48:03 +0000 UTC (0+3 container statuses recorded) Jan 22 06:53:44.202: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 06:53:44.202: INFO: Container driver-registrar ready: true, restart count 0 Jan 22 06:53:44.202: INFO: Container mock ready: true, restart count 0 Jan 22 06:53:44.202: INFO: pvc-volume-tester-274d7 started at 2023-01-22 06:48:54 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container volume-tester ready: false, restart count 0 Jan 22 06:53:44.202: INFO: termination-message-container962263c0-ea82-48ad-a838-91a02214c13e started at 2023-01-22 06:49:02 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container termination-message-container ready: false, restart count 0 Jan 22 06:53:44.202: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wc9kg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:44.202: INFO: pod-6b476aa3-d846-4f9c-939d-2491a5bc640e started at 2023-01-22 06:53:26 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container test-container ready: false, restart count 0 Jan 22 06:53:44.202: INFO: test-rs-q8xtv started at 2023-01-22 06:49:58 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container httpd ready: false, restart count 0 Jan 22 06:53:44.202: INFO: netserver-0 started at 2023-01-22 06:53:32 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container webserver ready: false, restart count 0 Jan 22 06:53:44.202: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-b8jbr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:44.202: INFO: pod-configmaps-4109893d-8a94-4e5e-936f-9ce494faed8a started at 2023-01-22 06:52:25 +0000 UTC (0+2 container statuses recorded) Jan 22 06:53:44.202: INFO: Container agnhost-container ready: false, restart count 0 Jan 22 06:53:44.202: INFO: Container configmap-volume-binary-test ready: false, restart count 0 Jan 22 06:53:44.202: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-l8cqz started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:53:44.202: INFO: pod-server-1 started at 2023-01-22 06:47:41 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container agnhost-container ready: true, restart count 0 Jan 22 06:53:44.202: INFO: cilium-dc97x started at 2023-01-22 06:25:51 +0000 UTC (1+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:53:44.202: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:53:44.202: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cfk97 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:44.202: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hvhkb started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:44.202: INFO: pod-server-2 started at 2023-01-22 06:49:36 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container agnhost-container ready: false, restart count 0 Jan 22 06:53:44.202: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hgtwv started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:44.202: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6zw5t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:44.202: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:45.021: INFO: Latency metrics for node i-08fe7e7767ef6cb6b Jan 22 06:53:45.021: INFO: Logging node info for node i-0ae272b208fd17383 Jan 22 06:53:45.258: INFO: Node Info: &Node{ObjectMeta:{i-0ae272b208fd17383 8e603661-0a86-4442-9629-8fb60195f947 35756 0 2023-01-22 06:25:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ae272b208fd17383 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0ae272b208fd17383 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.122 csi.volume.kubernetes.io/nodeid:{"csi-hostpath-provisioning-863":"i-0ae272b208fd17383","ebs.csi.aws.com":"i-0ae272b208fd17383"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:52:49 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:52:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0ae272b208fd17383,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:50 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:50 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:52:50 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:52:50 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.122,},NodeAddress{Type:ExternalIP,Address:13.233.206.115,},NodeAddress{Type:InternalDNS,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-206-115.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2696eee3a2748c57a2a7a5dcde49ea,SystemUUID:ec2696ee-e3a2-748c-57a2-a7a5dcde49ea,BootID:d7d392b7-67d7-4101-be08-ed3bfe242022,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-hostpath-provisioning-863^61282dfc-9a21-11ed-a3bd-7e3891f1fe9c kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c kubernetes.io/csi/ebs.csi.aws.com^vol-0a2e75d3fa837517a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0a2e75d3fa837517a,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/csi-hostpath-provisioning-863^61282dfc-9a21-11ed-a3bd-7e3891f1fe9c,DevicePath:,},},Config:nil,},} Jan 22 06:53:45.258: INFO: Logging kubelet events for node i-0ae272b208fd17383 Jan 22 06:53:45.497: INFO: Logging pods the kubelet thinks is on node i-0ae272b208fd17383 Jan 22 06:53:45.740: INFO: coredns-559769c974-j8pxd started at 2023-01-22 06:26:35 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container coredns ready: true, restart count 0 Jan 22 06:53:45.740: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-224vl started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:45.740: INFO: inline-volume-tester-cpf2m started at 2023-01-22 06:47:34 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container csi-volume-tester ready: true, restart count 0 Jan 22 06:53:45.740: INFO: pod-subpath-test-dynamicpv-9qxv started at 2023-01-22 06:52:48 +0000 UTC (0+2 container statuses recorded) Jan 22 06:53:45.740: INFO: Container test-container-subpath-dynamicpv-9qxv ready: false, restart count 0 Jan 22 06:53:45.740: INFO: Container test-container-volume-dynamicpv-9qxv ready: false, restart count 0 Jan 22 06:53:45.740: INFO: ebs-csi-node-x6xfs started at 2023-01-22 06:25:56 +0000 UTC (0+3 container statuses recorded) Jan 22 06:53:45.740: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:53:45.740: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:53:45.740: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:53:45.740: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gv8d9 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:45.740: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-jhxvf started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:53:45.740: INFO: ss-2 started at 2023-01-22 06:48:56 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container webserver ready: false, restart count 0 Jan 22 06:53:45.740: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-nqs66 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:45.740: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-j8nx8 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:45.740: INFO: cilium-svdg2 started at 2023-01-22 06:25:56 +0000 UTC (1+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:53:45.740: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:53:45.740: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:49:03 +0000 UTC (0+7 container statuses recorded) Jan 22 06:53:45.740: INFO: Container csi-attacher ready: true, restart count 0 Jan 22 06:53:45.740: INFO: Container csi-provisioner ready: true, restart count 0 Jan 22 06:53:45.740: INFO: Container csi-resizer ready: true, restart count 0 Jan 22 06:53:45.740: INFO: Container csi-snapshotter ready: true, restart count 0 Jan 22 06:53:45.740: INFO: Container hostpath ready: true, restart count 0 Jan 22 06:53:45.740: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:53:45.740: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:53:45.740: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-89kjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:45.740: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2rgjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:45.740: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-tgn4t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:45.740: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-94drq started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:45.740: INFO: netserver-1 started at 2023-01-22 06:53:33 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container webserver ready: false, restart count 0 Jan 22 06:53:45.740: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-5nknv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:45.740: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:46.562: INFO: Latency metrics for node i-0ae272b208fd17383 Jan 22 06:53:46.562: INFO: Logging node info for node i-0f0efd5c06406af22 Jan 22 06:53:46.799: INFO: Node Info: &Node{ObjectMeta:{i-0f0efd5c06406af22 d621d241-d0c1-4fcd-95f1-3043a1e318e5 36062 0 2023-01-22 06:25:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f0efd5c06406af22 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f0efd5c06406af22 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.247 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f0efd5c06406af22"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:53:25 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:53:28 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f0efd5c06406af22,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:28 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:28 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:28 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:53:28 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.247,},NodeAddress{Type:ExternalIP,Address:13.232.42.154,},NodeAddress{Type:InternalDNS,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-42-154.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27fd43a8a03a2384a7278d59d4ca0e,SystemUUID:ec27fd43-a8a0-3a23-84a7-278d59d4ca0e,BootID:5cf896d3-1ac6-483b-85fc-643267ffe608,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-045a7b4a2c61a4448 kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-045a7b4a2c61a4448,DevicePath:,},},Config:nil,},} Jan 22 06:53:46.799: INFO: Logging kubelet events for node i-0f0efd5c06406af22 Jan 22 06:53:47.038: INFO: Logging pods the kubelet thinks is on node i-0f0efd5c06406af22 Jan 22 06:53:47.281: INFO: pod-2249effe-eabc-49ee-a361-f1280a42a1bd started at 2023-01-22 06:53:22 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.281: INFO: Container write-pod ready: false, restart count 0 Jan 22 06:53:47.281: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-pc777 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.281: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:47.281: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lms68 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.281: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:47.281: INFO: netserver-2 started at 2023-01-22 06:53:33 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.281: INFO: Container webserver ready: false, restart count 0 Jan 22 06:53:47.281: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-swsd5 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:47.282: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-d5vgg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:47.282: INFO: ss-0 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container webserver ready: true, restart count 0 Jan 22 06:53:47.282: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-sdq2g started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:47.282: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-kdjqj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:47.282: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-dvbvr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:47.282: INFO: ebs-csi-node-nf6tg started at 2023-01-22 06:25:55 +0000 UTC (0+3 container statuses recorded) Jan 22 06:53:47.282: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:53:47.282: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:53:47.282: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:53:47.282: INFO: e2e-configmap-dns-server-f02b67dc-3110-446b-8668-2f483f3d9525 started at 2023-01-22 06:48:58 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container agnhost-container ready: false, restart count 0 Jan 22 06:53:47.282: INFO: nodeport-test-hrghh started at 2023-01-22 06:49:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container nodeport-test ready: false, restart count 0 Jan 22 06:53:47.282: INFO: pod-4b746955-149c-496e-ba63-8e63c8e7b5cc started at 2023-01-22 06:53:17 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container test-container ready: false, restart count 0 Jan 22 06:53:47.282: INFO: cilium-g9f7f started at 2023-01-22 06:25:55 +0000 UTC (1+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:53:47.282: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:53:47.282: INFO: csi-mockplugin-0 started at 2023-01-22 06:47:48 +0000 UTC (0+3 container statuses recorded) Jan 22 06:53:47.282: INFO: Container csi-provisioner ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container driver-registrar ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container mock ready: false, restart count 0 Jan 22 06:53:47.282: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:47:59 +0000 UTC (0+7 container statuses recorded) Jan 22 06:53:47.282: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container csi-provisioner ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container csi-resizer ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container hostpath ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container liveness-probe ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 22 06:53:47.282: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8n6lz started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:47.282: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lm57z started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:47.282: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:52:57 +0000 UTC (0+7 container statuses recorded) Jan 22 06:53:47.282: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container csi-provisioner ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container csi-resizer ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container hostpath ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container liveness-probe ready: false, restart count 0 Jan 22 06:53:47.282: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 22 06:53:47.282: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2k9d6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:47.282: INFO: test-rs-bvvpf started at 2023-01-22 06:50:30 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:47.282: INFO: Container httpd ready: true, restart count 0 Jan 22 06:53:48.073: INFO: Latency metrics for node i-0f0efd5c06406af22 Jan 22 06:53:48.073: INFO: Logging node info for node i-0f65ec97613c55060 Jan 22 06:53:48.309: INFO: Node Info: &Node{ObjectMeta:{i-0f65ec97613c55060 3b12d6e2-1a35-47ff-9dac-e4586b70e64b 35882 0 2023-01-22 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f65ec97613c55060 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f65ec97613c55060 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.23 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f65ec97613c55060"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:53:02 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f65ec97613c55060,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:02 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:02 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:53:02 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:53:02 +0000 UTC,LastTransitionTime:2023-01-22 06:26:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.23,},NodeAddress{Type:ExternalIP,Address:13.233.125.79,},NodeAddress{Type:InternalDNS,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-125-79.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec29271f6fcb1e589a5709b97d78e95d,SystemUUID:ec29271f-6fcb-1e58-9a57-09b97d78e95d,BootID:67de0a94-242d-47e1-96b0-5dc05022ee13,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-08f4126003dfe4110],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08f4126003dfe4110,DevicePath:,},},Config:nil,},} Jan 22 06:53:48.309: INFO: Logging kubelet events for node i-0f65ec97613c55060 Jan 22 06:53:48.547: INFO: Logging pods the kubelet thinks is on node i-0f65ec97613c55060 Jan 22 06:53:48.792: INFO: cilium-582c5 started at 2023-01-22 06:25:52 +0000 UTC (1+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Init container clean-cilium-state ready: true, restart count 0 Jan 22 06:53:48.792: INFO: Container cilium-agent ready: true, restart count 0 Jan 22 06:53:48.792: INFO: coredns-autoscaler-7cb5c5b969-jts8s started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container autoscaler ready: true, restart count 0 Jan 22 06:53:48.792: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:47:58 +0000 UTC (0+7 container statuses recorded) Jan 22 06:53:48.792: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container csi-provisioner ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container csi-resizer ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container hostpath ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container liveness-probe ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 22 06:53:48.792: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8qsbj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:48.792: INFO: pod-client started at 2023-01-22 06:43:18 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container pod-client ready: true, restart count 0 Jan 22 06:53:48.792: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cct9p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:48.792: INFO: inline-volume-tester2-5g7d4 started at 2023-01-22 06:47:51 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container csi-volume-tester ready: false, restart count 0 Jan 22 06:53:48.792: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdhsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:48.792: INFO: ebs-csi-node-wnt99 started at 2023-01-22 06:25:52 +0000 UTC (0+3 container statuses recorded) Jan 22 06:53:48.792: INFO: Container ebs-plugin ready: true, restart count 0 Jan 22 06:53:48.792: INFO: Container liveness-probe ready: true, restart count 0 Jan 22 06:53:48.792: INFO: Container node-driver-registrar ready: true, restart count 0 Jan 22 06:53:48.792: INFO: hostexec-i-0f65ec97613c55060-vvr62 started at 2023-01-22 06:53:02 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container agnhost-container ready: true, restart count 0 Jan 22 06:53:48.792: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2zr97 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0 Jan 22 06:53:48.792: INFO: netserver-3 started at 2023-01-22 06:53:33 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container webserver ready: false, restart count 0 Jan 22 06:53:48.792: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:48:12 +0000 UTC (0+7 container statuses recorded) Jan 22 06:53:48.792: INFO: Container csi-attacher ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container csi-provisioner ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container csi-resizer ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container csi-snapshotter ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container hostpath ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container liveness-probe ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container node-driver-registrar ready: false, restart count 0 Jan 22 06:53:48.792: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-n4scw started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:48.792: INFO: test-rs-lbplk started at 2023-01-22 06:52:48 +0000 UTC (0+2 container statuses recorded) Jan 22 06:53:48.792: INFO: Container httpd ready: false, restart count 0 Jan 22 06:53:48.792: INFO: Container test-rs ready: false, restart count 0 Jan 22 06:53:48.792: INFO: coredns-559769c974-s8kkg started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container coredns ready: true, restart count 0 Jan 22 06:53:48.792: INFO: pod-e613b77a-70a2-44aa-a6ee-e2b9de8f86a6 started at 2023-01-22 06:53:08 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container write-pod ready: false, restart count 0 Jan 22 06:53:48.792: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6wbqw started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:48.792: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8sv6x started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:48.792: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-52gsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:48.792: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6bwjg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:48.792: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdcz6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded) Jan 22 06:53:48.792: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0 Jan 22 06:53:49.596: INFO: Latency metrics for node i-0f65ec97613c55060 [DeferCleanup (Each)] [sig-cli] Kubectl client tear down framework | framework.go:193 �[1mSTEP:�[0m Destroying namespace "kubectl-3554" for this suite. �[38;5;243m01/22/23 06:53:49.596�[0m
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-cli\]\sKubectl\sclient\sSimple\spod\sshould\ssupport\sinline\sexecution\sand\sattach$'
test/e2e/framework/kubectl/builder.go:87
k8s.io/kubernetes/test/e2e/framework/kubectl.KubectlBuilder.ExecOrDie({0xc000d0fa20?, 0x0?}, {0xc005189ba0, 0xc})
test/e2e/framework/kubectl/builder.go:87 +0x1b4
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.8()
test/e2e/kubectl/kubectl.go:609 +0x2af
[BeforeEach] [sig-cli] Kubectl client
set up framework | framework.go:178
�[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/22/23 06:43:00.824�[0m
Jan 22 06:43:00.824: INFO: >>> kubeConfig: /root/.kube/config
�[1mSTEP:�[0m Building a namespace api object, basename kubectl �[38;5;243m01/22/23 06:43:00.825�[0m
�[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/22/23 06:43:01.523�[0m
�[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/22/23 06:43:01.987�[0m
[BeforeEach] [sig-cli] Kubectl client
test/e2e/framework/metrics/init/init.go:31
[BeforeEach] [sig-cli] Kubectl client
test/e2e/kubectl/kubectl.go:274
[BeforeEach] Simple pod
test/e2e/kubectl/kubectl.go:411
�[1mSTEP:�[0m creating the pod from �[38;5;243m01/22/23 06:43:02.45�[0m
Jan 22 06:43:02.450: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9636 create -f -'
Jan 22 06:43:03.697: INFO: stderr: ""
Jan 22 06:43:03.697: INFO: stdout: "pod/httpd created\n"
Jan 22 06:43:03.697: INFO: Waiting up to 5m0s for 1 pods to be running and ready: [httpd]
Jan 22 06:43:03.697: INFO: Waiting up to 5m0s for pod "httpd" in namespace "kubectl-9636" to be "running and ready"
Jan 22 06:43:03.929: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 232.134634ms
Jan 22 06:43:03.929: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:06.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2.464745177s
Jan 22 06:43:06.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:08.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4.465381031s
Jan 22 06:43:08.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:10.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 6.464658126s
Jan 22 06:43:10.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:12.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 8.464885554s
Jan 22 06:43:12.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:14.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 10.465514068s
Jan 22 06:43:14.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:16.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 12.46531568s
Jan 22 06:43:16.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:18.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 14.464778323s
Jan 22 06:43:18.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:20.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 16.465654162s
Jan 22 06:43:20.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:22.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 18.465294152s
Jan 22 06:43:22.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:24.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 20.464770619s
Jan 22 06:43:24.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:26.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 22.464566464s
Jan 22 06:43:26.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:28.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 24.465259828s
Jan 22 06:43:28.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:30.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 26.46527198s
Jan 22 06:43:30.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:32.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 28.465338287s
Jan 22 06:43:32.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:34.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 30.465006907s
Jan 22 06:43:34.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:36.161: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 32.464340917s
Jan 22 06:43:36.161: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:38.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 34.465227666s
Jan 22 06:43:38.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:40.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 36.464702156s
Jan 22 06:43:40.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:42.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 38.465254506s
Jan 22 06:43:42.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:44.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 40.465577057s
Jan 22 06:43:44.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:46.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 42.465818799s
Jan 22 06:43:46.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:48.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 44.465390739s
Jan 22 06:43:48.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:50.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 46.46461601s
Jan 22 06:43:50.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:52.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 48.465638949s
Jan 22 06:43:52.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:54.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 50.465550999s
Jan 22 06:43:54.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:56.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 52.464484841s
Jan 22 06:43:56.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:43:58.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 54.465167267s
Jan 22 06:43:58.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:00.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 56.465500331s
Jan 22 06:44:00.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:02.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 58.465403333s
Jan 22 06:44:02.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:04.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.46444899s
Jan 22 06:44:04.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:06.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.46455503s
Jan 22 06:44:06.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:08.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.465436563s
Jan 22 06:44:08.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:10.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.465056255s
Jan 22 06:44:10.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:12.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.465257892s
Jan 22 06:44:12.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:14.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.465712944s
Jan 22 06:44:14.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:16.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.464547863s
Jan 22 06:44:16.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:18.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.465199539s
Jan 22 06:44:18.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:20.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.4652875s
Jan 22 06:44:20.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:22.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.465219767s
Jan 22 06:44:22.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:24.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.464511679s
Jan 22 06:44:24.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:26.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.465104814s
Jan 22 06:44:26.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:28.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.464994415s
Jan 22 06:44:28.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:30.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.465298222s
Jan 22 06:44:30.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:32.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.465307224s
Jan 22 06:44:32.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:34.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.465231479s
Jan 22 06:44:34.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:36.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.465330775s
Jan 22 06:44:36.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:38.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.465095781s
Jan 22 06:44:38.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:40.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.465409138s
Jan 22 06:44:40.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:42.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.465059296s
Jan 22 06:44:42.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:44.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.465439158s
Jan 22 06:44:44.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:46.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.465533858s
Jan 22 06:44:46.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:48.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.465107823s
Jan 22 06:44:48.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:50.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.465659701s
Jan 22 06:44:50.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:52.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.464818443s
Jan 22 06:44:52.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:54.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.465129454s
Jan 22 06:44:54.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:56.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.465546623s
Jan 22 06:44:56.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:44:58.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.465344548s
Jan 22 06:44:58.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:00.164: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.467406023s
Jan 22 06:45:00.165: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:02.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.465355409s
Jan 22 06:45:02.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:04.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.464929549s
Jan 22 06:45:04.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:06.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.465681468s
Jan 22 06:45:06.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:08.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.465502588s
Jan 22 06:45:08.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:10.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.465661227s
Jan 22 06:45:10.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:12.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.464609046s
Jan 22 06:45:12.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:14.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.465270465s
Jan 22 06:45:14.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:16.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.464729221s
Jan 22 06:45:16.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:18.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.465202177s
Jan 22 06:45:18.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:20.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.465222818s
Jan 22 06:45:20.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:22.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.465182858s
Jan 22 06:45:22.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:24.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.464996562s
Jan 22 06:45:24.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:26.165: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.468324564s
Jan 22 06:45:26.165: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:28.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.464952648s
Jan 22 06:45:28.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:30.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.465320287s
Jan 22 06:45:30.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:32.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.465372124s
Jan 22 06:45:32.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:34.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.465014876s
Jan 22 06:45:34.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:36.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.465519756s
Jan 22 06:45:36.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:38.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.46517575s
Jan 22 06:45:38.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:40.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.465278201s
Jan 22 06:45:40.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:42.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.465405753s
Jan 22 06:45:42.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:44.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.465363784s
Jan 22 06:45:44.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:46.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.464947484s
Jan 22 06:45:46.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:48.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.465205895s
Jan 22 06:45:48.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:50.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.465231113s
Jan 22 06:45:50.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:52.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.465339249s
Jan 22 06:45:52.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:54.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.465495984s
Jan 22 06:45:54.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:56.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.465352242s
Jan 22 06:45:56.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:45:58.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.465204894s
Jan 22 06:45:58.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:00.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.464587073s
Jan 22 06:46:00.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:02.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.465373257s
Jan 22 06:46:02.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:04.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.464936972s
Jan 22 06:46:04.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:06.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.465196561s
Jan 22 06:46:06.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:08.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.465116128s
Jan 22 06:46:08.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:10.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.465332374s
Jan 22 06:46:10.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:12.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.465340694s
Jan 22 06:46:12.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:14.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.465077718s
Jan 22 06:46:14.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:16.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.464708212s
Jan 22 06:46:16.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:18.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.465367127s
Jan 22 06:46:18.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:20.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.465187111s
Jan 22 06:46:20.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:22.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.465427415s
Jan 22 06:46:22.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:24.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.465017511s
Jan 22 06:46:24.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:26.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.46505134s
Jan 22 06:46:26.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:28.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.465386644s
Jan 22 06:46:28.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:30.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.465175772s
Jan 22 06:46:30.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:32.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.465352764s
Jan 22 06:46:32.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:34.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.46544277s
Jan 22 06:46:34.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:36.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.465073826s
Jan 22 06:46:36.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:38.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.465408482s
Jan 22 06:46:38.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:40.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.465373702s
Jan 22 06:46:40.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:42.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.465359585s
Jan 22 06:46:42.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:44.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.465527023s
Jan 22 06:46:44.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:46.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.465601106s
Jan 22 06:46:46.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:48.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.464866803s
Jan 22 06:46:48.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:50.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.465185445s
Jan 22 06:46:50.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:52.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.465524936s
Jan 22 06:46:52.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:54.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.465369451s
Jan 22 06:46:54.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:56.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.465110928s
Jan 22 06:46:56.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:46:58.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.465231763s
Jan 22 06:46:58.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:00.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.465435456s
Jan 22 06:47:00.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:02.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.465167268s
Jan 22 06:47:02.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:04.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.464965195s
Jan 22 06:47:04.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:06.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.465907582s
Jan 22 06:47:06.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:08.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.465355152s
Jan 22 06:47:08.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:10.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.465374568s
Jan 22 06:47:10.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:12.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.465279879s
Jan 22 06:47:12.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:14.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.464648775s
Jan 22 06:47:14.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:16.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.465213916s
Jan 22 06:47:16.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:18.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.464576702s
Jan 22 06:47:18.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:20.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.465198734s
Jan 22 06:47:20.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:22.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.464733814s
Jan 22 06:47:22.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:24.166: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.469105914s
Jan 22 06:47:24.166: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:26.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.464650862s
Jan 22 06:47:26.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:28.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.464424076s
Jan 22 06:47:28.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:30.164: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.46653275s
Jan 22 06:47:30.164: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:32.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.465672967s
Jan 22 06:47:32.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:34.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.465052252s
Jan 22 06:47:34.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:36.162: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.465223243s
Jan 22 06:47:36.162: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:38.163: INFO: Pod "httpd": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.466151591s
Jan 22 06:47:38.163: INFO: Error evaluating pod condition running and ready: want pod 'httpd' on 'i-0f0efd5c06406af22' to be 'Running' but was 'Pending'
Jan 22 06:47:40.164: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 4m36.467163932s
Jan 22 06:47:40.164: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-0f0efd5c06406af22' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:03 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:03 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:03 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:03 +0000 UTC }]
Jan 22 06:47:42.162: INFO: Pod "httpd": Phase="Running", Reason="", readiness=false. Elapsed: 4m38.464513998s
Jan 22 06:47:42.162: INFO: Error evaluating pod condition running and ready: pod 'httpd' on 'i-0f0efd5c06406af22' didn't have condition {Ready True}; conditions: [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:03 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:03 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:03 +0000 UTC ContainersNotReady containers with unready status: [httpd]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:43:03 +0000 UTC }]
Jan 22 06:47:44.162: INFO: Pod "httpd": Phase="Running", Reason="", readiness=true. Elapsed: 4m40.465166514s
Jan 22 06:47:44.162: INFO: Pod "httpd" satisfied condition "running and ready"
Jan 22 06:47:44.162: INFO: Wanted all 1 pods to be running and ready. Result: true. Pods: [httpd]
[It] should support inline execution and attach
test/e2e/kubectl/kubectl.go:593
�[1mSTEP:�[0m executing a command with run and attach with stdin �[38;5;243m01/22/23 06:47:44.162�[0m
Jan 22 06:47:44.163: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9636 run run-test --image=registry.k8s.io/e2e-test-images/busybox:1.29-4 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --stdin -- sh -c echo -n read: && cat && echo 'stdin closed''
Jan 22 06:49:44.962: INFO: rc: 1
Jan 22 06:49:44.962: INFO: Unexpected error:
<exec.CodeExitError>: {
Err: <*errors.errorString | 0xc0010d6090>{
s: "error running /home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9636 run run-test --image=registry.k8s.io/e2e-test-images/busybox:1.29-4 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --stdin -- sh -c echo -n read: && cat && echo 'stdin closed':\nCommand stdout:\n\nstderr:\nerror: timed out waiting for the condition\n\nerror:\nexit status 1",
},
Code: 1,
}
Jan 22 06:49:44.962: FAIL: error running /home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9636 run run-test --image=registry.k8s.io/e2e-test-images/busybox:1.29-4 --restart=OnFailure --pod-running-timeout=2m0s --attach=true --stdin -- sh -c echo -n read: && cat && echo 'stdin closed':
Command stdout:
stderr:
error: timed out waiting for the condition
error:
exit status 1
Full Stack Trace
k8s.io/kubernetes/test/e2e/framework/kubectl.KubectlBuilder.ExecOrDie({0xc000d0fa20?, 0x0?}, {0xc005189ba0, 0xc})
test/e2e/framework/kubectl/builder.go:87 +0x1b4
k8s.io/kubernetes/test/e2e/kubectl.glob..func1.8.8()
test/e2e/kubectl/kubectl.go:609 +0x2af
[AfterEach] Simple pod
test/e2e/kubectl/kubectl.go:417
�[1mSTEP:�[0m using delete to clean up resources �[38;5;243m01/22/23 06:49:44.962�[0m
Jan 22 06:49:44.962: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9636 delete --grace-period=0 --force -f -'
Jan 22 06:49:46.021: INFO: stderr: "Warning: Immediate deletion does not wait for confirmation that the running resource has been terminated. The resource may continue to run on the cluster indefinitely.\n"
Jan 22 06:49:46.021: INFO: stdout: "pod \"httpd\" force deleted\n"
Jan 22 06:49:46.021: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9636 get rc,svc -l name=httpd --no-headers'
Jan 22 06:49:47.074: INFO: stderr: "No resources found in kubectl-9636 namespace.\n"
Jan 22 06:49:47.075: INFO: stdout: ""
Jan 22 06:49:47.075: INFO: Running '/home/prow/go/src/k8s.io/kops/_rundir/c1d7ac1c-9a1c-11ed-a697-56ea552f9d82/kubectl --server=https://api.e2e-e2e-kops-grid-cilium-eni-u2004-k26.test-cncf-aws.k8s.io --kubeconfig=/root/.kube/config --namespace=kubectl-9636 get pods -l name=httpd -o go-template={{ range .items }}{{ if not .metadata.deletionTimestamp }}{{ .metadata.name }}{{ "\n" }}{{ end }}{{ end }}'
Jan 22 06:49:47.882: INFO: stderr: ""
Jan 22 06:49:47.882: INFO: stdout: ""
[AfterEach] [sig-cli] Kubectl client
test/e2e/framework/node/init/init.go:32
Jan 22 06:49:47.882: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
[DeferCleanup (Each)] [sig-cli] Kubectl client
test/e2e/framework/metrics/init/init.go:33
[DeferCleanup (Each)] [sig-cli] Kubectl client
dump namespaces | framework.go:196
�[1mSTEP:�[0m dump namespace information after failure �[38;5;243m01/22/23 06:49:48.115�[0m
�[1mSTEP:�[0m Collecting events from namespace "kubectl-9636". �[38;5;243m01/22/23 06:49:48.115�[0m
�[1mSTEP:�[0m Found 26 events. �[38;5;243m01/22/23 06:49:48.348�[0m
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:43:03 +0000 UTC - event for httpd: {default-scheduler } Scheduled: Successfully assigned kubectl-9636/httpd to i-0f0efd5c06406af22
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:43:03 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c59f69188130155ecb6d3d35dd1a1fa83a78c4b3fd657ad88baeb03471389926": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:43:18 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "487a8ba1635c909423e84dc2e1795f8e5700950486e2c174d30e69b882577914": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:43:29 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "5bad40c685f2d309b208f08f7abf0c275ce8c4ff54b37b8581bd4922f492c2ec": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:43:44 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "c99f810d1d3c93d4e10e194496dc5ed9984316ac19458f92d52e784ce47dbbd3": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:43:57 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "8ee0298e6238d7f882e94c3ef83bc17452dd085ad282efc14fe9159ef112d33e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:44:09 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cfcd66d69f59e04bb0a4e04fb86155930f2d626b7a29b85bd66aff5b18e26304": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:44:23 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "d04c409174cd039fe15026b24745b786af938c745b879bde544716a8c12153ba": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:44:37 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b191e1f237be1c5d98ce91a7b39854970b1d1b75afb2fc5a6294d968cf9eb84b": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:44:51 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "eb1f9cfd48fca868aaed02341c7ca3d07f34fd14e51de51c583ef4f814c0a866": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:45:05 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "25168a0269598619ae9babaa0a4230a58067eec970909773e1ba38cb6946ac12": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:47:38 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} Created: Created container httpd
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:47:38 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} Started: Started container httpd
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:47:38 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} Pulled: Container image "registry.k8s.io/e2e-test-images/httpd:2.4.38-4" already present on machine
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:47:44 +0000 UTC - event for run-test: {default-scheduler } Scheduled: Successfully assigned kubectl-9636/run-test to i-0ae272b208fd17383
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:47:45 +0000 UTC - event for run-test: {kubelet i-0ae272b208fd17383} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "50b3135134784286a4b9c1d1a76b32b2a7f5454c2aab9fd56ab76506dd6848c7": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:47:58 +0000 UTC - event for run-test: {kubelet i-0ae272b208fd17383} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "cf4ea01dd0d69b382cc5cc95b8bb39a65b52cc98f3d9a6f02c6febe1482eb07d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:48:11 +0000 UTC - event for run-test: {kubelet i-0ae272b208fd17383} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "378375144eaa636471552906cc1bcc4cc298eee3965bed95515da50ba9d573a8": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:48:23 +0000 UTC - event for run-test: {kubelet i-0ae272b208fd17383} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "ab751afa20507aee0d1cfae1446ab01b27f0c1977432fd3669f7c745119e1717": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:48:36 +0000 UTC - event for run-test: {kubelet i-0ae272b208fd17383} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "999f9f1732c992f896159550b627e1e2936147df17573e2f4fbb7e746e1ce9e2": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:48:51 +0000 UTC - event for run-test: {kubelet i-0ae272b208fd17383} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "e3251fb9b6e4c7fd2f2a3d285a2107b3ed0600d023746b3c4b92b01b36aecbb1": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:49:04 +0000 UTC - event for run-test: {kubelet i-0ae272b208fd17383} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "db60082f202711f7d0ebb7cb485f7f373b64eebea3f7c2e923d630d1dcf5e960": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:49:19 +0000 UTC - event for run-test: {kubelet i-0ae272b208fd17383} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "2423a1ff6ba93c1d85555c25a7f527a3ae817e1f98eee001c2ad9886d13f3394": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:49:34 +0000 UTC - event for run-test: {kubelet i-0ae272b208fd17383} FailedCreatePodSandBox: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b68335eea9284da16eaf1801b3a66389212bc3b32b69e62ea596960b209f6d8e": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:49:45 +0000 UTC - event for httpd: {kubelet i-0f0efd5c06406af22} Killing: Stopping container httpd
Jan 22 06:49:48.348: INFO: At 2023-01-22 06:49:48 +0000 UTC - event for run-test: {kubelet i-0ae272b208fd17383} FailedCreatePodSandBox: (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "a701202a825f8e6a6d33bcd2875a51ef4c71f8f0b9120ddf9ca118f0da63551d": plugin type="cilium-cni" name="cilium" failed (add): unable to allocate IP via local cilium agent: [POST /ipam][502] postIpamFailure No more IPs available
Jan 22 06:49:48.582: INFO: POD NODE PHASE GRACE CONDITIONS
Jan 22 06:49:48.582: INFO: run-test i-0ae272b208fd17383 Pending [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:47:44 +0000 UTC } {Ready False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:47:44 +0000 UTC ContainersNotReady containers with unready status: [run-test]} {ContainersReady False 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:47:44 +0000 UTC ContainersNotReady containers with unready status: [run-test]} {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2023-01-22 06:47:44 +0000 UTC }]
Jan 22 06:49:48.582: INFO:
Jan 22 06:49:48.815: INFO: Unable to fetch kubectl-9636/run-test/run-test logs: the server rejected our request for an unknown reason (get pods run-test)
Jan 22 06:49:49.048: INFO:
Logging node info for node i-0784fefc7d59ccdae
Jan 22 06:49:49.281: INFO: Node Info: &Node{ObjectMeta:{i-0784fefc7d59ccdae 578f4339-1faa-4298-ac96-27aed9bc236a 33107 0 2023-01-22 06:24:10 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:c5.large beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kops.k8s.io/kops-controller-pki: kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0784fefc7d59ccdae kubernetes.io/os:linux node-role.kubernetes.io/control-plane: node.kubernetes.io/exclude-from-external-load-balancers: node.kubernetes.io/instance-type:c5.large topology.ebs.csi.aws.com/zone:ap-south-1a topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.129 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0784fefc7d59ccdae"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{kubelet Update v1 2023-01-22 06:24:10 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {protokube Update v1 2023-01-22 06:24:39 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kops.k8s.io/kops-controller-pki":{},"f:node-role.kubernetes.io/control-plane":{},"f:node.kubernetes.io/exclude-from-external-load-balancers":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:24:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.0.0/24\"":{}}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{},"f:taints":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:02 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kubelet Update v1 2023-01-22 06:47:09 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{}}},"f:status":{"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.0.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0784fefc7d59ccdae,Unschedulable:false,Taints:[]Taint{Taint{Key:node-role.kubernetes.io/control-plane,Value:,Effect:NoSchedule,TimeAdded:<nil>,},},ConfigSource:nil,PodCIDRs:[100.96.0.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3892297728 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3787440128 0} {<nil>} BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:06 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:09 +0000 UTC,LastTransitionTime:2023-01-22 06:24:55 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.129,},NodeAddress{Type:ExternalIP,Address:43.205.229.145,},NodeAddress{Type:InternalDNS,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0784fefc7d59ccdae.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-43-205-229-145.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2cca4041964650860029288f425941,SystemUUID:ec2cca40-4196-4650-8600-29288f425941,BootID:6d7bd66f-7345-4f07-a0a9-6dcf8a9b9a01,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[registry.k8s.io/etcdadm/etcd-manager@sha256:66a453db625abb268f4b3bbefc5a34a171d81e6e8796cecca54cfd71775c77c4 registry.k8s.io/etcdadm/etcd-manager:v3.0.20221209],SizeBytes:231502799,},ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/kube-apiserver-amd64:v1.26.1],SizeBytes:135178704,},ContainerImage{Names:[registry.k8s.io/kube-controller-manager-amd64:v1.26.1],SizeBytes:124995897,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/kube-scheduler-amd64:v1.26.1],SizeBytes:57661752,},ContainerImage{Names:[registry.k8s.io/kops/kops-controller:1.27.0-alpha.1],SizeBytes:43643680,},ContainerImage{Names:[registry.k8s.io/kops/dns-controller:1.27.0-alpha.1],SizeBytes:42841303,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[quay.io/cilium/operator@sha256:a6d24a006a6b92967ac90786b49bc1ac26e5477cf028cd1186efcfc2466484db quay.io/cilium/operator:v1.12.5],SizeBytes:26802430,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:122bfb8c1edabb3c0edd63f06523e6940d958d19b3957dc7b1d6f81e9f1f6119 registry.k8s.io/sig-storage/csi-provisioner:v3.1.0],SizeBytes:23345856,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:9ebbf9f023e7b41ccee3d52afe39a89e3ddacdbb69269d583abfc25847cfd9e4 registry.k8s.io/sig-storage/csi-resizer:v1.4.0],SizeBytes:22381475,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:8b9c313c05f54fb04f8d430896f5f5904b6cb157df261501b29adc04d2b2dc7b registry.k8s.io/sig-storage/csi-attacher:v3.4.0],SizeBytes:22085298,},ContainerImage{Names:[registry.k8s.io/provider-aws/cloud-controller-manager@sha256:fdeb61e3e42ecd9cca868d550ebdb88dd6341d9e91fcfa9a37e227dab2ad22cb registry.k8s.io/provider-aws/cloud-controller-manager:v1.26.0],SizeBytes:20154862,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/kops/kube-apiserver-healthcheck:1.27.0-alpha.1],SizeBytes:4965801,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[],VolumesAttached:[]AttachedVolume{},Config:nil,},}
Jan 22 06:49:49.281: INFO:
Logging kubelet events for node i-0784fefc7d59ccdae
Jan 22 06:49:49.516: INFO:
Logging pods the kubelet thinks is on node i-0784fefc7d59ccdae
Jan 22 06:49:49.754: INFO: kube-apiserver-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+2 container statuses recorded)
Jan 22 06:49:49.754: INFO: Container healthcheck ready: true, restart count 0
Jan 22 06:49:49.754: INFO: Container kube-apiserver ready: true, restart count 1
Jan 22 06:49:49.754: INFO: kube-controller-manager-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:49.754: INFO: Container kube-controller-manager ready: true, restart count 2
Jan 22 06:49:49.754: INFO: etcd-manager-events-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:49.754: INFO: Container etcd-manager ready: true, restart count 0
Jan 22 06:49:49.754: INFO: kops-controller-l7kst started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:49.754: INFO: Container kops-controller ready: true, restart count 0
Jan 22 06:49:49.754: INFO: aws-cloud-controller-manager-md9vc started at 2023-01-22 06:24:40 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:49.754: INFO: Container aws-cloud-controller-manager ready: true, restart count 0
Jan 22 06:49:49.754: INFO: cilium-operator-5dd44dc49f-2hpqt started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:49.754: INFO: Container cilium-operator ready: true, restart count 1
Jan 22 06:49:49.754: INFO: etcd-manager-main-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:49.754: INFO: Container etcd-manager ready: true, restart count 0
Jan 22 06:49:49.754: INFO: kube-scheduler-i-0784fefc7d59ccdae started at 2023-01-22 06:23:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:49.754: INFO: Container kube-scheduler ready: true, restart count 0
Jan 22 06:49:49.754: INFO: ebs-csi-node-2wncs started at 2023-01-22 06:24:40 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:49:49.754: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:49:49.754: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:49:49.754: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:49:49.754: INFO: cilium-dphgw started at 2023-01-22 06:24:40 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:49:49.754: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:49:49.754: INFO: Container cilium-agent ready: true, restart count 1
Jan 22 06:49:49.754: INFO: dns-controller-69987775c6-gdndv started at 2023-01-22 06:24:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:49.754: INFO: Container dns-controller ready: true, restart count 0
Jan 22 06:49:49.754: INFO: ebs-csi-controller-5bd98b456f-xxxj2 started at 2023-01-22 06:24:41 +0000 UTC (0+5 container statuses recorded)
Jan 22 06:49:49.754: INFO: Container csi-attacher ready: true, restart count 0
Jan 22 06:49:49.754: INFO: Container csi-provisioner ready: true, restart count 0
Jan 22 06:49:49.754: INFO: Container csi-resizer ready: true, restart count 0
Jan 22 06:49:49.754: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:49:49.754: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:49:50.503: INFO:
Latency metrics for node i-0784fefc7d59ccdae
Jan 22 06:49:50.503: INFO:
Logging node info for node i-08fe7e7767ef6cb6b
Jan 22 06:49:50.736: INFO: Node Info: &Node{ObjectMeta:{i-08fe7e7767ef6cb6b 2145b9b6-87c4-4056-9d33-2bdbd91f3e25 34635 0 2023-01-22 06:25:50 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a io.kubernetes.storage.mock/node:some-mock-node kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-08fe7e7767ef6cb6b kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-08fe7e7767ef6cb6b topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.53.140 csi.volume.kubernetes.io/nodeid:{"csi-mock-csi-mock-volumes-6487":"i-08fe7e7767ef6cb6b","ebs.csi.aws.com":"i-08fe7e7767ef6cb6b"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.1.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:50 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:49:10 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:49:27 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:io.kubernetes.storage.mock/node":{},"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.1.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-08fe7e7767ef6cb6b,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.1.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:10 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:10 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:10 +0000 UTC,LastTransitionTime:2023-01-22 06:25:50 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:49:10 +0000 UTC,LastTransitionTime:2023-01-22 06:26:08 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.53.140,},NodeAddress{Type:ExternalIP,Address:15.206.168.164,},NodeAddress{Type:InternalDNS,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-08fe7e7767ef6cb6b.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-15-206-168-164.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec244e84b4a6ab10c46e08d94bf33aed,SystemUUID:ec244e84-b4a6-ab10-c46e-08d94bf33aed,BootID:d699615e-6b18-42f3-878b-638f85804381,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7],SizeBytes:2110879,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/csi-mock-csi-mock-volumes-6487^d59ef7b4-9a20-11ed-8c0b-9a4b66333a9e kubernetes.io/csi/ebs.csi.aws.com^vol-0319e775eeab878e5 kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0319e775eeab878e5,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0999ff177fe1d42e1,DevicePath:,},},Config:nil,},}
Jan 22 06:49:50.736: INFO:
Logging kubelet events for node i-08fe7e7767ef6cb6b
Jan 22 06:49:50.971: INFO:
Logging pods the kubelet thinks is on node i-08fe7e7767ef6cb6b
Jan 22 06:49:51.211: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wj87w started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:51.211: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-s7ksv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:51.211: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gpz5p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:51.211: INFO: csi-mockplugin-attacher-0 started at 2023-01-22 06:48:03 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:49:51.211: INFO: hostexec-i-08fe7e7767ef6cb6b-hvhc4 started at 2023-01-22 06:45:03 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:49:51.211: INFO: pod-secrets-8bddb517-320a-4b52-ada4-d992ad1e745c started at 2023-01-22 06:47:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container secret-volume-test ready: false, restart count 0
Jan 22 06:49:51.211: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-wc9kg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:51.211: INFO: csi-mockplugin-0 started at 2023-01-22 06:48:03 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container csi-provisioner ready: true, restart count 0
Jan 22 06:49:51.211: INFO: Container driver-registrar ready: true, restart count 0
Jan 22 06:49:51.211: INFO: Container mock ready: true, restart count 0
Jan 22 06:49:51.211: INFO: pvc-volume-tester-274d7 started at 2023-01-22 06:48:54 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container volume-tester ready: false, restart count 0
Jan 22 06:49:51.211: INFO: termination-message-container962263c0-ea82-48ad-a838-91a02214c13e started at 2023-01-22 06:49:02 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container termination-message-container ready: false, restart count 0
Jan 22 06:49:51.211: INFO: pod-subpath-test-preprovisionedpv-shw9 started at 2023-01-22 06:45:13 +0000 UTC (2+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Init container init-volume-preprovisionedpv-shw9 ready: false, restart count 0
Jan 22 06:49:51.211: INFO: Init container test-init-subpath-preprovisionedpv-shw9 ready: false, restart count 0
Jan 22 06:49:51.211: INFO: Container test-container-subpath-preprovisionedpv-shw9 ready: false, restart count 0
Jan 22 06:49:51.211: INFO: cilium-dc97x started at 2023-01-22 06:25:51 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:49:51.211: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:49:51.211: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cfk97 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:51.211: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-b8jbr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:51.211: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-l8cqz started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:49:51.211: INFO: pod-server-1 started at 2023-01-22 06:47:41 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:49:51.211: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hgtwv started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:51.211: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6zw5t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:51.211: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-hvhkb started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:51.211: INFO: pod-server-2 started at 2023-01-22 06:49:36 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container agnhost-container ready: false, restart count 0
Jan 22 06:49:51.211: INFO: pod-bf1c715d-36e6-4b21-a7c8-c46782ba49bd started at 2023-01-22 06:42:07 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container write-pod ready: false, restart count 0
Jan 22 06:49:51.211: INFO: ss-1 started at 2023-01-22 06:42:43 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container webserver ready: true, restart count 0
Jan 22 06:49:51.211: INFO: netserver-0 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container webserver ready: false, restart count 0
Jan 22 06:49:51.211: INFO: ebs-csi-node-l5r6q started at 2023-01-22 06:25:51 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:49:51.211: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:49:51.211: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:49:51.211: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:49:52.052: INFO:
Latency metrics for node i-08fe7e7767ef6cb6b
Jan 22 06:49:52.052: INFO:
Logging node info for node i-0ae272b208fd17383
Jan 22 06:49:52.284: INFO: Node Info: &Node{ObjectMeta:{i-0ae272b208fd17383 8e603661-0a86-4442-9629-8fb60195f947 34469 0 2023-01-22 06:25:55 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0ae272b208fd17383 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0ae272b208fd17383 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.42.122 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0ae272b208fd17383"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.4.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:48:58 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:49:05 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.4.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0ae272b208fd17383,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.4.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:05 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:05 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:05 +0000 UTC,LastTransitionTime:2023-01-22 06:25:55 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:49:05 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.42.122,},NodeAddress{Type:ExternalIP,Address:13.233.206.115,},NodeAddress{Type:InternalDNS,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0ae272b208fd17383.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-206-115.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec2696eee3a2748c57a2a7a5dcde49ea,SystemUUID:ec2696ee-e3a2-748c-57a2-a7a5dcde49ea,BootID:d7d392b7-67d7-4101-be08-ed3bfe242022,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/etcd@sha256:dd75ec974b0a2a6f6bb47001ba09207976e625db898d1b16735528c009cb171c registry.k8s.io/etcd:3.5.6-0],SizeBytes:102542580,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/sample-apiserver@sha256:8d70890151aa5d096f331cb9da1b9cd5be0412b7363fe67b5c3befdcaa2a28d0 registry.k8s.io/e2e-test-images/sample-apiserver:1.17.7],SizeBytes:25667066,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/regression-issue-74839@sha256:b4f1d8d61bdad84bd50442d161d5460e4019d53e989b64220fdbc62fc87d76bf registry.k8s.io/e2e-test-images/regression-issue-74839:1.2],SizeBytes:18651485,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c kubernetes.io/csi/ebs.csi.aws.com^vol-0a2e75d3fa837517a],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-011c4ca5fc1fc580c,DevicePath:,},AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-0a2e75d3fa837517a,DevicePath:,},},Config:nil,},}
Jan 22 06:49:52.285: INFO:
Logging kubelet events for node i-0ae272b208fd17383
Jan 22 06:49:52.519: INFO:
Logging pods the kubelet thinks is on node i-0ae272b208fd17383
Jan 22 06:49:52.760: INFO: run-test started at 2023-01-22 06:47:44 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container run-test ready: false, restart count 0
Jan 22 06:49:52.760: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-5nknv started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:52.760: INFO: coredns-559769c974-j8pxd started at 2023-01-22 06:26:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container coredns ready: true, restart count 0
Jan 22 06:49:52.760: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-224vl started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:52.760: INFO: inline-volume-tester-cpf2m started at 2023-01-22 06:47:34 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container csi-volume-tester ready: true, restart count 0
Jan 22 06:49:52.760: INFO: ebs-csi-node-x6xfs started at 2023-01-22 06:25:56 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:49:52.760: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:49:52.760: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:49:52.760: INFO: svc-latency-rc-zqln2 started at 2023-01-22 06:48:14 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container svc-latency-rc ready: false, restart count 0
Jan 22 06:49:52.760: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-gv8d9 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:52.760: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-jhxvf started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:49:52.760: INFO: ss-2 started at 2023-01-22 06:48:56 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container webserver ready: false, restart count 0
Jan 22 06:49:52.760: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-nqs66 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:52.760: INFO: cilium-svdg2 started at 2023-01-22 06:25:56 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:49:52.760: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:49:52.760: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:49:03 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:49:52.760: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:49:52.760: INFO: Container csi-resizer ready: false, restart count 0
Jan 22 06:49:52.760: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 22 06:49:52.760: INFO: Container hostpath ready: false, restart count 0
Jan 22 06:49:52.760: INFO: Container liveness-probe ready: false, restart count 0
Jan 22 06:49:52.760: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 22 06:49:52.760: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-j8nx8 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:52.760: INFO: netserver-1 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container webserver ready: true, restart count 0
Jan 22 06:49:52.760: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-89kjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:52.760: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2rgjd started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:52.760: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-tgn4t started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:52.760: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-94drq started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:52.760: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:53.552: INFO:
Latency metrics for node i-0ae272b208fd17383
Jan 22 06:49:53.552: INFO:
Logging node info for node i-0f0efd5c06406af22
Jan 22 06:49:53.784: INFO: Node Info: &Node{ObjectMeta:{i-0f0efd5c06406af22 d621d241-d0c1-4fcd-95f1-3043a1e318e5 34751 0 2023-01-22 06:25:54 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f0efd5c06406af22 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f0efd5c06406af22 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.38.247 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f0efd5c06406af22"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.3.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:54 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:59 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:31 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:49:40 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.3.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f0efd5c06406af22,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.3.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051677184 0} {<nil>} 3956716Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946819584 0} {<nil>} 3854316Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:13 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:13 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:49:13 +0000 UTC,LastTransitionTime:2023-01-22 06:25:54 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:49:13 +0000 UTC,LastTransitionTime:2023-01-22 06:26:10 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.38.247,},NodeAddress{Type:ExternalIP,Address:13.232.42.154,},NodeAddress{Type:InternalDNS,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f0efd5c06406af22.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-232-42-154.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec27fd43a8a03a2384a7278d59d4ca0e,SystemUUID:ec27fd43-a8a0-3a23-84a7-278d59d4ca0e,BootID:5cf896d3-1ac6-483b-85fc-643267ffe608,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nautilus@sha256:80ba6c8c44f9623f06e868a1aa66026c8ec438ad814f9ec95e9333b415fe3550 registry.k8s.io/e2e-test-images/nautilus:1.7],SizeBytes:49641698,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonewprivs@sha256:8ac1264691820febacf3aea5d152cbde6d10685731ec14966a9401c6f47a68ac registry.k8s.io/e2e-test-images/nonewprivs:1.3],SizeBytes:3263463,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-09a0f75b25c27c1b4,DevicePath:,},},Config:nil,},}
Jan 22 06:49:53.785: INFO:
Logging kubelet events for node i-0f0efd5c06406af22
Jan 22 06:49:54.019: INFO:
Logging pods the kubelet thinks is on node i-0f0efd5c06406af22
Jan 22 06:49:54.258: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8n6lz started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:54.258: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lm57z started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:54.258: INFO: hostexec-i-0f0efd5c06406af22-ztx2q started at 2023-01-22 06:47:36 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:49:54.258: INFO: httpd started at 2023-01-22 06:48:37 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container httpd ready: false, restart count 0
Jan 22 06:49:54.258: INFO: pod-c969c034-86fd-4603-9b07-49c4d8c6f476 started at 2023-01-22 06:48:13 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container write-pod ready: false, restart count 0
Jan 22 06:49:54.258: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2k9d6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:54.258: INFO: hostexec-i-0f0efd5c06406af22-4wfcp started at 2023-01-22 06:48:04 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container agnhost-container ready: true, restart count 0
Jan 22 06:49:54.258: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-pc777 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:54.258: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-lms68 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:54.258: INFO: netserver-2 started at 2023-01-22 06:47:28 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container webserver ready: false, restart count 0
Jan 22 06:49:54.258: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-swsd5 started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:54.258: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-d5vgg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:49:54.258: INFO: proxy-service-chtwd-rjv5v started at 2023-01-22 06:49:35 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container proxy-service-chtwd ready: true, restart count 0
Jan 22 06:49:54.258: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-kdjqj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:54.258: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-dvbvr started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:54.258: INFO: ss-0 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container webserver ready: true, restart count 0
Jan 22 06:49:54.258: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-sdq2g started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:54.258: INFO: pod-subpath-test-preprovisionedpv-jrsm started at 2023-01-22 06:47:56 +0000 UTC (2+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Init container init-volume-preprovisionedpv-jrsm ready: false, restart count 0
Jan 22 06:49:54.258: INFO: Init container test-init-volume-preprovisionedpv-jrsm ready: false, restart count 0
Jan 22 06:49:54.258: INFO: Container test-container-subpath-preprovisionedpv-jrsm ready: false, restart count 0
Jan 22 06:49:54.258: INFO: e2e-configmap-dns-server-f02b67dc-3110-446b-8668-2f483f3d9525 started at 2023-01-22 06:48:58 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container agnhost-container ready: false, restart count 0
Jan 22 06:49:54.258: INFO: ebs-csi-node-nf6tg started at 2023-01-22 06:25:55 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:49:54.258: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:49:54.258: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:49:54.258: INFO: csi-mockplugin-0 started at 2023-01-22 06:47:48 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:49:54.258: INFO: Container driver-registrar ready: false, restart count 0
Jan 22 06:49:54.258: INFO: Container mock ready: false, restart count 0
Jan 22 06:49:54.258: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:47:59 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:49:54.258: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:49:54.258: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:49:54.258: INFO: Container csi-resizer ready: false, restart count 0
Jan 22 06:49:54.258: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 22 06:49:54.258: INFO: Container hostpath ready: false, restart count 0
Jan 22 06:49:54.258: INFO: Container liveness-probe ready: false, restart count 0
Jan 22 06:49:54.258: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 22 06:49:54.258: INFO: cilium-g9f7f started at 2023-01-22 06:25:55 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:49:54.258: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:49:54.258: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:49:55.063: INFO:
Latency metrics for node i-0f0efd5c06406af22
Jan 22 06:49:55.063: INFO:
Logging node info for node i-0f65ec97613c55060
Jan 22 06:49:55.296: INFO: Node Info: &Node{ObjectMeta:{i-0f65ec97613c55060 3b12d6e2-1a35-47ff-9dac-e4586b70e64b 33734 0 2023-01-22 06:25:51 +0000 UTC <nil> <nil> map[beta.kubernetes.io/arch:amd64 beta.kubernetes.io/instance-type:t3.medium beta.kubernetes.io/os:linux failure-domain.beta.kubernetes.io/region:ap-south-1 failure-domain.beta.kubernetes.io/zone:ap-south-1a kubelet_cleanup:true kubernetes.io/arch:amd64 kubernetes.io/hostname:i-0f65ec97613c55060 kubernetes.io/os:linux node-role.kubernetes.io/node: node.kubernetes.io/instance-type:t3.medium topology.ebs.csi.aws.com/zone:ap-south-1a topology.hostpath.csi/node:i-0f65ec97613c55060 topology.kubernetes.io/region:ap-south-1 topology.kubernetes.io/zone:ap-south-1a] map[alpha.kubernetes.io/provided-node-ip:172.20.54.23 csi.volume.kubernetes.io/nodeid:{"ebs.csi.aws.com":"i-0f65ec97613c55060"} node.alpha.kubernetes.io/ttl:0 volumes.kubernetes.io/controller-managed-attach-detach:true] [] [] [{aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:beta.kubernetes.io/instance-type":{},"f:failure-domain.beta.kubernetes.io/region":{},"f:failure-domain.beta.kubernetes.io/zone":{},"f:node.kubernetes.io/instance-type":{},"f:topology.kubernetes.io/region":{},"f:topology.kubernetes.io/zone":{}}},"f:spec":{"f:providerID":{}}} } {aws-cloud-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:status":{"f:addresses":{"k:{\"type\":\"ExternalDNS\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"ExternalIP\"}":{".":{},"f:address":{},"f:type":{}},"k:{\"type\":\"Hostname\"}":{"f:address":{}},"k:{\"type\":\"InternalDNS\"}":{".":{},"f:address":{},"f:type":{}}}}} status} {kops-controller Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:node-role.kubernetes.io/node":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:node.alpha.kubernetes.io/ttl":{}}},"f:spec":{"f:podCIDR":{},"f:podCIDRs":{".":{},"v:\"100.96.2.0/24\"":{}}}} } {kubelet Update v1 2023-01-22 06:25:51 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{".":{},"f:alpha.kubernetes.io/provided-node-ip":{},"f:volumes.kubernetes.io/controller-managed-attach-detach":{}},"f:labels":{".":{},"f:beta.kubernetes.io/arch":{},"f:beta.kubernetes.io/os":{},"f:kubernetes.io/arch":{},"f:kubernetes.io/hostname":{},"f:kubernetes.io/os":{}}}} } {e2e.test Update v1 2023-01-22 06:41:58 +0000 UTC FieldsV1 {"f:metadata":{"f:labels":{"f:kubelet_cleanup":{}}}} } {kube-controller-manager Update v1 2023-01-22 06:47:53 +0000 UTC FieldsV1 {"f:status":{"f:volumesAttached":{}}} status} {kubelet Update v1 2023-01-22 06:47:55 +0000 UTC FieldsV1 {"f:metadata":{"f:annotations":{"f:csi.volume.kubernetes.io/nodeid":{}},"f:labels":{"f:topology.ebs.csi.aws.com/zone":{},"f:topology.hostpath.csi/node":{}}},"f:status":{"f:allocatable":{"f:ephemeral-storage":{}},"f:conditions":{"k:{\"type\":\"DiskPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"MemoryPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"PIDPressure\"}":{"f:lastHeartbeatTime":{}},"k:{\"type\":\"Ready\"}":{"f:lastHeartbeatTime":{},"f:lastTransitionTime":{},"f:message":{},"f:reason":{},"f:status":{}}},"f:images":{},"f:volumesInUse":{}}} status}]},Spec:NodeSpec{PodCIDR:100.96.2.0/24,DoNotUseExternalID:,ProviderID:aws:///ap-south-1a/i-0f65ec97613c55060,Unschedulable:false,Taints:[]Taint{},ConfigSource:nil,PodCIDRs:[100.96.2.0/24],},Status:NodeStatus{Capacity:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{49753808896 0} {<nil>} BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{4051685376 0} {<nil>} 3956724Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{2 0} {<nil>} 2 DecimalSI},ephemeral-storage: {{44778427933 0} {<nil>} 44778427933 DecimalSI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{3946827776 0} {<nil>} 3854324Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[]NodeCondition{NodeCondition{Type:MemoryPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientMemory,Message:kubelet has sufficient memory available,},NodeCondition{Type:DiskPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasNoDiskPressure,Message:kubelet has no disk pressure,},NodeCondition{Type:PIDPressure,Status:False,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:25:51 +0000 UTC,Reason:KubeletHasSufficientPID,Message:kubelet has sufficient PID available,},NodeCondition{Type:Ready,Status:True,LastHeartbeatTime:2023-01-22 06:47:55 +0000 UTC,LastTransitionTime:2023-01-22 06:26:06 +0000 UTC,Reason:KubeletReady,Message:kubelet is posting ready status. AppArmor enabled,},},Addresses:[]NodeAddress{NodeAddress{Type:InternalIP,Address:172.20.54.23,},NodeAddress{Type:ExternalIP,Address:13.233.125.79,},NodeAddress{Type:InternalDNS,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:Hostname,Address:i-0f65ec97613c55060.ap-south-1.compute.internal,},NodeAddress{Type:ExternalDNS,Address:ec2-13-233-125-79.ap-south-1.compute.amazonaws.com,},},DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:ec29271f6fcb1e589a5709b97d78e95d,SystemUUID:ec29271f-6fcb-1e58-9a57-09b97d78e95d,BootID:67de0a94-242d-47e1-96b0-5dc05022ee13,KernelVersion:5.15.0-1028-aws,OSImage:Ubuntu 20.04.5 LTS,ContainerRuntimeVersion:containerd://1.6.15,KubeletVersion:v1.26.1,KubeProxyVersion:v1.26.1,OperatingSystem:linux,Architecture:amd64,},Images:[]ContainerImage{ContainerImage{Names:[quay.io/cilium/cilium@sha256:06ce2b0a0a472e73334a7504ee5c5d8b2e2d7b72ef728ad94e564740dd505be5 quay.io/cilium/cilium:v1.12.5],SizeBytes:166719855,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/jessie-dnsutils@sha256:24aaf2626d6b27864c29de2097e8bbb840b3a414271bf7c8995e431e47d8408e registry.k8s.io/e2e-test-images/jessie-dnsutils:1.7],SizeBytes:112030336,},ContainerImage{Names:[registry.k8s.io/kube-proxy-amd64:v1.26.1],SizeBytes:67205316,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/agnhost@sha256:16bbf38c463a4223d8cfe4da12bc61010b082a79b4bb003e2d3ba3ece5dd5f9e registry.k8s.io/e2e-test-images/agnhost:2.43],SizeBytes:51706353,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:3fe7acf013d1264ffded116b80a73dc129a449b0fccdb8d21af8279f2233f36e registry.k8s.io/e2e-test-images/httpd:2.4.39-4],SizeBytes:41901587,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/httpd@sha256:148b022f5c5da426fc2f3c14b5c0867e58ef05961510c84749ac1fddcb0fef22 registry.k8s.io/e2e-test-images/httpd:2.4.38-4],SizeBytes:40764257,},ContainerImage{Names:[registry.k8s.io/provider-aws/aws-ebs-csi-driver@sha256:f0c5de192d832e7c1daa6580d4a62e8fa6fc8eabc0917ae4cb7ed4d15e95b59e registry.k8s.io/provider-aws/aws-ebs-csi-driver:v1.14.1],SizeBytes:29725845,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-provisioner@sha256:ee3b525d5b89db99da3b8eb521d9cd90cb6e9ef0fbb651e98bb37be78d36b5b8 registry.k8s.io/sig-storage/csi-provisioner:v3.3.0],SizeBytes:25491225,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-resizer@sha256:425d8f1b769398127767b06ed97ce62578a3179bcb99809ce93a1649e025ffe7 registry.k8s.io/sig-storage/csi-resizer:v1.6.0],SizeBytes:24148884,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-snapshotter@sha256:291334908ddf71a4661fd7f6d9d97274de8a5378a2b6fdfeb2ce73414a34f82f registry.k8s.io/sig-storage/csi-snapshotter:v6.1.0],SizeBytes:23881995,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-attacher@sha256:9a685020911e2725ad019dbce6e4a5ab93d51e3d4557f115e64343345e05781b registry.k8s.io/sig-storage/csi-attacher:v4.0.0],SizeBytes:23847201,},ContainerImage{Names:[registry.k8s.io/cpa/cluster-proportional-autoscaler@sha256:68d396900aeaa072c1f27289485fdac29834045a6f3ffe369bf389d830ef572d registry.k8s.io/cpa/cluster-proportional-autoscaler:1.8.6],SizeBytes:20293261,},ContainerImage{Names:[registry.k8s.io/sig-storage/hostpathplugin@sha256:92257881c1d6493cf18299a24af42330f891166560047902b8d431fb66b01af5 registry.k8s.io/sig-storage/hostpathplugin:v1.9.0],SizeBytes:18758628,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nonroot@sha256:ee9f50b3c64b174d296d91ca9f69a914ac30e59095dfb462b2b518ad28a63655 registry.k8s.io/e2e-test-images/nonroot:1.4],SizeBytes:17747885,},ContainerImage{Names:[registry.k8s.io/coredns/coredns@sha256:017727efcfeb7d053af68e51436ce8e65edbc6ca573720afb4f79c8594036955 registry.k8s.io/coredns/coredns:v1.10.0],SizeBytes:15273057,},ContainerImage{Names:[registry.k8s.io/sig-storage/csi-node-driver-registrar@sha256:0103eee7c35e3e0b5cd8cdca9850dc71c793cdeb6669d8be7a89440da2d06ae4 registry.k8s.io/sig-storage/csi-node-driver-registrar:v2.5.1],SizeBytes:9133109,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:933940f13b3ea0abc62e656c1aa5c5b47c04b15d71250413a6b821bd0c58b94e registry.k8s.io/sig-storage/livenessprobe:v2.7.0],SizeBytes:8688564,},ContainerImage{Names:[registry.k8s.io/sig-storage/livenessprobe@sha256:406f59599991916d2942d8d02f076d957ed71b541ee19f09fc01723a6e6f5932 registry.k8s.io/sig-storage/livenessprobe:v2.6.0],SizeBytes:8240918,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:db048754ae68ae337d8fa96494c96d2a1204c3320f5dcf7e8e71085adec85da6 registry.k8s.io/e2e-test-images/nginx:1.15-4],SizeBytes:7000082,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/nginx@sha256:5c99cf6a02adda929b10321dbf4ecfa00d87be9ba4fb456006237d530ab4baa1 registry.k8s.io/e2e-test-images/nginx:1.14-4],SizeBytes:6978614,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:c318242786b139d18676b1c09a0ad7f15fc17f8f16a5b2e625cd0dc8c9703daf registry.k8s.io/e2e-test-images/busybox:1.29-2],SizeBytes:732424,},ContainerImage{Names:[registry.k8s.io/e2e-test-images/busybox@sha256:2e0f836850e09b8b7cc937681d6194537a09fbd5f6b9e08f4d646a85128e8937 registry.k8s.io/e2e-test-images/busybox:1.29-4],SizeBytes:731990,},ContainerImage{Names:[registry.k8s.io/pause@sha256:7031c1b283388d2c2e09b57badb803c05ebed362dc88d84b480cc47f72a21097 registry.k8s.io/pause:3.9],SizeBytes:321520,},ContainerImage{Names:[registry.k8s.io/pause@sha256:3d380ca8864549e74af4b29c10f9cb0956236dfb01c40ca076fb6c37253234db registry.k8s.io/pause:3.6],SizeBytes:301773,},},VolumesInUse:[kubernetes.io/csi/ebs.csi.aws.com^vol-08f4126003dfe4110],VolumesAttached:[]AttachedVolume{AttachedVolume{Name:kubernetes.io/csi/ebs.csi.aws.com^vol-08f4126003dfe4110,DevicePath:,},},Config:nil,},}
Jan 22 06:49:55.296: INFO:
Logging kubelet events for node i-0f65ec97613c55060
Jan 22 06:49:55.531: INFO:
Logging pods the kubelet thinks is on node i-0f65ec97613c55060
Jan 22 06:49:55.773: INFO: pod-client started at 2023-01-22 06:43:18 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container pod-client ready: true, restart count 0
Jan 22 06:49:55.773: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-cct9p started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:55.773: INFO: netserver-3 started at 2023-01-22 06:47:29 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container webserver ready: false, restart count 0
Jan 22 06:49:55.773: INFO: inline-volume-tester2-5g7d4 started at 2023-01-22 06:47:51 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container csi-volume-tester ready: false, restart count 0
Jan 22 06:49:55.773: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdhsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:55.773: INFO: ebs-csi-node-wnt99 started at 2023-01-22 06:25:52 +0000 UTC (0+3 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container ebs-plugin ready: true, restart count 0
Jan 22 06:49:55.773: INFO: Container liveness-probe ready: true, restart count 0
Jan 22 06:49:55.773: INFO: Container node-driver-registrar ready: true, restart count 0
Jan 22 06:49:55.773: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-2zr97 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: false, restart count 0
Jan 22 06:49:55.773: INFO: hostpath-injector started at 2023-01-22 06:48:03 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container hostpath-injector ready: false, restart count 0
Jan 22 06:49:55.773: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:48:12 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container csi-resizer ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container hostpath ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container liveness-probe ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 22 06:49:55.773: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-n4scw started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:55.773: INFO: coredns-559769c974-s8kkg started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container coredns ready: true, restart count 0
Jan 22 06:49:55.773: INFO: busybox-readonly-true-2fe51bf6-e622-4739-b4d8-f2c74b6c4b49 started at 2023-01-22 06:47:49 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container busybox-readonly-true-2fe51bf6-e622-4739-b4d8-f2c74b6c4b49 ready: false, restart count 0
Jan 22 06:49:55.773: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6wbqw started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:55.773: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8sv6x started at 2023-01-22 06:41:59 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:55.773: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-52gsg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:55.773: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-6bwjg started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:55.773: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-vdcz6 started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:55.773: INFO: cilium-582c5 started at 2023-01-22 06:25:52 +0000 UTC (1+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Init container clean-cilium-state ready: true, restart count 0
Jan 22 06:49:55.773: INFO: Container cilium-agent ready: true, restart count 0
Jan 22 06:49:55.773: INFO: coredns-autoscaler-7cb5c5b969-jts8s started at 2023-01-22 06:26:06 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container autoscaler ready: true, restart count 0
Jan 22 06:49:55.773: INFO: csi-hostpathplugin-0 started at 2023-01-22 06:47:58 +0000 UTC (0+7 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container csi-attacher ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container csi-provisioner ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container csi-resizer ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container csi-snapshotter ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container hostpath ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container liveness-probe ready: false, restart count 0
Jan 22 06:49:55.773: INFO: Container node-driver-registrar ready: false, restart count 0
Jan 22 06:49:55.773: INFO: cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0-8qsbj started at 2023-01-22 06:42:00 +0000 UTC (0+1 container statuses recorded)
Jan 22 06:49:55.773: INFO: Container cleanup40-0a1058cc-c9a8-43c0-b449-04364a9f6ad0 ready: true, restart count 0
Jan 22 06:49:56.741: INFO:
Latency metrics for node i-0f65ec97613c55060
[DeferCleanup (Each)] [sig-cli] Kubectl client
tear down framework | framework.go:193
�[1mSTEP:�[0m Destroying namespace "kubectl-9636" for this suite. �[38;5;243m01/22/23 06:49:56.741�[0m
from junit_01.xml
Filter through log files | View test history on testgrid
go run hack/e2e.go -v --test --test_args='--ginkgo.focus=Kubernetes\se2e\ssuite\s\[It\]\s\[sig\-network\]\sConntrack\sshould\sbe\sable\sto\spreserve\sUDP\straffic\swhen\sserver\spod\scycles\sfor\sa\sNodePort\sservice$'
test/e2e/framework/pod/pod_client.go:107 k8s.io/kubernetes/test/e2e/framework/pod.(*PodClient).CreateSync(0xc001011590, 0xc00301d470?) test/e2e/framework/pod/pod_client.go:107 +0x94 k8s.io/kubernetes/test/e2e/network.glob..func1.3() test/e2e/network/conntrack.go:189 +0xa1f
[BeforeEach] [sig-network] Conntrack set up framework | framework.go:178 �[1mSTEP:�[0m Creating a kubernetes client �[38;5;243m01/22/23 06:43:16�[0m Jan 22 06:43:16.000: INFO: >>> kubeConfig: /root/.kube/config �[1mSTEP:�[0m Building a namespace api object, basename conntrack �[38;5;243m01/22/23 06:43:16.001�[0m �[1mSTEP:�[0m Waiting for a default service account to be provisioned in namespace �[38;5;243m01/22/23 06:43:16.707�[0m �[1mSTEP:�[0m Waiting for kube-root-ca.crt to be provisioned in namespace �[38;5;243m01/22/23 06:43:17.176�[0m [BeforeEach] [sig-network] Conntrack test/e2e/framework/metrics/init/init.go:31 [BeforeEach] [sig-network] Conntrack test/e2e/network/conntrack.go:98 [It] should be able to preserve UDP traffic when server pod cycles for a NodePort service test/e2e/network/conntrack.go:132 �[1mSTEP:�[0m creating a UDP service svc-udp with type=NodePort in conntrack-9793 �[38;5;243m01/22/23 06:43:17.88�[0m �[1mSTEP:�[0m creating a client pod for probing the service svc-udp �[38;5;243m01/22/23 06:43:18.132�[0m Jan 22 06:43:18.370: INFO: Waiting up to 5m0s for pod "pod-client" in namespace "conntrack-9793" to be "running and ready" Jan 22 06:43:18.604: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 234.706281ms Jan 22 06:43:18.604: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:20.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2.469854887s Jan 22 06:43:20.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:22.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4.470119876s Jan 22 06:43:22.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:24.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 6.469636402s Jan 22 06:43:24.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:26.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 8.470347813s Jan 22 06:43:26.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:28.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 10.470783528s Jan 22 06:43:28.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:30.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 12.469869244s Jan 22 06:43:30.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:32.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 14.469775902s Jan 22 06:43:32.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:34.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 16.470388547s Jan 22 06:43:34.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:36.841: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 18.470899999s Jan 22 06:43:36.841: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:38.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 20.470144612s Jan 22 06:43:38.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:40.841: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 22.470885118s Jan 22 06:43:40.841: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:42.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 24.469802914s Jan 22 06:43:42.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:44.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 26.469666731s Jan 22 06:43:44.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:46.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 28.4698747s Jan 22 06:43:46.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:48.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 30.469575416s Jan 22 06:43:48.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:50.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 32.469843236s Jan 22 06:43:50.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:52.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 34.469886077s Jan 22 06:43:52.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:54.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 36.469874246s Jan 22 06:43:54.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:56.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 38.470477599s Jan 22 06:43:56.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:43:58.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 40.469830577s Jan 22 06:43:58.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:00.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 42.470147914s Jan 22 06:44:00.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:02.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 44.469817888s Jan 22 06:44:02.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:04.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 46.469975929s Jan 22 06:44:04.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:06.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 48.470577158s Jan 22 06:44:06.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:08.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 50.470498923s Jan 22 06:44:08.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:10.841: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 52.471161075s Jan 22 06:44:10.841: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:12.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 54.469735807s Jan 22 06:44:12.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:14.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 56.46980963s Jan 22 06:44:14.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:16.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 58.470582795s Jan 22 06:44:16.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:18.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.470528021s Jan 22 06:44:18.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:20.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.469492581s Jan 22 06:44:20.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:22.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.470369155s Jan 22 06:44:22.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:24.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.46987912s Jan 22 06:44:24.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:26.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.470595676s Jan 22 06:44:26.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:28.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.470703079s Jan 22 06:44:28.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:30.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.47068724s Jan 22 06:44:30.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:32.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.470765926s Jan 22 06:44:32.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:34.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.470674067s Jan 22 06:44:34.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:36.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.470267743s Jan 22 06:44:36.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:38.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.469875692s Jan 22 06:44:38.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:40.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.470204416s Jan 22 06:44:40.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:42.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.469811396s Jan 22 06:44:42.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:44.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.47066548s Jan 22 06:44:44.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:46.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.470168602s Jan 22 06:44:46.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:48.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.469788861s Jan 22 06:44:48.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:50.841: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.470858053s Jan 22 06:44:50.841: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:52.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.469687785s Jan 22 06:44:52.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:54.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.46961038s Jan 22 06:44:54.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:56.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.469588652s Jan 22 06:44:56.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:44:58.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.470622339s Jan 22 06:44:58.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:00.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.470198841s Jan 22 06:45:00.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:02.841: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.470947858s Jan 22 06:45:02.841: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:04.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.470759322s Jan 22 06:45:04.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:06.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.470464232s Jan 22 06:45:06.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:08.841: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.470909682s Jan 22 06:45:08.841: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:10.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.470155275s Jan 22 06:45:10.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:12.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.469716001s Jan 22 06:45:12.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:14.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.47018887s Jan 22 06:45:14.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:16.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.470765645s Jan 22 06:45:16.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:18.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.469716915s Jan 22 06:45:18.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:20.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.470610244s Jan 22 06:45:20.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:22.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.470455915s Jan 22 06:45:22.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:24.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.469729592s Jan 22 06:45:24.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:26.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.470316829s Jan 22 06:45:26.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:28.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.47025522s Jan 22 06:45:28.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:30.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.469516004s Jan 22 06:45:30.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:32.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.469540784s Jan 22 06:45:32.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:34.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.469643653s Jan 22 06:45:34.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:36.843: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.473423113s Jan 22 06:45:36.843: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:38.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.470642665s Jan 22 06:45:38.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:40.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.4698048s Jan 22 06:45:40.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:42.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.469737491s Jan 22 06:45:42.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:44.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.469742932s Jan 22 06:45:44.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:46.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.469838975s Jan 22 06:45:46.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:48.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.469711699s Jan 22 06:45:48.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:50.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.469900779s Jan 22 06:45:50.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:52.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.469709942s Jan 22 06:45:52.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:54.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.470756733s Jan 22 06:45:54.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:56.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.470107803s Jan 22 06:45:56.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:45:58.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.469732116s Jan 22 06:45:58.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:00.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.470581373s Jan 22 06:46:00.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:02.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.469799059s Jan 22 06:46:02.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:04.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.470259825s Jan 22 06:46:04.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:06.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.470586908s Jan 22 06:46:06.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:08.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.470627448s Jan 22 06:46:08.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:10.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.470379078s Jan 22 06:46:10.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:12.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.469816128s Jan 22 06:46:12.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:14.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.469950869s Jan 22 06:46:14.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:16.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.470759735s Jan 22 06:46:16.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:18.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.469955797s Jan 22 06:46:18.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:20.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.470631487s Jan 22 06:46:20.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:22.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.469662413s Jan 22 06:46:22.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:24.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.469653721s Jan 22 06:46:24.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:26.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.470089301s Jan 22 06:46:26.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:28.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.469988916s Jan 22 06:46:28.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:30.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.47033752s Jan 22 06:46:30.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:32.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.470801571s Jan 22 06:46:32.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:34.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.469797841s Jan 22 06:46:34.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:36.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.470585659s Jan 22 06:46:36.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:38.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.469600704s Jan 22 06:46:38.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:40.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.470377095s Jan 22 06:46:40.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:42.841: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.4715814s Jan 22 06:46:42.841: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:44.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.469656877s Jan 22 06:46:44.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:46.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.470614683s Jan 22 06:46:46.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:48.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.469651581s Jan 22 06:46:48.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:50.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.469703212s Jan 22 06:46:50.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:52.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.470335711s Jan 22 06:46:52.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:54.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.470202691s Jan 22 06:46:54.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:56.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.469831876s Jan 22 06:46:56.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:46:58.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.46972132s Jan 22 06:46:58.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:00.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.469749116s Jan 22 06:47:00.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:02.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.47017488s Jan 22 06:47:02.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:04.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.46964598s Jan 22 06:47:04.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:06.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.470623025s Jan 22 06:47:06.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:08.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.469984802s Jan 22 06:47:08.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:10.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.470735963s Jan 22 06:47:10.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:12.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.469692569s Jan 22 06:47:12.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:14.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.470691825s Jan 22 06:47:14.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:16.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.46962675s Jan 22 06:47:16.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:18.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.4698082s Jan 22 06:47:18.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:20.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.469757285s Jan 22 06:47:20.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:22.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.46999863s Jan 22 06:47:22.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:24.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.47042957s Jan 22 06:47:24.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:26.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.469751201s Jan 22 06:47:26.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:28.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.470398249s Jan 22 06:47:28.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:30.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.470801713s Jan 22 06:47:30.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:32.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.470578741s Jan 22 06:47:32.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:34.841: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.471006721s Jan 22 06:47:34.841: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:36.840: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.470483301s Jan 22 06:47:36.840: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:38.839: INFO: Pod "pod-client": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.469559076s Jan 22 06:47:38.839: INFO: The phase of Pod pod-client is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:40.839: INFO: Pod "pod-client": Phase="Running", Reason="", readiness=true. Elapsed: 4m22.469582361s Jan 22 06:47:40.839: INFO: The phase of Pod pod-client is Running (Ready = true) Jan 22 06:47:40.839: INFO: Pod "pod-client" satisfied condition "running and ready" Jan 22 06:47:41.311: INFO: Pod client logs: Sun Jan 22 06:47:39 UTC 2023 Sun Jan 22 06:47:39 UTC 2023 Try: 1 �[1mSTEP:�[0m creating a backend pod pod-server-1 for the service svc-udp �[38;5;243m01/22/23 06:47:41.311�[0m Jan 22 06:47:41.548: INFO: Waiting up to 5m0s for pod "pod-server-1" in namespace "conntrack-9793" to be "running and ready" Jan 22 06:47:41.783: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 234.444164ms Jan 22 06:47:41.783: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:44.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 2.469385861s Jan 22 06:47:44.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:46.019: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 4.470615369s Jan 22 06:47:46.019: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:48.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 6.46994216s Jan 22 06:47:48.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:50.021: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 8.472738909s Jan 22 06:47:50.021: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:52.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 10.46941471s Jan 22 06:47:52.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:54.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 12.469331247s Jan 22 06:47:54.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:56.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 14.469352134s Jan 22 06:47:56.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:47:58.022: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 16.474335304s Jan 22 06:47:58.022: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:00.020: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 18.471688459s Jan 22 06:48:00.020: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:02.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 20.470178149s Jan 22 06:48:02.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:04.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 22.470071571s Jan 22 06:48:04.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:06.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 24.469769498s Jan 22 06:48:06.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:08.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 26.469927212s Jan 22 06:48:08.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:10.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 28.469293846s Jan 22 06:48:10.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:12.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 30.469175502s Jan 22 06:48:12.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:14.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 32.469079023s Jan 22 06:48:14.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:16.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 34.469532983s Jan 22 06:48:16.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:18.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 36.469611091s Jan 22 06:48:18.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:20.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 38.469132156s Jan 22 06:48:20.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:22.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 40.469173106s Jan 22 06:48:22.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:24.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 42.469084657s Jan 22 06:48:24.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:26.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 44.469969695s Jan 22 06:48:26.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:28.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 46.469116134s Jan 22 06:48:28.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:30.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 48.469310309s Jan 22 06:48:30.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:32.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 50.469200772s Jan 22 06:48:32.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:34.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 52.469271304s Jan 22 06:48:34.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:36.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 54.469718446s Jan 22 06:48:36.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:38.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 56.470124197s Jan 22 06:48:38.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:40.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 58.469497183s Jan 22 06:48:40.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:42.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.469853511s Jan 22 06:48:42.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:44.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.469115733s Jan 22 06:48:44.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:46.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.470286597s Jan 22 06:48:46.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:48.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.469082937s Jan 22 06:48:48.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:50.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.470057622s Jan 22 06:48:50.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:52.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.469142694s Jan 22 06:48:52.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:54.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.469230798s Jan 22 06:48:54.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:56.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.470354484s Jan 22 06:48:56.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:48:58.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.4695183s Jan 22 06:48:58.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:00.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.469053837s Jan 22 06:49:00.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:02.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.469382918s Jan 22 06:49:02.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:04.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.469811411s Jan 22 06:49:04.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:06.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.470021493s Jan 22 06:49:06.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:08.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.469162591s Jan 22 06:49:08.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:10.019: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.47118032s Jan 22 06:49:10.019: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:12.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.470384279s Jan 22 06:49:12.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:14.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.469008626s Jan 22 06:49:14.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:16.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.46978284s Jan 22 06:49:16.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:18.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.469437337s Jan 22 06:49:18.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:20.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.469809628s Jan 22 06:49:20.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:22.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.469243528s Jan 22 06:49:22.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:24.017: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.469152631s Jan 22 06:49:24.017: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:26.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.469511112s Jan 22 06:49:26.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:28.018: INFO: Pod "pod-server-1": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.469534726s Jan 22 06:49:28.018: INFO: The phase of Pod pod-server-1 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:30.018: INFO: Pod "pod-server-1": Phase="Running", Reason="", readiness=true. Elapsed: 1m48.469924597s Jan 22 06:49:30.018: INFO: The phase of Pod pod-server-1 is Running (Ready = true) Jan 22 06:49:30.018: INFO: Pod "pod-server-1" satisfied condition "running and ready" �[1mSTEP:�[0m waiting up to 3m0s for service svc-udp in namespace conntrack-9793 to expose endpoints map[pod-server-1:[80]] �[38;5;243m01/22/23 06:49:30.253�[0m Jan 22 06:49:31.191: INFO: successfully validated that service svc-udp in namespace conntrack-9793 exposes endpoints map[pod-server-1:[80]] �[1mSTEP:�[0m checking client pod connected to the backend 1 on Node IP 172.20.53.140 �[38;5;243m01/22/23 06:49:31.191�[0m �[1mSTEP:�[0m creating a second backend pod pod-server-2 for the service svc-udp �[38;5;243m01/22/23 06:49:36.668�[0m Jan 22 06:49:36.907: INFO: Waiting up to 5m0s for pod "pod-server-2" in namespace "conntrack-9793" to be "running and ready" Jan 22 06:49:37.142: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 234.815715ms Jan 22 06:49:37.142: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:39.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2.47017977s Jan 22 06:49:39.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:41.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4.470718855s Jan 22 06:49:41.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:43.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 6.470513608s Jan 22 06:49:43.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:45.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 8.469801842s Jan 22 06:49:45.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:47.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 10.470570111s Jan 22 06:49:47.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:49.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 12.470604159s Jan 22 06:49:49.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:51.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 14.470419245s Jan 22 06:49:51.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:53.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 16.471031695s Jan 22 06:49:53.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:55.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 18.470572033s Jan 22 06:49:55.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:57.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 20.47027549s Jan 22 06:49:57.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:49:59.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 22.470399057s Jan 22 06:49:59.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:01.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 24.470386935s Jan 22 06:50:01.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:03.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 26.470522777s Jan 22 06:50:03.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:05.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 28.470869523s Jan 22 06:50:05.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:07.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 30.470650694s Jan 22 06:50:07.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:09.381: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 32.473953764s Jan 22 06:50:09.381: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:11.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 34.471014401s Jan 22 06:50:11.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:13.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 36.470696447s Jan 22 06:50:13.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:15.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 38.470273286s Jan 22 06:50:15.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:17.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 40.470147051s Jan 22 06:50:17.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:19.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 42.470343936s Jan 22 06:50:19.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:21.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 44.469628876s Jan 22 06:50:21.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:23.380: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 46.473473148s Jan 22 06:50:23.380: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:25.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 48.470677444s Jan 22 06:50:25.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:27.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 50.470416936s Jan 22 06:50:27.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:29.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 52.470059705s Jan 22 06:50:29.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:31.379: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 54.472421924s Jan 22 06:50:31.379: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:33.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 56.471320668s Jan 22 06:50:33.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:35.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 58.470446641s Jan 22 06:50:35.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:37.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m0.470464817s Jan 22 06:50:37.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:39.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m2.469869289s Jan 22 06:50:39.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:41.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m4.470596651s Jan 22 06:50:41.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:43.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m6.470507277s Jan 22 06:50:43.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:45.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m8.470711155s Jan 22 06:50:45.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:47.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m10.47067013s Jan 22 06:50:47.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:49.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m12.470582266s Jan 22 06:50:49.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:51.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m14.470378235s Jan 22 06:50:51.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:53.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m16.471527554s Jan 22 06:50:53.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:55.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m18.470773769s Jan 22 06:50:55.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:57.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m20.470393312s Jan 22 06:50:57.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:50:59.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m22.470885739s Jan 22 06:50:59.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:01.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m24.470829789s Jan 22 06:51:01.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:03.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m26.470668736s Jan 22 06:51:03.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:05.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m28.47041598s Jan 22 06:51:05.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:07.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m30.470574111s Jan 22 06:51:07.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:09.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m32.470749904s Jan 22 06:51:09.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:11.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m34.470131915s Jan 22 06:51:11.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:13.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m36.471007658s Jan 22 06:51:13.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:15.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m38.470676795s Jan 22 06:51:15.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:17.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m40.470746374s Jan 22 06:51:17.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:19.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m42.470486097s Jan 22 06:51:19.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:21.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m44.470224107s Jan 22 06:51:21.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:23.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m46.470306096s Jan 22 06:51:23.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:25.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m48.470621313s Jan 22 06:51:25.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:27.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m50.470659205s Jan 22 06:51:27.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:29.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m52.470533637s Jan 22 06:51:29.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:31.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m54.470852462s Jan 22 06:51:31.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:33.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m56.470979929s Jan 22 06:51:33.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:35.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 1m58.470307898s Jan 22 06:51:35.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:37.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m0.470608724s Jan 22 06:51:37.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:39.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m2.470662006s Jan 22 06:51:39.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:41.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m4.470355732s Jan 22 06:51:41.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:43.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m6.470591395s Jan 22 06:51:43.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:45.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m8.471470934s Jan 22 06:51:45.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:47.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m10.470999065s Jan 22 06:51:47.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:49.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m12.470368848s Jan 22 06:51:49.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:51.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m14.470445319s Jan 22 06:51:51.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:53.379: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m16.471994726s Jan 22 06:51:53.379: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:55.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m18.470358022s Jan 22 06:51:55.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:57.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m20.470055011s Jan 22 06:51:57.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:51:59.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m22.470531765s Jan 22 06:51:59.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:01.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m24.469869893s Jan 22 06:52:01.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:03.379: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m26.472285113s Jan 22 06:52:03.379: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:05.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m28.470323953s Jan 22 06:52:05.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:07.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m30.470246321s Jan 22 06:52:07.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:09.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m32.470438347s Jan 22 06:52:09.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:11.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m34.469959089s Jan 22 06:52:11.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:13.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m36.470444049s Jan 22 06:52:13.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:15.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m38.470344378s Jan 22 06:52:15.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:17.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m40.470388397s Jan 22 06:52:17.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:19.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m42.470504256s Jan 22 06:52:19.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:21.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m44.470775589s Jan 22 06:52:21.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:23.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m46.470582728s Jan 22 06:52:23.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:25.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m48.471293359s Jan 22 06:52:25.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:27.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m50.469726671s Jan 22 06:52:27.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:29.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m52.470336202s Jan 22 06:52:29.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:31.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m54.470232878s Jan 22 06:52:31.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:33.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m56.470702856s Jan 22 06:52:33.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:35.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 2m58.470653105s Jan 22 06:52:35.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:37.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m0.470838589s Jan 22 06:52:37.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:39.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m2.469989903s Jan 22 06:52:39.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:41.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m4.469726924s Jan 22 06:52:41.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:43.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m6.470269621s Jan 22 06:52:43.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:45.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m8.470538919s Jan 22 06:52:45.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:47.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m10.470011717s Jan 22 06:52:47.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:49.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m12.470306891s Jan 22 06:52:49.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:51.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m14.470222386s Jan 22 06:52:51.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:53.379: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m16.471844317s Jan 22 06:52:53.379: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:55.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m18.470605725s Jan 22 06:52:55.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:57.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m20.470376948s Jan 22 06:52:57.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:52:59.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m22.470395456s Jan 22 06:52:59.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:01.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m24.469685334s Jan 22 06:53:01.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:03.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m26.470417416s Jan 22 06:53:03.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:05.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m28.470610126s Jan 22 06:53:05.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:07.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m30.470624451s Jan 22 06:53:07.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:09.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m32.470459898s Jan 22 06:53:09.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:11.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m34.470678027s Jan 22 06:53:11.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:13.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m36.470394942s Jan 22 06:53:13.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:15.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m38.470484433s Jan 22 06:53:15.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:17.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m40.470512928s Jan 22 06:53:17.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:19.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m42.470896045s Jan 22 06:53:19.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:21.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m44.470289382s Jan 22 06:53:21.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:23.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m46.470659738s Jan 22 06:53:23.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:25.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m48.470252371s Jan 22 06:53:25.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:27.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m50.470227583s Jan 22 06:53:27.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:29.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m52.470421592s Jan 22 06:53:29.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:31.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m54.469705387s Jan 22 06:53:31.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:33.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m56.470382494s Jan 22 06:53:33.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:35.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 3m58.470448622s Jan 22 06:53:35.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:37.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m0.470386917s Jan 22 06:53:37.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:39.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m2.470556005s Jan 22 06:53:39.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:41.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m4.469952934s Jan 22 06:53:41.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:43.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m6.471059959s Jan 22 06:53:43.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:45.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m8.470541042s Jan 22 06:53:45.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:47.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m10.470627582s Jan 22 06:53:47.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:49.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m12.470269709s Jan 22 06:53:49.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:51.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m14.470357286s Jan 22 06:53:51.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:53.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m16.47089298s Jan 22 06:53:53.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:55.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m18.470383256s Jan 22 06:53:55.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:57.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m20.469990604s Jan 22 06:53:57.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:53:59.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m22.470476061s Jan 22 06:53:59.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:01.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m24.470042572s Jan 22 06:54:01.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:03.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m26.470444669s Jan 22 06:54:03.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:05.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m28.470306351s Jan 22 06:54:05.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:07.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m30.469900918s Jan 22 06:54:07.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:09.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m32.470398436s Jan 22 06:54:09.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:11.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m34.470695333s Jan 22 06:54:11.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:13.380: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m36.472700387s Jan 22 06:54:13.380: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:15.384: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m38.476935866s Jan 22 06:54:15.384: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:17.379: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m40.472551678s Jan 22 06:54:17.380: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:19.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m42.470667143s Jan 22 06:54:19.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:21.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m44.469878921s Jan 22 06:54:21.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:23.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m46.470737218s Jan 22 06:54:23.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:25.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m48.470501561s Jan 22 06:54:25.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:27.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m50.470942461s Jan 22 06:54:27.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:29.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m52.470750543s Jan 22 06:54:29.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:31.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m54.47018697s Jan 22 06:54:31.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:33.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m56.470236667s Jan 22 06:54:33.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:35.377: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 4m58.470378521s Jan 22 06:54:35.377: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:37.378: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.470842389s Jan 22 06:54:37.378: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:37.613: INFO: Pod "pod-server-2": Phase="Pending", Reason="", readiness=false. Elapsed: 5m0.705568534s Jan 22 06:54:37.613: INFO: The phase of Pod pod-server-2 is Pending, waiting for it to be Running (with Ready = true) Jan 22 06:54:37.614: INFO: Unexpected error: <*pod.timeoutError | 0xc0031b2600>: { msg: "timed out while waiting for pod conntrack-9793/pod-server-2 to be running and ready", observedObjects: [ <*v1.Pod | 0xc001342900>{ TypeMeta: {Kind: "", APIVersion: ""}, ObjectMeta: { Name: "pod-server-2", GenerateName: "", Namespace: "conntrack-9793", SelfLink: "", UID: "517e5855-de82-4f2a-b731-eb5f7ac74d66", ResourceVersion: "34716", Generation: 0, CreationTimestamp: { Time: { wall: 0, ext: 63809966976, loc: { name: "Local", zone: [ {name: "UTC", offset: 0, isDST: false}, ], tx: [ { when: -576460752303423488, index: 0, isstd: false, isutc: false, }, ], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: "UTC", offset: 0, isDST: false}, }, }, }, DeletionTimestamp: nil, DeletionGracePeriodSeconds: nil, Labels: { "testid": "svc-udp-6c559e29-b2f5-42a8-9529-9576e46f651a", }, Annotations: nil, OwnerReferences: nil, Finalizers: nil, ManagedFields: [ { Manager: "e2e.test", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63809966976, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:metadata\":{\"f:labels\":{\".\":{},\"f:testid\":{}}},\"f:spec\":{\"f:affinity\":{\".\":{},\"f:nodeAffinity\":{\".\":{},\"f:requiredDuringSchedulingIgnoredDuringExecution\":{}}},\"f:containers\":{\"k:{\\\"name\\\":\\\"agnhost-container\\\"}\":{\".\":{},\"f:args\":{},\"f:image\":{},\"f:imagePullPolicy\":{},\"f:name\":{},\"f:resources\":{},\"f:securityContext\":{},\"f:terminationMessagePath\":{},\"f:terminationMessagePolicy\":{}}},\"f:dnsPolicy\":{},\"f:enableServiceLinks\":{},\"f:restartPolicy\":{},\"f:schedulerName\":{},\"f:securityContext\":{},\"f:terminationGracePeriodSeconds\":{}}}", }, Subresource: "", }, { Manager: "kubelet", Operation: "Update", APIVersion: "v1", Time: { Time: { wall: 0, ext: 63809966976, loc: { name: "Local", zone: [...], tx: [...], extend: "UTC0", cacheStart: 9223372036854775807, cacheEnd: 9223372036854775807, cacheZone: {name: ..., offset: ..., isDST: ...}, }, }, }, FieldsType: "FieldsV1", FieldsV1: { Raw: "{\"f:status\":{\"f:conditions\":{\"k:{\\\"type\\\":\\\"ContainersReady\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Initialized\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:status\":{},\"f:type\":{}},\"k:{\\\"type\\\":\\\"Ready\\\"}\":{\".\":{},\"f:lastProbeTime\":{},\"f:lastTransitionTime\":{},\"f:message\":{},\"f:reason\":{},\"f:status\":{},\"f:type\":{}}},\"f:containerStatuses\":{},\"f:hostIP\":{},\"f:startTime\":{}}}", }, Subresource: "status", }, ], }, Spec: { Volumes: [ { Name: "kube-api-access-dvz5d", VolumeSource: { HostPath: nil, EmptyDir: nil, GCEPersistentDisk: nil, AWSElasticBlockStore: nil, GitRepo: nil,